Skip to content

Deactivate some thin_replica_server_test.cpp cases#2647

Merged
teoparvanov merged 1 commit intovmware:masterfrom
upshaw-alex:disable-unstable-thin-replica-server-unit-tests
May 20, 2022
Merged

Deactivate some thin_replica_server_test.cpp cases#2647
teoparvanov merged 1 commit intovmware:masterfrom
upshaw-alex:disable-unstable-thin-replica-server-unit-tests

Conversation

@upshaw-alex
Copy link
Copy Markdown
Contributor

@upshaw-alex upshaw-alex commented May 20, 2022

This commit deactivates certain test cases in thin-replica-server/test/thin_replica_server_test.cpp known to be unstable. This is intended to be a temporary measure in order to prevent these failures from blocking other merges, especially others intended to improve stability. The intention is to reactivate these test cases in the near future once a better fix for them can be provided.

  • Problem Overview
    Several test cases with names of the form SubscribeTo*EventGroupUpdate*WithGapTwoClients have been observed to fail intermittently on master. These failures have been observed to be significantly more common for builds with DCMAKE_BUILD_TYPE=DEBUG. These failures are interfering with the ability of developers to merge changes to master, including other changes intended to stabilize the branch.
  • Testing Done
    I have tried building with these changes and with DCMAKE_BUILD_TYPE=DEBUG and running the thin_replica_server_test suite built from thin-replica-server/test/thin_replica_server_test.cpp. This suite has not failed since I reached the current set of deactivated test cases included in this PR, and I have run the suite with these changes and the DEBUG build at least several dozen times (I wanted to have a script run it at least a couple hundred times, but decided I'd probably run the tests enough times after a couple hours with no failures). I've also tried running the suite with a build with the default parameters (i.e. without explicitly providing DCMAKE_BUILD_TYPE=DEBUG) with these changes 32 times, and all of them passed with no failures.

This commit deactivates certain test cases in
thin-replica-server/test/thin_replica_server_test.cpp known to be
unstable. This is intended to be a temporary measure in order to prevent
these failures from blocking other merges, especially others intended to
improve stability. The intention is to reactivate these test cases in
the near future once a better fix for them can be provided.
@upshaw-alex upshaw-alex self-assigned this May 20, 2022
@upshaw-alex upshaw-alex requested a review from a team as a code owner May 20, 2022 01:17
Copy link
Copy Markdown

@teoparvanov teoparvanov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Alex!

@teoparvanov teoparvanov merged commit 16b7558 into vmware:master May 20, 2022
mdarade pushed a commit to mdarade/concord-bft that referenced this pull request Jun 9, 2022
This commit deactivates certain test cases in
thin-replica-server/test/thin_replica_server_test.cpp known to be
unstable. This is intended to be a temporary measure in order to prevent
these failures from blocking other merges, especially others intended to
improve stability. The intention is to reactivate these test cases in
the near future once a better fix for them can be provided.
cloudnoize pushed a commit to cloudnoize/concord-bft that referenced this pull request Jun 28, 2022
This commit deactivates certain test cases in
thin-replica-server/test/thin_replica_server_test.cpp known to be
unstable. This is intended to be a temporary measure in order to prevent
these failures from blocking other merges, especially others intended to
improve stability. The intention is to reactivate these test cases in
the near future once a better fix for them can be provided.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants