Skip to content

Hide successful, skipped Complement tests in the CI#19590

Merged
anoadragon453 merged 12 commits intodevelopfrom
anoa/complement_hide_successful_tests
Mar 23, 2026
Merged

Hide successful, skipped Complement tests in the CI#19590
anoadragon453 merged 12 commits intodevelopfrom
anoa/complement_hide_successful_tests

Conversation

@anoadragon453
Copy link
Copy Markdown
Member

@anoadragon453 anoadragon453 commented Mar 20, 2026

So that the formatted Complement output isn't incredibly long. I never find myself looking at the successful test output anyways, but if one wants to, they can still view the output of the previous step.

This will be more-and-more necessary as we add more tests to Complement over time.

You can see the result of the changes in this CI run (only the failing tests are shown).

The package definitions of entirely-passing runs are still left in, but I figured they were minor (and it's still useful to see which packages are running).

Pull Request Checklist

  • Pull request is based on the develop branch
  • Pull request includes a changelog file. The entry should:
    • Be a short description of your change which makes sense to users. "Fixed a bug that prevented receiving messages from other servers." instead of "Moved X method from EventStore to EventWorkerStore.".
    • Use markdown where necessary, mostly for code blocks.
    • End with either a period (.) or an exclamation mark (!).
    • Start with a capital letter.
    • Feel free to credit yourself, by adding a sentence "Contributed by @github_username." or "Contributed by [Your Name]." to the end of the entry.
  • Code style is correct (run the linters)

So the formatted Complement output isn't incredibly long. I never find
myself looking at the successful test output anyways, but if one wants
to, they can still view the output of the previous step.
This flag only works if you're not customising the default `gotestfmt` template, which we do via `.ci/complement_package.gotpl`.
Without this, setting `HideSuccessfulTests` via the `-hide` argument
would do nothing.
I was confused otherwise. Also clearly document that successful tests
are hidden, in case folks are confused why they may see no or few tests
running.
While this script is clean, it is unused and currently a source of noise.
Complement has not depended on libolm for years. There's no need to keep installing it.
@anoadragon453 anoadragon453 changed the title Hide successful Complement tests in the CI Hide successful, skipped Complement tests in the CI Mar 20, 2026
@anoadragon453 anoadragon453 marked this pull request as ready for review March 20, 2026 18:30
@anoadragon453 anoadragon453 requested a review from a team as a code owner March 20, 2026 18:30
Comment thread changelog.d/19590.misc
@@ -0,0 +1 @@
Only show failing Complement tests in the formatted output in CI. No newline at end of file
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cross-linking the original context where this change is spawning from in the 2026-01-05 weekly backend team meeting.

While discussing #19326, @anoadragon453 mentioned "Since we have a file with the test output now, should we also filter things down to only the failing tests?" and I said "Sounds like a good follow-up especially since that collapsible section output is so laggy in the GitHub UI"

Comment thread .github/workflows/tests.yml Outdated
Comment thread .github/workflows/tests.yml Outdated
anoadragon453 and others added 2 commits March 23, 2026 13:47
Co-authored-by: Eric Eastwood <erice@element.io>
The earlier version made it sound like our template was interpreting the
value of `-hide` directly.
@anoadragon453 anoadragon453 enabled auto-merge (squash) March 23, 2026 13:55
@anoadragon453 anoadragon453 disabled auto-merge March 23, 2026 15:16
@anoadragon453 anoadragon453 merged commit 713aa7e into develop Mar 23, 2026
44 of 46 checks passed
@anoadragon453 anoadragon453 deleted the anoa/complement_hide_successful_tests branch March 23, 2026 15:16
MadLittleMods added a commit that referenced this pull request Mar 30, 2026
Conflicts:
	.github/workflows/tests.yml

Resolve conflicts from #19590
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants