Skip to content

UI tests - UserSettings - fix flaky test#24163

Merged
sgiehl merged 1 commit into5.x-devfrom
improve-usersettings-tests
Mar 3, 2026
Merged

UI tests - UserSettings - fix flaky test#24163
sgiehl merged 1 commit into5.x-devfrom
improve-usersettings-tests

Conversation

@tzi
Copy link
Copy Markdown
Contributor

@tzi tzi commented Mar 2, 2026

Description

When the subscribe to newsletter test is too long or had a problem, the next test will be broken and could cause useless screenshot diff (the newsletter section is still there).

Examples

From a failing CI:

SitesManager_search_no_result.png

Processed Expected  Diff
image image image

Checklist

  • [NA] I have understood, reviewed, and tested all AI outputs before use
  • [NA] All AI instructions respect security, IP, and privacy rules

Review

@tzi tzi added this to the 5.9.0 milestone Mar 2, 2026
@tzi tzi added c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. not-in-changelog For issues or pull requests that should not be included in our release changelog on matomo.org. labels Mar 2, 2026
@tzi tzi force-pushed the improve-usersettings-tests branch from 414ffd2 to ab15f82 Compare March 2, 2026 16:45
@tzi tzi force-pushed the improve-usersettings-tests branch from ab15f82 to 5c3c950 Compare March 2, 2026 17:40
@tzi tzi requested a review from a team March 2, 2026 21:27
@sgiehl sgiehl merged commit ea84cd8 into 5.x-dev Mar 3, 2026
69 of 72 checks passed
@sgiehl sgiehl deleted the improve-usersettings-tests branch March 3, 2026 10:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. not-in-changelog For issues or pull requests that should not be included in our release changelog on matomo.org.

Development

Successfully merging this pull request may close these issues.

3 participants