Skip to content

End to End Tests #11087

End to End Tests

End to End Tests #11087

Triggered via merge group September 23, 2025 14:29
Status Success
Total duration 15m 56s
Artifacts 9

end-to-end-tests.yaml

on: merge_group
Build Element-Web
2m 30s
Build Element-Web
Matrix: playwright
Downstream Playwright tests [element-modules]  /  Run Playwright end-to-end tests & upload html report
4m 8s
Downstream Playwright tests [element-modules] / Run Playwright end-to-end tests & upload html report
end-to-end-tests
1m 16s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

6 errors and 6 notices
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:102:13 › Room list › Room list › should open the notification options menu @screenshot: playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L141
1) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:102:13 › Room list › Room list › should open the notification options menu @screenshot Error: expect(page).toHaveScreenshot(expected) 117 pixels (ratio 0.01 of all image pixels) are different. Snapshot: room-list-item-open-notification-options-selection.png Call log: - Expect "toHaveScreenshot(room-list-item-open-notification-options-selection.png)" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 117 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 117 pixels (ratio 0.01 of all image pixels) are different. 139 | // The Mute room option should be selected 140 | await expect(page.getByRole("menuitem", { name: "Mute room" })).toHaveAttribute("aria-selected", "true"); > 141 | await expect(page).toMatchScreenshot("room-list-item-open-notification-options-selection.png"); | ^ 142 | }); 143 | 144 | test("should scroll to the current room", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:141:32
[Chrome] › playwright/e2e/crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM: playwright/pages/toasts.ts#L22
3) [Chrome] › playwright/e2e/crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Toast_toast').filter({ hasText: 'Verification requested' }).first() Expected: visible Received: <element(s) not found> Call log: - Expect "toBeVisible" with timeout 5000ms - waiting for locator('.mx_Toast_toast').filter({ hasText: 'Verification requested' }).first() at ../pages/toasts.ts:22 20 | public async getToast(expectedTitle: string): Promise<Locator> { 21 | const toast = this.page.locator(".mx_Toast_toast", { hasText: expectedTitle }).first(); > 22 | await expect(toast).toBeVisible(); | ^ 23 | return toast; 24 | } 25 | at Toasts.getToast (/home/runner/work/element-web/element-web/playwright/pages/toasts.ts:22:29) at /home/runner/work/element-web/element-web/playwright/e2e/crypto/user-verification.spec.ts:63:36
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event: playwright/e2e/crypto/decryption-failure-messages.spec.ts#L281
2) [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_RoomView').getByRole('button', { name: 'Accept' }) 279 | // Alice accepts the invite 280 | await page.getByRole("option", { name: "Test room" }).click(); > 281 | await page.locator(".mx_RoomView").getByRole("button", { name: "Accept" }).click(); | ^ 282 | 283 | // wait until we're joined and see the timeline 284 | await expect(page.locator(`.mx_EventTile`).getByText("Alice joined the room")).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/crypto/decryption-failure-messages.spec.ts:281:92
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event: playwright/e2e/crypto/decryption-failure-messages.spec.ts#L0
2) [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:249:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:249:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot › Expect "toPass" Error: Test timeout of 30000ms exceeded 19 | await tile.hover(); 20 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); > 21 | }).toPass(); | ^ 22 | await expect(tile.page().getByText("Replying", { exact: true })).toBeVisible(); 23 | }; 24 | at clickButtonReply (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:21:8) at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:277:19
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot: playwright/e2e/timeline/timeline.spec.ts#L1121
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot Error: expect(locator).toHaveScreenshot(expected) 41 pixels (ratio 0.01 of all image pixels) are different. Snapshot: event-tile-reply-chains-irc-modern.png Call log: - Expect "toHaveScreenshot(event-tile-reply-chains-irc-modern.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" data-scroll-tokens="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 29 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" data-scroll-tokens="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 12 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" data-scroll-tokens="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 1119 | 1120 | // Take a snapshot on modern layout > 1121 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot( | ^ 1122 | "event-tile-reply-chains-irc-modern.png", 1123 | screenshotOptions, 1124 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1121:62
🎭 Playwright Run Summary
2 skipped 96 passed (7.9m)
🎭 Playwright Run Summary
2 skipped 96 passed (7.7m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:102:13 › Room list › Room list › should open the notification options menu @screenshot 1 skipped 95 passed (8.6m)
🎭 Playwright Run Summary
44 skipped 59 passed (7.8m)
🎭 Playwright Run Summary
3 flaky [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:249:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event [Chrome] › playwright/e2e/crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM 100 passed (10.1m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot 98 passed (10.5m)

Artifacts

Produced during runtime
Name Size Digest
all-blob-reports-Chrome-1 Expired
16 MB
sha256:b43aa832e69e3cdce7a602b69961348fc4a10e4c85df40c21e1e0b1d748c2134
all-blob-reports-Chrome-2 Expired
7.95 MB
sha256:0fa79aec4b440fc391bd245e6808fc9b333af05dabf6690f7712374230310221
all-blob-reports-Chrome-3 Expired
327 KB
sha256:5ad8fc292da7ac680390e7457d1b2c34605ca1730dc882652a54e285a8a19e97
all-blob-reports-Chrome-4 Expired
449 KB
sha256:79a108894a6939829a27beb057d01907a937f0c19917e0d3d541e638f3c19fe0
all-blob-reports-Chrome-5 Expired
751 KB
sha256:df0de5eccc126a9a5c7bebc46d3951a63da4cdfeb41c091e69a5ad9e65d23475
all-blob-reports-Chrome-6 Expired
5.11 MB
sha256:9c3f5c19aafc89877fa9d4b9ef7183e937d72d3fabe8a90b31df7969444687a5
html-report Expired
28.9 MB
sha256:06883d0dbc0b29cd0dda0b316a781b334c64c2ab84a44052bba85ebb8ac6cbe6
playwright-html-report Expired
256 KB
sha256:8486856fc6a0759db01f6577523e3662505452c54c7da65082f6685909a3d7c2
webapp Expired
38.6 MB
sha256:7b0d1faa78209f25b37cb7449b23e31a8f28c70d1d0cddcdd023874512875bef