Skip to content

Element Web End to End Tests #3156

Element Web End to End Tests

Element Web End to End Tests #3156

Triggered via merge group March 25, 2025 12:50
Status Success
Total duration 15m 17s
Artifacts 8
Playwright  /  Build Element-Web
2m 16s
Playwright / Build Element-Web
Matrix: Playwright / playwright
Playwright  /  end-to-end-tests
43s
Playwright / end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

9 errors and 6 notices
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: Test timeout of 30000ms exceeded 19 | await tile.hover(); 20 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); > 21 | }).toPass(); | ^ 22 | }; 23 | 24 | test.describe("Audio player", { tag: ["@no-firefox", "@no-webkit"] }, () => { at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:21:8) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:274:19
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L96
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: "route.fetch: Test ended." while running route callback. Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })` before the end of the test to ignore remaining routes in flight. 94 | await route.fulfill({ json: {} }); 95 | await new Promise((f) => setTimeout(f, 1000)); > 96 | await route.fetch(); | ^ 97 | }); 98 | 99 | await logIntoElement(page, credentials); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/device-verification.spec.ts:96:25
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L1
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: apiRequestContext.fetch: Target page, context or browser has been closed Call log: - → POST http://localhost:41891/_synapse/admin/v1/register - user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.6998.35 Safari/537.36 - accept: */* - accept-encoding: gzip,deflate,br - content-type: application/json - content-length: 308 at Api.request (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/@element-hq/element-web-playwright-common/lib/utils/api.js:28:41) at StartedSynapseContainer.registerUserInternal (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/@element-hq/element-web-playwright-common/lib/testcontainers/synapse.js:287:42) at Object.credentials (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/@element-hq/element-web-playwright-common/lib/fixtures/user.js:16:29)
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default: playwright/e2e/app-loading/guest-registration.spec.ts#L1
1) [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default Test timeout of 30000ms exceeded while setting up "homeserver".
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default: playwright/e2e/app-loading/guest-registration.spec.ts#L1
1) [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default Error: (HTTP code 403) unexpected - error while removing network: network 613105df27ab id 8c8687b66492e4350b9f2a0d8eb602212f007cccd26eb14a511862a2e89fa038 has active endpoints at /home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:343:17 at getCause (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:373:7) at Modem.buildPayload (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:342:5) at IncomingMessage.<anonymous> (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:310:16)
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:142:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L158
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:142:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 40 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 40 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 40 pixels (ratio 0.01 of all image pixels) are different. 156 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 157 | > 158 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 159 | }, 160 | ); 161 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:158:61
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L1
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L297
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_GenericEventListSummary').getByRole('button', { name: 'Expand' }) - locator resolved to <div tabindex="0" role="button" aria-expanded="false" class="mx_AccessibleButton mx_GenericEventListSummary_toggle mx_AccessibleButton_hasKind mx_AccessibleButton_kind_link_inline">Expand</div> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events - retrying click action - waiting 100ms 53 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events - retrying click action - waiting 500ms 295 | 296 | // Click "expand" link button > 297 | await page.locator(".mx_GenericEventListSummary").getByRole("button", { name: "Expand" }).click(); | ^ 298 | 299 | // Check the event line has margin instead of inset property 300 | // cf. _EventTile.pcss at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:297:107
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:877:13 › Timeline › message displaying › should render a code block @screenshot: playwright/e2e/timeline/timeline.spec.ts#L895
4) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:877:13 › Timeline › message displaying › should render a code block @screenshot Error: expect(locator).toHaveScreenshot(expected) 16 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/code-block-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-0ac37--should-render-a-code-block-Chrome/code-block-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-0ac37--should-render-a-code-block-Chrome/code-block-diff.png Call log: - expect.toHaveScreenshot(code-block.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="~!lbyOhIdEzmDgLPtawU:localhost:m1742907765147.0" class="mx_EventTile mx_EventTile_sending mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 16 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$gyXwpBQpyBzvx9zvMwWkB339THe4QPu4FDXE_eTniLs" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$gyXwpBQpyBzvx9zvMwWkB339THe4QPu4FDXE_eTniLs">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 16 pixels (ratio 0.01 of all image pixels) are different. 893 | const tile = page.locator(".mx_EventTile"); 894 | await expect(tile).toBeVisible(); > 895 | await expect(tile).toMatchScreenshot("code-block.png", { mask: [page.locator(".mx_MessageTimestamp")] }); | ^ 896 | 897 | // Edit a code block and assert the edited code block has been correctly rendered 898 | await tile.hover(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:895:32
🎭 Playwright Run Summary
43 skipped 39 passed (5.8m)
🎭 Playwright Run Summary
2 skipped 89 passed (6.9m)
🎭 Playwright Run Summary
2 skipped 90 passed (7.4m)
🎭 Playwright Run Summary
2 flaky [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit 85 passed (7.7m)
🎭 Playwright Run Summary
2 skipped 82 passed (7.1m)
🎭 Playwright Run Summary
4 flaky [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default [Chrome] › playwright/e2e/timeline/timeline.spec.ts:142:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:877:13 › Timeline › message displaying › should render a code block @screenshot 72 passed (10.0m)

Artifacts

Produced during runtime
Name Size Digest
all-blob-reports-Chrome-1 Expired
11.6 MB
sha256:7aae4be2e36a0abd35f43960c56daa990f5d3b9b86248f2fa15e42e14dd7858d
all-blob-reports-Chrome-2 Expired
337 KB
sha256:a2cc0e3f75192c45e24b418047cb2077c89667dc0a4c694955bd5dba99a1d264
all-blob-reports-Chrome-3 Expired
244 KB
sha256:0bb04870411f629ce38a3469ab6c7c36589ff848ee1edca23c02da1b8833eb18
all-blob-reports-Chrome-4 Expired
362 KB
sha256:c89868f14e64ace3aeac77ee5ca17012fcce9815cde8d9cb1bb3bdee4dcd972b
all-blob-reports-Chrome-5 Expired
547 KB
sha256:c1cc6e342f7a308dd57d63061407c7d387cd788e75392744c617f8910bf45f69
all-blob-reports-Chrome-6 Expired
14 MB
sha256:0b46f23c42b8f9c70e854dda7b1ce6c66e4ad7a0513523c0fe97385f9c385884
html-report Expired
25.7 MB
sha256:943a0c9d8c2de87ede2dc353b734f1369830118cf7c0b7336ff57555b6fe2a9f
webapp Expired
27.4 MB
sha256:29fab3270952419b90f2a7ede34113e607b6194b78216bee58928d10e2675d3e