Element Web End to End Tests #3156
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element-Web
2m 16s
Matrix: Playwright / playwright
Playwright
/
end-to-end-tests
43s
Annotations
9 errors and 6 notices
|
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Error: Test timeout of 30000ms exceeded
19 | await tile.hover();
20 | await tile.getByRole("button", { name: "Reply", exact: true }).click();
> 21 | }).toPass();
| ^
22 | };
23 |
24 | test.describe("Audio player", { tag: ["@no-firefox", "@no-webkit"] }, () => {
at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:21:8)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:274:19
|
|
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit:
playwright/e2e/crypto/device-verification.spec.ts#L96
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
Error: "route.fetch: Test ended." while running route callback.
Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })`
before the end of the test to ignore remaining routes in flight.
94 | await route.fulfill({ json: {} });
95 | await new Promise((f) => setTimeout(f, 1000));
> 96 | await route.fetch();
| ^
97 | });
98 |
99 | await logIntoElement(page, credentials);
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/device-verification.spec.ts:96:25
|
|
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit:
playwright/e2e/crypto/device-verification.spec.ts#L1
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
Error: apiRequestContext.fetch: Target page, context or browser has been closed
Call log:
- → POST http://localhost:41891/_synapse/admin/v1/register
- user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.6998.35 Safari/537.36
- accept: */*
- accept-encoding: gzip,deflate,br
- content-type: application/json
- content-length: 308
at Api.request (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/@element-hq/element-web-playwright-common/lib/utils/api.js:28:41)
at StartedSynapseContainer.registerUserInternal (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/@element-hq/element-web-playwright-common/lib/testcontainers/synapse.js:287:42)
at Object.credentials (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/@element-hq/element-web-playwright-common/lib/fixtures/user.js:16:29)
|
|
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default:
playwright/e2e/app-loading/guest-registration.spec.ts#L1
1) [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default
Test timeout of 30000ms exceeded while setting up "homeserver".
|
|
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default:
playwright/e2e/app-loading/guest-registration.spec.ts#L1
1) [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default
Error: (HTTP code 403) unexpected - error while removing network: network 613105df27ab id 8c8687b66492e4350b9f2a0d8eb602212f007cccd26eb14a511862a2e89fa038 has active endpoints
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:343:17
at getCause (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:373:7)
at Modem.buildPayload (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:342:5)
at IncomingMessage.<anonymous> (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:310:16)
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:142:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L158
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:142:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
40 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-diff.png
Call log:
- expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 40 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 40 pixels (ratio 0.01 of all image pixels) are different.
156 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today");
157 |
> 158 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png");
| ^
159 | },
160 | );
161 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:158:61
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot
Test timeout of 30000ms exceeded.
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L297
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_GenericEventListSummary').getByRole('button', { name: 'Expand' })
- locator resolved to <div tabindex="0" role="button" aria-expanded="false" class="mx_AccessibleButton mx_GenericEventListSummary_toggle mx_AccessibleButton_hasKind mx_AccessibleButton_kind_link_inline">Expand</div>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events
- retrying click action
- waiting 100ms
53 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events
- retrying click action
- waiting 500ms
295 |
296 | // Click "expand" link button
> 297 | await page.locator(".mx_GenericEventListSummary").getByRole("button", { name: "Expand" }).click();
| ^
298 |
299 | // Check the event line has margin instead of inset property
300 | // cf. _EventTile.pcss
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:297:107
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:877:13 › Timeline › message displaying › should render a code block @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L895
4) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:877:13 › Timeline › message displaying › should render a code block @screenshot
Error: expect(locator).toHaveScreenshot(expected)
16 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/timeline/timeline.spec.ts/code-block-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-0ac37--should-render-a-code-block-Chrome/code-block-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/timeline-timeline-Timeline-0ac37--should-render-a-code-block-Chrome/code-block-diff.png
Call log:
- expect.toHaveScreenshot(code-block.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="~!lbyOhIdEzmDgLPtawU:localhost:m1742907765147.0" class="mx_EventTile mx_EventTile_sending mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 16 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$gyXwpBQpyBzvx9zvMwWkB339THe4QPu4FDXE_eTniLs" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection" data-scroll-tokens="$gyXwpBQpyBzvx9zvMwWkB339THe4QPu4FDXE_eTniLs">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 16 pixels (ratio 0.01 of all image pixels) are different.
893 | const tile = page.locator(".mx_EventTile");
894 | await expect(tile).toBeVisible();
> 895 | await expect(tile).toMatchScreenshot("code-block.png", { mask: [page.locator(".mx_MessageTimestamp")] });
| ^
896 |
897 | // Edit a code block and assert the edited code block has been correctly rendered
898 | await tile.hover();
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:895:32
|
|
🎭 Playwright Run Summary
43 skipped
39 passed (5.8m)
|
|
🎭 Playwright Run Summary
2 skipped
89 passed (6.9m)
|
|
🎭 Playwright Run Summary
2 skipped
90 passed (7.4m)
|
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
85 passed (7.7m)
|
|
🎭 Playwright Run Summary
2 skipped
82 passed (7.1m)
|
|
🎭 Playwright Run Summary
4 flaky
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts:21:5 › Shows the welcome page by default
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:142:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:279:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:877:13 › Timeline › message displaying › should render a code block @screenshot
72 passed (10.0m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
all-blob-reports-Chrome-1
Expired
|
11.6 MB |
sha256:7aae4be2e36a0abd35f43960c56daa990f5d3b9b86248f2fa15e42e14dd7858d
|
|
|
all-blob-reports-Chrome-2
Expired
|
337 KB |
sha256:a2cc0e3f75192c45e24b418047cb2077c89667dc0a4c694955bd5dba99a1d264
|
|
|
all-blob-reports-Chrome-3
Expired
|
244 KB |
sha256:0bb04870411f629ce38a3469ab6c7c36589ff848ee1edca23c02da1b8833eb18
|
|
|
all-blob-reports-Chrome-4
Expired
|
362 KB |
sha256:c89868f14e64ace3aeac77ee5ca17012fcce9815cde8d9cb1bb3bdee4dcd972b
|
|
|
all-blob-reports-Chrome-5
Expired
|
547 KB |
sha256:c1cc6e342f7a308dd57d63061407c7d387cd788e75392744c617f8910bf45f69
|
|
|
all-blob-reports-Chrome-6
Expired
|
14 MB |
sha256:0b46f23c42b8f9c70e854dda7b1ce6c66e4ad7a0513523c0fe97385f9c385884
|
|
|
html-report
Expired
|
25.7 MB |
sha256:943a0c9d8c2de87ede2dc353b734f1369830118cf7c0b7336ff57555b6fe2a9f
|
|
|
webapp
Expired
|
27.4 MB |
sha256:29fab3270952419b90f2a7ede34113e607b6194b78216bee58928d10e2675d3e
|
|