Support downstream js-sdk changes in matrix-js-sdk#5134 #16643
end-to-end-tests.yaml
on: pull_request
Build Element-Web
1m 59s
Matrix: playwright
Downstream Playwright tests [element-modules]
/
Run Playwright end-to-end tests & upload html report
end-to-end-tests
43s
Annotations
4 errors and 6 notices
|
[Chrome] › playwright/e2e/location/location.spec.ts:33:5 › Location sharing › sends and displays pin drop location message successfully @no-firefox @screenshot:
playwright/e2e/location/location.spec.ts#L0
1) [Chrome] › playwright/e2e/location/location.spec.ts:33:5 › Location sharing › sends and displays pin drop location message successfully @no-firefox @screenshot
Fixture "network" timeout of 30000ms exceeded during setup.
at /home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/fixtures/services.js:14:26
|
|
[Chrome] › playwright/e2e/crypto/toasts.spec.ts:35:5 › Key storage out of sync toast › should prompt for recovery key if 'enter recovery key' pressed @screenshot:
playwright/e2e/crypto/toasts.spec.ts#L42
1) [Chrome] › playwright/e2e/crypto/toasts.spec.ts:35:5 › Key storage out of sync toast › should prompt for recovery key if 'enter recovery key' pressed @screenshot
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: getByRole('alert').first()
Timeout: 5000ms
Timeout 5000ms exceeded.
Snapshot: key-storage-out-of-sync-toast.png
Call log:
- Expect "toHaveScreenshot(key-storage-out-of-sync-toast.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('alert').first()
- locator resolved to <div role="alert" class="mx_NonUrgentToastContainer"></div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
2 × waiting for element to be stable
- element is not visible
- retrying scroll into view action
- waiting 20ms
2 × waiting for element to be stable
- element is not visible
- retrying scroll into view action
- waiting 100ms
9 × waiting for element to be stable
- element is not visible
- retrying scroll into view action
- waiting 500ms
- Timeout 5000ms exceeded.
40 | // Mask the background of the screenshot to avoid failing the test just because some
41 | // other component have changed its rendering.
> 42 | await expect(page.getByRole("alert").first()).toMatchScreenshot("key-storage-out-of-sync-toast.png", {
| ^
43 | css: `
44 | .mx_ToastContainer {
45 | background-color: magenta !important;
at /home/runner/work/element-web/element-web/playwright/e2e/crypto/toasts.spec.ts:42:55
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1077:9 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1164
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1077:9 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('.mx_EventTile_last')
41 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: event-tile-reply-chains-irc-modern.png
Call log:
- Expect "toHaveScreenshot(event-tile-reply-chains-irc-modern.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$EO4KVitWPEHTpdTiZjCYW7BQlldJZ_U5ytczPq3tz-k" data-scroll-tokens="$EO4KVitWPEHTpdTiZjCYW7BQlldJZ_U5ytczPq3tz-k" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 41 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$EO4KVitWPEHTpdTiZjCYW7BQlldJZ_U5ytczPq3tz-k" data-scroll-tokens="$EO4KVitWPEHTpdTiZjCYW7BQlldJZ_U5ytczPq3tz-k" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 41 pixels (ratio 0.01 of all image pixels) are different.
1162 |
1163 | // Take a snapshot on modern layout
> 1164 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot(
| ^
1165 | "event-tile-reply-chains-irc-modern.png",
1166 | screenshotOptions,
1167 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1164:62
|
|
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot:
playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L336
1) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: getByTestId('room-list').getByRole('option', { name: 'video room' })
282 pixels (ratio 0.02 of all image pixels) are different.
Snapshot: room-list-item-video.png
Call log:
- Expect "toHaveScreenshot(room-list-item-video.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('room-list').getByRole('option', { name: 'video room' })
- locator resolved to <button type="button" role="option" tabindex="-1" aria-setsize="1" aria-posinset="1" data-state="closed" aria-haspopup="menu" aria-selected="false" aria-label="Open room video room" class="_flex_4dswl_9 _roomListItem_nspnt_8 mx_RoomListItemView">…</button>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 282 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('room-list').getByRole('option', { name: 'video room' })
- locator resolved to <button type="button" role="option" tabindex="-1" aria-setsize="1" aria-posinset="1" data-state="closed" aria-haspopup="menu" aria-selected="false" aria-label="Open room video room" class="_flex_4dswl_9 _roomListItem_nspnt_8 mx_RoomListItemView">…</button>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 282 pixels (ratio 0.02 of all image pixels) are different.
334 |
335 | await expect(videoRoom).toBeVisible();
> 336 | await expect(videoRoom).toMatchScreenshot("room-list-item-video.png");
| ^
337 | });
338 | });
339 |
at /home/runner/work/element-web/element-web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:336:37
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/location/location.spec.ts:33:5 › Location sharing › sends and displays pin drop location message successfully @no-firefox @screenshot
3 skipped
78 passed (6.0m)
|
|
🎭 Playwright Run Summary
80 passed (6.4m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/crypto/toasts.spec.ts:35:5 › Key storage out of sync toast › should prompt for recovery key if 'enter recovery key' pressed @screenshot
87 passed (8.7m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1077:9 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
2 skipped
87 passed (9.0m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot
75 passed (9.0m)
|
|
🎭 Playwright Run Summary
72 passed (9.3m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
all-blob-reports-Chrome-1
Expired
|
9.93 MB |
sha256:c2a8c13411937f904c2ff56e460addac784d27c7b5b72486ebac3d6e305a2911
|
|
|
all-blob-reports-Chrome-2
Expired
|
3.96 MB |
sha256:4a203611ee4ea167f8c686f58d6ae4fad024ac15e2b9c903c98c0ba17fb2aa36
|
|
|
all-blob-reports-Chrome-3
Expired
|
5.36 MB |
sha256:37dc4ea1e8021fb31dea5a65da1ff119c72f44605820953ed51b075788c4832b
|
|
|
all-blob-reports-Chrome-4
Expired
|
597 KB |
sha256:a2e91b4cdd5f631b6db9ebbda1de7e470a008761045175a945b35b0eaec831cb
|
|
|
all-blob-reports-Chrome-5
Expired
|
5.45 MB |
sha256:7b102b08494f24ff3479e41059c17fcbdc0495e6d4a9236bf6400ffee62d2aa7
|
|
|
all-blob-reports-Chrome-6
Expired
|
535 KB |
sha256:dba5218aad6591a7781c5ceb60ccfd09ab999535cc27e130a8cae1b571ec6e41
|
|
|
html-report
Expired
|
25.5 MB |
sha256:d172d3cc0577433d5098f988da49e4ce012887c6c652f4f8537ca3c95348dd57
|
|
|
webapp
Expired
|
39.3 MB |
sha256:cf0665d6d986e644ec7b53b0c1bdc562000973e3943c7f6ecc482d7ba7f30516
|
|