End to End Tests #11087
end-to-end-tests.yaml
on: merge_group
Build Element-Web
2m 30s
Matrix: playwright
Downstream Playwright tests [element-modules]
/
Run Playwright end-to-end tests & upload html report
4m 8s
end-to-end-tests
1m 16s
Annotations
6 errors and 6 notices
|
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:102:13 › Room list › Room list › should open the notification options menu @screenshot:
playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L141
1) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:102:13 › Room list › Room list › should open the notification options menu @screenshot
Error: expect(page).toHaveScreenshot(expected)
117 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: room-list-item-open-notification-options-selection.png
Call log:
- Expect "toHaveScreenshot(room-list-item-open-notification-options-selection.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 117 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 117 pixels (ratio 0.01 of all image pixels) are different.
139 | // The Mute room option should be selected
140 | await expect(page.getByRole("menuitem", { name: "Mute room" })).toHaveAttribute("aria-selected", "true");
> 141 | await expect(page).toMatchScreenshot("room-list-item-open-notification-options-selection.png");
| ^
142 | });
143 |
144 | test("should scroll to the current room", async ({ page, app, user }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:141:32
|
|
[Chrome] › playwright/e2e/crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM:
playwright/pages/toasts.ts#L22
3) [Chrome] › playwright/e2e/crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: locator('.mx_Toast_toast').filter({ hasText: 'Verification requested' }).first()
Expected: visible
Received: <element(s) not found>
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for locator('.mx_Toast_toast').filter({ hasText: 'Verification requested' }).first()
at ../pages/toasts.ts:22
20 | public async getToast(expectedTitle: string): Promise<Locator> {
21 | const toast = this.page.locator(".mx_Toast_toast", { hasText: expectedTitle }).first();
> 22 | await expect(toast).toBeVisible();
| ^
23 | return toast;
24 | }
25 |
at Toasts.getToast (/home/runner/work/element-web/element-web/playwright/pages/toasts.ts:22:29)
at /home/runner/work/element-web/element-web/playwright/e2e/crypto/user-verification.spec.ts:63:36
|
|
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event:
playwright/e2e/crypto/decryption-failure-messages.spec.ts#L281
2) [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_RoomView').getByRole('button', { name: 'Accept' })
279 | // Alice accepts the invite
280 | await page.getByRole("option", { name: "Test room" }).click();
> 281 | await page.locator(".mx_RoomView").getByRole("button", { name: "Accept" }).click();
| ^
282 |
283 | // wait until we're joined and see the timeline
284 | await expect(page.locator(`.mx_EventTile`).getByText("Alice joined the room")).toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/crypto/decryption-failure-messages.spec.ts:281:92
|
|
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event:
playwright/e2e/crypto/decryption-failure-messages.spec.ts#L0
2) [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event
Test timeout of 30000ms exceeded.
|
|
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:249:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:249:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot › Expect "toPass"
Error: Test timeout of 30000ms exceeded
19 | await tile.hover();
20 | await tile.getByRole("button", { name: "Reply", exact: true }).click();
> 21 | }).toPass();
| ^
22 | await expect(tile.page().getByText("Replying", { exact: true })).toBeVisible();
23 | };
24 |
at clickButtonReply (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:21:8)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:277:19
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1121
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected)
41 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: event-tile-reply-chains-irc-modern.png
Call log:
- Expect "toHaveScreenshot(event-tile-reply-chains-irc-modern.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" data-scroll-tokens="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 29 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" data-scroll-tokens="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 12 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" data-scroll-tokens="$3HWaWjT2BylIkGt0wf35Z63S4fE4gQ7rM1cDS1yV4Ak" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 41 pixels (ratio 0.01 of all image pixels) are different.
1119 |
1120 | // Take a snapshot on modern layout
> 1121 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot(
| ^
1122 | "event-tile-reply-chains-irc-modern.png",
1123 | screenshotOptions,
1124 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1121:62
|
|
🎭 Playwright Run Summary
2 skipped
96 passed (7.9m)
|
|
🎭 Playwright Run Summary
2 skipped
96 passed (7.7m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:102:13 › Room list › Room list › should open the notification options menu @screenshot
1 skipped
95 passed (8.6m)
|
|
🎭 Playwright Run Summary
44 skipped
59 passed (7.8m)
|
|
🎭 Playwright Run Summary
3 flaky
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:249:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts:202:17 › Cryptography › decryption failure messages › non-joined historical messages › should be able to jump to a message sent before our last join event
[Chrome] › playwright/e2e/crypto/user-verification.spec.ts:34:9 › User verification › can receive a verification request when there is no existing DM
100 passed (10.1m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
98 passed (10.5m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
all-blob-reports-Chrome-1
Expired
|
16 MB |
sha256:b43aa832e69e3cdce7a602b69961348fc4a10e4c85df40c21e1e0b1d748c2134
|
|
|
all-blob-reports-Chrome-2
Expired
|
7.95 MB |
sha256:0fa79aec4b440fc391bd245e6808fc9b333af05dabf6690f7712374230310221
|
|
|
all-blob-reports-Chrome-3
Expired
|
327 KB |
sha256:5ad8fc292da7ac680390e7457d1b2c34605ca1730dc882652a54e285a8a19e97
|
|
|
all-blob-reports-Chrome-4
Expired
|
449 KB |
sha256:79a108894a6939829a27beb057d01907a937f0c19917e0d3d541e638f3c19fe0
|
|
|
all-blob-reports-Chrome-5
Expired
|
751 KB |
sha256:df0de5eccc126a9a5c7bebc46d3951a63da4cdfeb41c091e69a5ad9e65d23475
|
|
|
all-blob-reports-Chrome-6
Expired
|
5.11 MB |
sha256:9c3f5c19aafc89877fa9d4b9ef7183e937d72d3fabe8a90b31df7969444687a5
|
|
|
html-report
Expired
|
28.9 MB |
sha256:06883d0dbc0b29cd0dda0b316a781b334c64c2ab84a44052bba85ebb8ac6cbe6
|
|
|
playwright-html-report
Expired
|
256 KB |
sha256:8486856fc6a0759db01f6577523e3662505452c54c7da65082f6685909a3d7c2
|
|
|
webapp
Expired
|
38.6 MB |
sha256:7b0d1faa78209f25b37cb7449b23e31a8f28c70d1d0cddcdd023874512875bef
|
|