Skip to content

Update playwright to v1.53.2 (#30279) #8884

Update playwright to v1.53.2 (#30279)

Update playwright to v1.53.2 (#30279) #8884

Triggered via push July 8, 2025 17:10
Status Success
Total duration 15m 47s
Artifacts 8
Build Element-Web
2m 35s
Build Element-Web
Matrix: playwright
Downstream Playwright tests [element-modules]  /  Run Playwright end-to-end tests & upload html report
Downstream Playwright tests [element-modules] / Run Playwright end-to-end tests & upload html report
end-to-end-tests
1m 8s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

15 errors and 6 notices
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts:204:17 › Read receipts › redactions › in the main timeline › Redacting all unread messages makes the room read after restart @mergequeue: playwright/e2e/read-receipts/index.ts#L450
1) [Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts:204:17 › Read receipts › redactions › in the main timeline › Redacting all unread messages makes the room read after restart @mergequeue Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') Expected: not visible Received: visible Call log: - Expect "not toBeVisible" with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') 9 × locator resolved to <span class="mx_NotificationBadge_count">1</span> - unexpected value "visible" at read-receipts/index.ts:450 448 | const tile = this.getRoomListTile(room.name); 449 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); > 450 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); | ^ 451 | } 452 | 453 | /** at Helpers.assertRead (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:450:71) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-main-timeline.spec.ts:216:17
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts:164:13 › Cryptography › event shields › Should show a grey padlock for a key restored from backup: playwright/e2e/crypto/event-shields.spec.ts#L202
5) [Chrome] › playwright/e2e/crypto/event-shields.spec.ts:164:13 › Cryptography › event shields › Should show a grey padlock for a key restored from backup Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: locator('.mx_EventTile_last') Expected string: "test encrypted 1" Received: <element(s) not found> Call log: - Expect "toContainText" with timeout 5000ms - waiting for locator('.mx_EventTile_last') 200 | /* go back to the test room and find Bob's message again */ 201 | await app.viewRoomById(testRoomId); > 202 | await expect(lastTile).toContainText("test encrypted 1"); | ^ 203 | // The gray shield would be a mx_EventTile_e2eIcon_normal. The red shield would be a mx_EventTile_e2eIcon_warning. 204 | // No shield would have no div mx_EventTile_e2eIcon at all. 205 | await expect(lastTileE2eIcon).toHaveClass(/mx_EventTile_e2eIcon_normal/); at /home/runner/work/element-web/element-web/playwright/e2e/crypto/event-shields.spec.ts:202:36
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:122:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L0
4) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:122:9 › Device verification › Verify device with QR code during login @no-webkit Error: apiRequestContext.fetch: Target page, context or browser has been closed Call log: - → POST http://localhost:37143/_synapse/admin/v1/register - user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.7204.23 Safari/537.36 - accept: */* - accept-encoding: gzip,deflate,br - content-type: application/json - content-length: 310 at Api.request (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/utils/api.js:28:41) at StartedSynapseContainer.registerUserInternal (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/testcontainers/synapse.js:287:42) at Object.credentials (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/fixtures/user.js:16:29)
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:122:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L97
4) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:122:9 › Device verification › Verify device with QR code during login @no-webkit Error: "route.fetch: Test ended." while running route callback. Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })` before the end of the test to ignore remaining routes in flight. 95 | await route.fulfill({ json: {} }); 96 | await new Promise((f) => setTimeout(f, 1000)); > 97 | await route.fetch(); | ^ 98 | }); 99 | 100 | await logIntoElement(page, credentials); at /home/runner/work/element-web/element-web/playwright/e2e/crypto/device-verification.spec.ts:97:25
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L283
3) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('.mx_EventTile_last').locator('.mx_ReplyChain') Expected: 2 Received: 1 Call log: - Expect "toHaveCount" with timeout 5000ms - waiting for locator('.mx_EventTile_last').locator('.mx_ReplyChain') 9 × locator resolved to 1 element - unexpected value "1" 281 | 282 | // Assert that there are two "mx_ReplyChain" elements > 283 | await expect(tile.locator(".mx_ReplyChain")).toHaveCount(2); | ^ 284 | 285 | // Assert that one line contains the user name 286 | await expect(tile.locator(".mx_ReplyChain .mx_ReplyTile_sender").getByText(user.displayName)).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:283:58
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:222:9 › Audio player › should support replying to audio file with another audio file @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L244
2) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:222:9 › Audio player › should support replying to audio file with another audio file @no-firefox @no-webkit @screenshot Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_EventTile_last').locator('.mx_ReplyChain_wrapper .mx_MFileBody_info[role=\'button\']').locator('.mx_MFileBody_info_filename') Expected: visible Received: <element(s) not found> Call log: - Expect "toBeVisible" with timeout 5000ms - waiting for locator('.mx_EventTile_last').locator('.mx_ReplyChain_wrapper .mx_MFileBody_info[role=\'button\']').locator('.mx_MFileBody_info_filename') 242 | const button = tile.locator(".mx_ReplyChain_wrapper .mx_MFileBody_info[role='button']"); 243 | // Assert that the file button has file name > 244 | await expect(button.locator(".mx_MFileBody_info_filename")).toBeVisible(); | ^ 245 | 246 | await takeSnapshots(page, app, "Selected EventTile of audio player with a reply"); 247 | }, at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:244:73
[Chrome] › playwright/e2e/app-loading/stored-credentials.spec.ts:26:5 › Shows the last known page on reload: playwright/e2e/app-loading/stored-credentials.spec.ts#L42
1) [Chrome] › playwright/e2e/app-loading/stored-credentials.spec.ts:26:5 › Shows the last known page on reload Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected) Locator: locator(':root') Expected pattern: /\/#\/room\// Received string: "http://localhost:8080/#/home" Call log: - Expect "toHaveURL" with timeout 5000ms - waiting for locator(':root') 9 × locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:8080/#/home" 40 | 41 | // Check that the room reloaded > 42 | await expect(page).toHaveURL(/\/#\/room\//); | ^ 43 | await expect(page.locator(".mx_RoomHeader")).toContainText("Test Room"); 44 | }); 45 | at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/stored-credentials.spec.ts:42:24
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:142:13 › Room list › Room list › should scroll to the current room: playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L150
3) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:142:13 › Room list › Room list › should scroll to the current room Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByTestId('room-list').getByRole('gridcell', { name: 'Open room room0' }) 148 | 149 | await expect(roomListView.getByRole("gridcell", { name: "Open room room0" })).toBeVisible(); > 150 | await roomListView.getByRole("gridcell", { name: "Open room room0" }).click(); | ^ 151 | 152 | const filters = page.getByRole("listbox", { name: "Room list filters" }); 153 | await filters.getByRole("option", { name: "People" }).click(); at /home/runner/work/element-web/element-web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:150:83
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:142:13 › Room list › Room list › should scroll to the current room: playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L0
3) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:142:13 › Room list › Room list › should scroll to the current room Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:98:13 › Room list › Room list › should open the notification options menu @screenshot: playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L131
2) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:98:13 › Room list › Room list › should open the notification options menu @screenshot Error: locator.hover: Test timeout of 30000ms exceeded. Call log: - waiting for getByTestId('room-list').getByRole('gridcell', { name: 'Open room room29' }) - locator resolved to <button type="button" tabindex="-1" role="gridcell" data-state="closed" aria-haspopup="menu" aria-selected="false" class="mx_RoomListItemView" aria-label="Open room room29">…</button> - attempting hover action - waiting for element to be visible and stable - element was detached from the DOM, retrying 129 | await expect(roomItem.getByTestId("notification-decoration")).toBeVisible(); 130 | > 131 | await roomItem.hover(); | ^ 132 | // On hover, the room should show the muted icon 133 | await expect(roomItem).toMatchScreenshot("room-list-item-hover-silent.png"); 134 | at /home/runner/work/element-web/element-web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:131:28
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:98:13 › Room list › Room list › should open the notification options menu @screenshot: playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L0
2) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:98:13 › Room list › Room list › should open the notification options menu @screenshot Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:44:13 › Room list › Room list › should render the room list @screenshot: playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L54
1) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:44:13 › Room list › Room list › should render the room list @screenshot Error: expect(locator).toHaveScreenshot(expected) 9210 pixels (ratio 0.05 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/left-panel/room-list-panel/room-list.spec.ts/room-list-scrolled-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/left-panel-room-list-panel-b32ce-should-render-the-room-list-Chrome/room-list-scrolled-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/left-panel-room-list-panel-b32ce-should-render-the-room-list-Chrome/room-list-scrolled-diff.png Call log: - Expect "toHaveScreenshot(room-list-scrolled.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('room-list') - locator resolved to <div class="mx_RoomList" data-testid="room-list">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 9210 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('room-list') - locator resolved to <div class="mx_RoomList" data-testid="room-list">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 9210 pixels (ratio 0.05 of all image pixels) are different. 52 | await page.mouse.wheel(0, 1000); 53 | await expect(roomListView.getByRole("gridcell", { name: "Open room room0" })).toBeVisible(); > 54 | await expect(roomListView).toMatchScreenshot("room-list-scrolled.png"); | ^ 55 | }); 56 | 57 | test("should open the room when it is clicked", async ({ page, app, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:54:40
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:228:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L256
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:228:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png Call log: - Expect "toHaveScreenshot(expanded-gels-bubble-layout.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 210 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 210 pixels (ratio 0.01 of all image pixels) are different. 254 | 255 | // Save snapshot of expanded generic event list summary on bubble layout > 256 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", { | ^ 257 | // Exclude timestamp from snapshot 258 | mask: [page.locator(".mx_MessageTimestamp")], 259 | }); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:256:61
[Chrome] › playwright/e2e/oidc/oidc-native.spec.ts:81:9 › OIDC Native › it should log out the user & wipe data when logging out via MAS @no-firefox @no-webkit @screenshot: playwright/e2e/oidc/oidc-native.spec.ts#L0
2) [Chrome] › playwright/e2e/oidc/oidc-native.spec.ts:81:9 › OIDC Native › it should log out the user & wipe data when logging out via MAS @no-firefox @no-webkit @screenshot Error: Request to http://localhost:38689/_matrix/client/v3/publicRooms failed with status 500: {"errcode":"M_FORBIDDEN","error":"User not found"} at ClientServerApi.request (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/utils/api.js:38:19) at StartedSynapseWithMasContainer.deletePublicRooms (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/testcontainers/synapse.js:277:34) at StartedSynapseWithMasContainer.onTestFinished (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/testcontainers/synapse.js:272:9) at Object.context (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/fixtures/services.js:112:9)
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts:23:9 › Encryption state after registration › Key backup is enabled by default: playwright/e2e/crypto/backups-mas.spec.ts#L0
1) [Chrome] › playwright/e2e/crypto/backups-mas.spec.ts:23:9 › Encryption state after registration › Key backup is enabled by default Test timeout of 30000ms exceeded.
🎭 Playwright Run Summary
32 skipped 59 passed (7.5m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts:204:17 › Read receipts › redactions › in the main timeline › Redacting all unread messages makes the room read after restart @mergequeue 14 skipped 81 passed (7.7m)
🎭 Playwright Run Summary
2 skipped 97 passed (7.9m)
🎭 Playwright Run Summary
5 flaky [Chrome] › playwright/e2e/app-loading/stored-credentials.spec.ts:26:5 › Shows the last known page on reload [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:222:9 › Audio player › should support replying to audio file with another audio file @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:122:9 › Device verification › Verify device with QR code during login @no-webkit [Chrome] › playwright/e2e/crypto/event-shields.spec.ts:164:13 › Cryptography › event shields › Should show a grey padlock for a key restored from backup 90 passed (9.6m)
🎭 Playwright Run Summary
3 flaky [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:44:13 › Room list › Room list › should render the room list @screenshot [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:98:13 › Room list › Room list › should open the notification options menu @screenshot [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:142:13 › Room list › Room list › should scroll to the current room 1 skipped 95 passed (9.9m)
🎭 Playwright Run Summary
3 flaky [Chrome] › playwright/e2e/crypto/backups-mas.spec.ts:23:9 › Encryption state after registration › Key backup is enabled by default [Chrome] › playwright/e2e/oidc/oidc-native.spec.ts:81:9 › OIDC Native › it should log out the user & wipe data when logging out via MAS @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:228:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot 84 passed (10.4m)

Artifacts

Produced during runtime
Name Size Digest
all-blob-reports-Chrome-1 Expired
29.5 MB
sha256:6154e83b41814e40933e545a74d53509e72b7d78520fd6ea29d603242f2d933f
all-blob-reports-Chrome-2 Expired
21.5 MB
sha256:1ca1c619966f557c6df046cb7f01b822728661d0386cfdd43cb140dc104d2da4
all-blob-reports-Chrome-3 Expired
324 KB
sha256:5b4fa4130ae28d3995b2f9c5136a14c91a60477a73796e0b8cf07641b99fdb2e
all-blob-reports-Chrome-4 Expired
3.76 MB
sha256:76a6c6bb6232f9c936d0d8231444b84e48edb99fd042a3a3289c50515f4fffec
all-blob-reports-Chrome-5 Expired
446 KB
sha256:950e0abc1f3c6408031ad091b3f313990953dfb7e1a975bce9636372a39ec212
all-blob-reports-Chrome-6 Expired
11.8 MB
sha256:cf061e103bd6cb5f18c67d4ba8116556077f6fe2c21999a1e705cf440fc5b706
html-report Expired
64.1 MB
sha256:155256131354e431135c4e1041897550ae713ac8852ea4e28f141a9af2f4a7e0
webapp Expired
38.4 MB
sha256:23ee3d861ea18efddcedbeea88ff872ab3e8d3cc1d33d4c38405972ecd5e1eb5