1) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot Error: expect(locator).toHaveScreenshot(expected) failed Locator: getByTestId('room-list').getByRole('option', { name: 'video room' }) 283 pixels (ratio 0.02 of all image pixels) are different. Snapshot: room-list-item-video.png Call log: - Expect "toHaveScreenshot(room-list-item-video.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('room-list').getByRole('option', { name: 'video room' }) - locator resolved to <button type="button" tabindex="-1" role="option" aria-setsize="1" aria-posinset="1" data-state="closed" aria-haspopup="menu" aria-selected="false" aria-label="Open room video room" class="_flex_4dswl_9 _roomListItem_rtaba_8 mx_RoomListItemView _firstItem_rtaba_123 _lastItem_rtaba_127">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 283 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('room-list').getByRole('option', { name: 'video room' }) - locator resolved to <button type="button" tabindex="-1" role="option" aria-setsize="1" aria-posinset="1" data-state="closed" aria-haspopup="menu" aria-selected="false" aria-label="Open room video room" class="_flex_4dswl_9 _roomListItem_rtaba_8 mx_RoomListItemView _firstItem_rtaba_123 _lastItem_rtaba_127">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 283 pixels (ratio 0.02 of all image pixels) are different. 334 | 335 | await expect(videoRoom).toBeVisible(); > 336 | await expect(videoRoom).toMatchScreenshot("room-list-item-video.png"); | ^ 337 | }); 338 | }); 339 | at /home/runner/work/element-web/element-web/apps/web/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:336:37

1) [Chrome] › playwright/e2e/crypto/toasts.spec.ts:45:5 › Key storage out of sync toast › should prompt for recovery key if 'enter recovery key' pressed @screenshot Error: expect(locator).toHaveScreenshot(expected) failed Locator: getByRole('alert').first() Timeout: 5000ms Timeout 5000ms exceeded. Snapshot: key-storage-out-of-sync-toast.png Call log: - Expect "toHaveScreenshot(key-storage-out-of-sync-toast.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('alert').first() - locator resolved to <div role="alert" class="mx_NonUrgentToastContainer"></div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action 2 × waiting for element to be stable - element is not visible - retrying scroll into view action - waiting 20ms 2 × waiting for element to be stable - element is not visible - retrying scroll into view action - waiting 100ms 9 × waiting for element to be stable - element is not visible - retrying scroll into view action - waiting 500ms - Timeout 5000ms exceeded. 48 | // it would always be checking the same toast, even if another one is now the first. 49 | await expect(page.getByRole("alert")).toHaveCount(2); > 50 | await expect(page.getByRole("alert").first()).toMatchScreenshot( | ^ 51 | "key-storage-out-of-sync-toast.png", 52 | screenshotOptions, 53 | ); at /home/runner/work/element-web/element-web/apps/web/playwright/e2e/crypto/toasts.spec.ts:50:55

1) [Chrome] › playwright/e2e/timeline/media-preview-settings.spec.ts:38:5 › Media preview settings › should be able to hide avatars of inviters @screenshot Error: expect(locator).toHaveScreenshot(expected) failed Locator: getByRole('complementary').filter({ hasText: 'Do you want to join Test room' }) Timeout: 5000ms Timeout 5000ms exceeded. Snapshot: invite-with-avatar.png Call log: - Expect "toHaveScreenshot(invite-with-avatar.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('complementary').filter({ hasText: 'Do you want to join Test room' }) - Timeout 5000ms exceeded. 66 | await expect( 67 | page.getByRole("complementary").filter({ hasText: "Do you want to join Test room" }), > 68 | ).toMatchScreenshot("invite-with-avatar.png", { | ^ 69 | // Hide the mxid, which is not stable. 70 | css: ` 71 | .mx_RoomPreviewBar_inviter_mxid { at /home/runner/work/element-web/element-web/apps/web/playwright/e2e/timeline/media-preview-settings.spec.ts:68:11

3 skipped 84 passed (5.8m)

80 passed (6.6m)

1 flaky [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot 83 passed (8.9m)

1 flaky [Chrome] › playwright/e2e/crypto/toasts.spec.ts:45:5 › Key storage out of sync toast › should prompt for recovery key if 'enter recovery key' pressed @screenshot 89 passed (9.2m)

1 flaky [Chrome] › playwright/e2e/timeline/media-preview-settings.spec.ts:38:5 › Media preview settings › should be able to hide avatars of inviters @screenshot 2 skipped 93 passed (9.3m)