Add a test for #29882, which is fixed by matrix-js-sdk#5016 (#30835) #11090
end-to-end-tests.yaml
on: push
Build Element-Web
2m 36s
Matrix: playwright
Downstream Playwright tests [element-modules]
/
Run Playwright end-to-end tests & upload html report
end-to-end-tests
1m 17s
Annotations
5 errors and 6 notices
|
[Chrome] › playwright/e2e/composer/CIDER.spec.ts:101:13 › Composer › CIDER › can send mention @screenshot:
playwright/e2e/composer/CIDER.spec.ts#L116
1) [Chrome] › playwright/e2e/composer/CIDER.spec.ts:101:13 › Composer › CIDER › can send mention @screenshot
Error: expect(locator).toHaveScreenshot(expected)
13 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: mention.png
Call log:
- Expect "toHaveScreenshot(mention.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('textbox', { name: 'Send an unencrypted message…' })
- locator resolved to <div dir="auto" tabindex="0" role="textbox" translate="no" aria-multiline="true" aria-disabled="false" contenteditable="true" aria-haspopup="listbox" aria-autocomplete="list" data-testid="basicmessagecomposer" aria-label="Send an unencrypted message…" class="mx_BasicMessageComposer_input mx_BasicMessageComposer_input_shouldShowPillAvatar">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 13 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByRole('textbox', { name: 'Send an unencrypted message…' })
- locator resolved to <div dir="auto" tabindex="0" role="textbox" translate="no" aria-multiline="true" aria-disabled="false" contenteditable="true" aria-haspopup="listbox" aria-autocomplete="list" data-testid="basicmessagecomposer" aria-label="Send an unencrypted message…" class="mx_BasicMessageComposer_input mx_BasicMessageComposer_input_shouldShowPillAvatar">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 13 pixels (ratio 0.01 of all image pixels) are different.
114 | await page.getByRole("option", { name: `Bob ${bot.credentials.userId}` }).click();
115 | await expect(composer.getByText("Bob")).toBeVisible();
> 116 | await expect(composer).toMatchScreenshot("mention.png");
| ^
117 | await composer.press("Enter");
118 | await expect(page.locator(".mx_EventTile_body", { hasText: "Bob" })).toBeVisible();
119 | });
at /home/runner/work/element-web/element-web/playwright/e2e/composer/CIDER.spec.ts:116:36
|
|
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:83:9 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot:
playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L104
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:83:9 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
Error: locator.fill: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).getByRole('spinbutton', { name: '@user_6496a26110e4309860ce-e6b187015ed0865317ce:localhost' })
- locator resolved to <input value="100" type="number" max="Infinity" id="mx_Field_5" label="@user_6496a26110e4309860ce-e6b187015ed0865317ce:localhost" placeholder="@user_6496a26110e4309860ce-e6b187015ed0865317ce:localhost"/>
- fill("80")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element was detached from the DOM, retrying
102 | await ourComboBox.selectOption("Custom level");
103 | const ourPl = settings.getByRole("spinbutton", { name: user.userId });
> 104 | await ourPl.fill("80");
| ^
105 | await ourPl.blur(); // Shows a warning on
106 |
107 | // Accept the de-op
at /home/runner/work/element-web/element-web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts:104:25
|
|
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:83:9 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot:
playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L0
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:83:9 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
Test timeout of 30000ms exceeded.
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1121
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected)
41 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: event-tile-reply-chains-irc-modern.png
Call log:
- Expect "toHaveScreenshot(event-tile-reply-chains-irc-modern.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$kkt5IRvhxO73KekLDBGQb6Qc021ngqEOEvqeoF48A_U" data-scroll-tokens="$kkt5IRvhxO73KekLDBGQb6Qc021ngqEOEvqeoF48A_U" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 29 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$kkt5IRvhxO73KekLDBGQb6Qc021ngqEOEvqeoF48A_U" data-scroll-tokens="$kkt5IRvhxO73KekLDBGQb6Qc021ngqEOEvqeoF48A_U" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 12 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$kkt5IRvhxO73KekLDBGQb6Qc021ngqEOEvqeoF48A_U" data-scroll-tokens="$kkt5IRvhxO73KekLDBGQb6Qc021ngqEOEvqeoF48A_U" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 41 pixels (ratio 0.01 of all image pixels) are different.
1119 |
1120 | // Take a snapshot on modern layout
> 1121 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot(
| ^
1122 | "event-tile-reply-chains-irc-modern.png",
1123 | screenshotOptions,
1124 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1121:62
|
|
End to End Tests
Canceling since a higher priority waiting request for End to End Tests-refs/heads/develop-push exists
|
|
🎭 Playwright Run Summary
1 skipped
96 passed (8.1m)
|
|
🎭 Playwright Run Summary
44 skipped
59 passed (7.8m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/composer/CIDER.spec.ts:101:13 › Composer › CIDER › can send mention @screenshot
102 passed (8.8m)
|
|
🎭 Playwright Run Summary
2 skipped
96 passed (8.5m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:83:9 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
2 skipped
95 passed (8.6m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1038:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
98 passed (10.4m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
all-blob-reports-Chrome-1
Expired
|
4.5 MB |
sha256:c775b39ec653012683e93eef781648da8fe84f5667b163e933e488dc1715ec02
|
|
|
all-blob-reports-Chrome-2
Expired
|
575 KB |
sha256:63e660abebe3311043ccd125af9931654c7fbdac0e4bed32bd977768dcc3b351
|
|
|
all-blob-reports-Chrome-3
Expired
|
327 KB |
sha256:76d72d5d1c89cc035d40f0ea343952743834fb728ce6d0b1d792da0c14c3f6db
|
|
|
all-blob-reports-Chrome-4
Expired
|
452 KB |
sha256:dfba062721870f0dee21355d2eabc125b6037ba8415775b6c8ba75abcbf4d9a8
|
|
|
all-blob-reports-Chrome-5
Expired
|
4.79 MB |
sha256:4601495317f8208114346192aa82c1df7946c34b80cb5e4d064d0306bc3bb9c8
|
|
|
all-blob-reports-Chrome-6
Expired
|
5.17 MB |
sha256:76f34a9ed1ea274872e4acf0d3acf654b5d27843ea956130259ceff095272c0c
|
|
|
html-report
Expired
|
15.3 MB |
sha256:3e10cdc92de7b556047e90094f60716a0a6c10c6fa4ec0b53b255058920da1dc
|
|
|
webapp
Expired
|
38.6 MB |
sha256:3e3e53469f1ce93c0a6dff1227906f1cbfe671cdf0f8c13b040b8af7c5bbb68f
|
|