element-web-notify #11590
end-to-end-tests.yaml
on: repository_dispatch
Build Element-Web
2m 44s
Matrix: playwright
Downstream Playwright tests [element-modules]
/
Run Playwright end-to-end tests & upload html report
end-to-end-tests
1m 20s
Annotations
3 errors and 6 notices
|
[Chrome] › playwright/e2e/widgets/permissions-dialog.spec.ts:49:9 › Widger permissions dialog › should be updated if user is re-invited into the room with updated state event @screenshot:
playwright/e2e/widgets/permissions-dialog.spec.ts#L92
2) [Chrome] › playwright/e2e/widgets/permissions-dialog.spec.ts:49:9 › Widger permissions dialog › should be updated if user is re-invited into the room with updated state event @screenshot
Error: expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 368
- Array []
+ Array [
+ Object {
+ "description": "Ensure aria-hidden elements are not focusable nor contain focusable elements",
+ "help": "ARIA hidden element must not be focusable or contain focusable elements",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.10/aria-hidden-focus?application=playwright",
+ "id": "aria-hidden-focus",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [
+ Object {
+ "data": null,
+ "id": "focusable-disabled",
+ "impact": "serious",
+ "message": "Focusable content should be disabled or be removed from the DOM",
+ "relatedNodes": Array [
+ Object {
+ "html": "<button class=\"_button_vczzf_8\" role=\"button\" tabindex=\"0\" data-size=\"sm\" data-kind=\"secondary\">Dismiss</button>",
+ "target": Array [
+ ".mx_Toast_buttons > ._button_vczzf_8[data-size=\"sm\"][data-kind=\"secondary\"]",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_button_vczzf_8\" role=\"button\" tabindex=\"0\" data-size=\"sm\" data-kind=\"primary\">Enable</button>",
+ "target": Array [
+ "._button_vczzf_8[data-size=\"sm\"][data-kind=\"primary\"]",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_icon-button_1pz9o_8 mx_ThreadsActivityCentreButton\" role=\"button\" tabindex=\"0\" aria-disabled=\"false\" aria-label=\"Threads\" type=\"button\" id=\"radix-«rc»\" aria-haspopup=\"menu\" aria-expanded=\"false\" data-state=\"closed\" aria-labelledby=\"«re»\" data-kind=\"primary\" style=\"--cpd-icon-button-size: 32px;\">",
+ "target": Array [
+ "#radix-«rc»",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_button_vczzf_8 mx_RoomListSearch_search _has-icon_vczzf_57\" role=\"button\" tabindex=\"0\" data-size=\"sm\" data-kind=\"secondary\">",
+ "target": Array [
+ ".mx_RoomListSearch_search",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_button_vczzf_8 _has-icon_vczzf_57 _icon-only_vczzf_50\" role=\"button\" tabindex=\"0\" aria-label=\"Explore rooms\" data-size=\"sm\" data-kind=\"secondary\">",
+ "target": Array [
+ "._icon-only_vczzf_50",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_icon-button_1pz9o_8\" role=\"button\" tabindex=\"0\" aria-disabled=\"false\" aria-label=\"Room Options\" type=\"button\" id=\"radix-«rv»\" aria-haspopup=\"menu\" aria-expanded=\"false\" data-state=\"closed\" aria-labelledby=\"«r11»\" data-kind=\"primary\" style=\"--cpd-icon-button-size: 32px;\">",
+ "target": Array [
+ "#radix-«rv»",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_icon-button_1pz9o_8\" role=\"button\" tabindex=\"0\" aria-disabled=\"false\" aria-label=\"Add\" type=\"button\" id=\"radix-«r1a»\" aria-haspopup=\"menu\" aria-expanded=\"false\" data-state=\"closed\" data-kind=\"primary\" style=\"--cpd-icon-button-size: 32px;\">",
+ "target": Array [
+ "#radix-«r1a»",
+ ],
+ },
+ Object {
+ "ht
|
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1056:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1139
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1056:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected)
41 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: event-tile-reply-chains-irc-modern.png
Call log:
- Expect "toHaveScreenshot(event-tile-reply-chains-irc-modern.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$ORMrG8lY-Kni4GPJHxziMPyD0rgFzhWf9lo77K21ygY" data-scroll-tokens="$ORMrG8lY-Kni4GPJHxziMPyD0rgFzhWf9lo77K21ygY" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 29 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$ORMrG8lY-Kni4GPJHxziMPyD0rgFzhWf9lo77K21ygY" data-scroll-tokens="$ORMrG8lY-Kni4GPJHxziMPyD0rgFzhWf9lo77K21ygY" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 12 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$ORMrG8lY-Kni4GPJHxziMPyD0rgFzhWf9lo77K21ygY" data-scroll-tokens="$ORMrG8lY-Kni4GPJHxziMPyD0rgFzhWf9lo77K21ygY" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 41 pixels (ratio 0.01 of all image pixels) are different.
1137 |
1138 | // Take a snapshot on modern layout
> 1139 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot(
| ^
1140 | "event-tile-reply-chains-irc-modern.png",
1141 | screenshotOptions,
1142 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1139:62
|
|
[Chrome] › playwright/e2e/composer/CIDER.spec.ts:101:13 › Composer › CIDER › can send mention @screenshot:
playwright/e2e/composer/CIDER.spec.ts#L116
1) [Chrome] › playwright/e2e/composer/CIDER.spec.ts:101:13 › Composer › CIDER › can send mention @screenshot
Error: expect(locator).toHaveScreenshot(expected)
13 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: mention.png
Call log:
- Expect "toHaveScreenshot(mention.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('textbox', { name: 'Send an unencrypted message…' })
- locator resolved to <div dir="auto" tabindex="0" role="textbox" translate="no" aria-multiline="true" aria-disabled="false" contenteditable="true" aria-haspopup="listbox" aria-autocomplete="list" data-testid="basicmessagecomposer" aria-label="Send an unencrypted message…" class="mx_BasicMessageComposer_input mx_BasicMessageComposer_input_shouldShowPillAvatar">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 13 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByRole('textbox', { name: 'Send an unencrypted message…' })
- locator resolved to <div dir="auto" tabindex="0" role="textbox" translate="no" aria-multiline="true" aria-disabled="false" contenteditable="true" aria-haspopup="listbox" aria-autocomplete="list" data-testid="basicmessagecomposer" aria-label="Send an unencrypted message…" class="mx_BasicMessageComposer_input mx_BasicMessageComposer_input_shouldShowPillAvatar">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 13 pixels (ratio 0.01 of all image pixels) are different.
114 | await page.getByRole("option", { name: `Bob ${bot.credentials.userId}` }).click();
115 | await expect(composer.getByText("Bob")).toBeVisible();
> 116 | await expect(composer).toMatchScreenshot("mention.png");
| ^
117 | await composer.press("Enter");
118 | await expect(page.locator(".mx_EventTile_body", { hasText: "Bob" })).toBeVisible();
119 | });
at /home/runner/work/element-web/element-web/playwright/e2e/composer/CIDER.spec.ts:116:36
|
|
🎭 Playwright Run Summary
44 skipped
59 passed (8.0m)
|
|
🎭 Playwright Run Summary
2 skipped
96 passed (8.5m)
|
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1056:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot
[Chrome] › playwright/e2e/widgets/permissions-dialog.spec.ts:49:9 › Widger permissions dialog › should be updated if user is re-invited into the room with updated state event @screenshot
95 passed (10.6m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/composer/CIDER.spec.ts:101:13 › Composer › CIDER › can send mention @screenshot
100 passed (9.0m)
|
|
🎭 Playwright Run Summary
1 skipped
102 passed (10.0m)
|
|
🎭 Playwright Run Summary
2 skipped
101 passed (8.7m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
all-blob-reports-Chrome-1
Expired
|
4.67 MB |
sha256:81dff0564cbd5e29d690511f66a7cc75d38d2350dc47f3fcc77a344c9a5a1d0a
|
|
|
all-blob-reports-Chrome-2
Expired
|
610 KB |
sha256:0a51b64a387092ec8fc91732f9e7b7ed1d49399b4de1116e0e7fe326c2ffb320
|
|
|
all-blob-reports-Chrome-3
Expired
|
328 KB |
sha256:78c51ca0e0e2d6048d73efcae6cdfa3f3ec7927b613426ae240698206de796c6
|
|
|
all-blob-reports-Chrome-4
Expired
|
452 KB |
sha256:4d869775011b6e425f56032144f424501960417ceb05dd56b81a5928c6644f1a
|
|
|
all-blob-reports-Chrome-5
Expired
|
774 KB |
sha256:a1bb3e25d71d7e9c954d498ff52693813a0b1270c9c7c878bc33082246c5e0b9
|
|
|
all-blob-reports-Chrome-6
Expired
|
9.31 MB |
sha256:8a76a74c7514a21af8c807ab4b68c65b8ed069135a8608aeb9ff27bf2aba3acb
|
|
|
html-report
Expired
|
15.6 MB |
sha256:22187deb0fe07e92196a06d17c477bb8644cf22bbf0c34ee1db042177b6136fd
|
|
|
webapp
Expired
|
39.7 MB |
sha256:26aed92be708c012e76554987ec79158d83cb7c4178a47e9fe2322537939918a
|
|