Skip to content

End to End Tests

End to End Tests #3620

Triggered via merge group January 2, 2025 20:20
Status Success
Total duration 15m 10s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
1m 42s
Build Element-Web
Matrix: playwright
end-to-end-tests
37s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 30 warnings, and 6 notices
[Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue: playwright/e2e/read-receipts/index.ts#L449
1) [Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') 9 × locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" at read-receipts/index.ts:449 447 | async assertRead(room: RoomRef) { 448 | const tile = this.getRoomListTile(room.name); > 449 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); | ^ 450 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); 451 | } 452 | at Helpers.assertRead (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:449:69) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-in-threads.spec.ts:440:28
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit: playwright/e2e/room-directory/room-directory.spec.ts#L34
1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 32 | await localAddresses.getByRole("textbox").fill("gaming"); 33 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 35 | 36 | // Publish into the public rooms directory 37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73
[Chrome] › sliding-sync/sliding-sync.spec.ts:356:5 › Sliding Sync › should send unsubscribe_rooms for every room switch: playwright/e2e/sliding-sync/sliding-sync.spec.ts#L372
2) [Chrome] › sliding-sync/sliding-sync.spec.ts:356:5 › Sliding Sync › should send unsubscribe_rooms for every room switch Error: expect(received).toEqual(expected) // deep equality Expected: ["!sXCmWbAzrHfJnOjSfo:localhost"] Received: undefined 370 | return; 371 | } > 372 | expect(body.unsubscribe_rooms).toEqual([unsubRoomId]); | ^ 373 | expect(body.room_subscriptions).not.toHaveProperty(unsubRoomId); 374 | expect(body.room_subscriptions).toHaveProperty(subRoomId); 375 | }; at assertUnsubExists (/home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:372:44) at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:394:9
[Chrome] › integration-manager/read_events.spec.ts:129:9 › Integration Manager: Read Events › should read a state event by state key: playwright/e2e/integration-manager/read_events.spec.ts#L99
1) [Chrome] › integration-manager/read_events.spec.ts:129:9 › Integration Manager: Read Events › should read a state event by state key Test timeout of 30000ms exceeded while running "beforeEach" hook. 97 | }); 98 | > 99 | test.beforeEach(async ({ page, user, app, room }) => { | ^ 100 | await app.client.setAccountData("m.widgets", { 101 | "m.integration_manager": { 102 | content: { at /home/runner/work/element-web/element-web/playwright/e2e/integration-manager/read_events.spec.ts:99:10
[Chrome] › integration-manager/read_events.spec.ts:129:9 › Integration Manager: Read Events › should read a state event by state key: playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › integration-manager/read_events.spec.ts:129:9 › Integration Manager: Read Events › should read a state event by state key Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Integration Manager Test"],[aria-label="Integration Manager Test"]').first() at ../pages/ElementAppPage.ts:96 94 | .locator(`[title="${name}"],[aria-label="${name}"]`) 95 | .first() > 96 | .click(); | ^ 97 | } 98 | 99 | public async viewRoomById(roomId: string): Promise<void> { at ElementAppPage.viewRoomByName (/home/runner/work/element-web/element-web/playwright/pages/ElementAppPage.ts:96:14) at /home/runner/work/element-web/element-web/playwright/e2e/integration-manager/read_events.spec.ts:126:19
[Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/e2e/oidc/oidc-native.spec.ts#L1
2) [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Test timeout of 90000ms exceeded.
[Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/e2e/oidc/oidc-native.spec.ts#L19
2) [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Error: page.waitForRequest: Test timeout of 90000ms exceeded. 17 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 18 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 19 | const tokenApiPromise = page.waitForRequest( | ^ 20 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 21 | ); 22 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:19:38
Slow Test: [Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.2m
Slow Test: [Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 1.6m
Slow Test: [Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 1.2m
Slow Test: [Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.6m
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
Slow Test: [Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 34.7s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 34.2s
Slow Test: [Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.9m
Slow Test: [Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 55.9s
Slow Test: [Chrome] › read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 52.3s
Slow Test: [Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 50.5s
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 1.0m
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 52.5s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 42.2s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 36.7s
Slow Test: [Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 30.8s
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.2m
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
Slow Test: [Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 58.6s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 52.3s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.2m
Slow Test: [Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.7m
Slow Test: [Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.0m
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 37.2s
Slow Test: [Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 33.4s
🎭 Playwright Run Summary
32 skipped 50 passed (9.2m)
🎭 Playwright Run Summary
3 skipped 69 passed (9.5m)
🎭 Playwright Run Summary
1 flaky [Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue 15 skipped 59 passed (9.6m)
🎭 Playwright Run Summary
2 flaky [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit [Chrome] › sliding-sync/sliding-sync.spec.ts:356:5 › Sliding Sync › should send unsubscribe_rooms for every room switch 1 skipped 77 passed (10.5m)
🎭 Playwright Run Summary
81 passed (11.7m)
🎭 Playwright Run Summary
2 flaky [Chrome] › integration-manager/read_events.spec.ts:129:9 › Integration Manager: Read Events › should read a state event by state key [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit 1 skipped 75 passed (11.9m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
684 KB
all-blob-reports-Chrome-2 Expired
9.4 MB
all-blob-reports-Chrome-3 Expired
308 KB
all-blob-reports-Chrome-4 Expired
4.38 MB
all-blob-reports-Chrome-5 Expired
7.17 MB
all-blob-reports-Chrome-6 Expired
774 KB
html-report Expired
22.1 MB
webapp Expired
28.3 MB