End to End Tests #1906
Annotations
12 errors, 29 warnings, and 6 notices
timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC:
playwright/e2e/timeline/timeline.spec.ts#L557
1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout
Error: Screenshot comparison failed:
6560 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout/event-tiles-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 26765 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 26765 pixels (ratio 0.05 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 6560 pixels (ratio 0.02 of all image pixels) are different.
- waiting 500ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 6560 pixels (ratio 0.02 of all image pixels) are different.
555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"),
556 | ).toBeInViewport();
> 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot(
| ^
558 | "event-tiles-bubble-layout.png",
559 | screenshotOptions,
560 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57
|
timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC:
playwright/e2e/timeline/timeline.spec.ts#L557
1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
6560 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-retry1/event-tiles-bubble-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-retry1/event-tiles-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 26765 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 33467 pixels (ratio 0.06 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 6560 pixels (ratio 0.02 of all image pixels) are different.
555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"),
556 | ).toBeInViewport();
> 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot(
| ^
558 | "event-tiles-bubble-layout.png",
559 | screenshotOptions,
560 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57
|
timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC:
playwright/e2e/timeline/timeline.spec.ts#L557
1) timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
6560 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-retry2/event-tiles-bubble-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-retry2/event-tiles-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(event-tiles-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 26765 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 26765 pixels (ratio 0.05 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 6560 pixels (ratio 0.02 of all image pixels) are different.
- waiting 500ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 6560 pixels (ratio 0.02 of all image pixels) are different.
555 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"),
556 | ).toBeInViewport();
> 557 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot(
| ^
558 | "event-tiles-bubble-layout.png",
559 | screenshotOptions,
560 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:557:57
|
Run Tests 6/6
Process completed with exit code 1.
|
read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread:
playwright/e2e/read-receipts/high-level.spec.ts#L1
1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread
Test timeout of 30000ms exceeded.
|
read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread:
playwright/e2e/read-receipts/high-level.spec.ts#L1
1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread:
playwright/e2e/read-receipts/index.ts#L573
1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeVisible()
Locator: locator('.mx_RoomView')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for locator('.mx_RoomView')
at read-receipts/index.ts:573
571 | await this.page.reload();
572 | // Wait for the app to reload
> 573 | await expect(this.page.locator(".mx_RoomView")).toBeVisible();
| ^
574 | }
575 |
576 | /**
at Helpers.saveAndReload (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:573:57)
at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/high-level.spec.ts:243:13
|
read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread:
playwright/e2e/read-receipts/high-level.spec.ts#L1
1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread:
playwright/e2e/read-receipts/index.ts#L516
1) read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForTimeout: Test timeout of 30000ms exceeded.
at read-receipts/index.ts:516
514 | // If we've just entered the room, the threads panel takes a while to decide
515 | // whether it's open or not - wait here to give it a chance to settle.
> 516 | await this.page.waitForTimeout(200);
| ^
517 |
518 | const threadPanel = this.page.locator(".mx_ThreadPanel");
519 | const isThreadPanelOpen = (await threadPanel.count()) !== 0;
at Helpers.openThreadList (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:516:25)
at Helpers.getThreadListTile (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:541:20)
at Helpers.assertUnreadThread (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:559:33)
at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/high-level.spec.ts:257:24
|
Run Tests 3/6
Process completed with exit code 1.
|
end-to-end-tests:
timeline/timeline.spec.ts/event-tiles-bubble-layout-linux.png#L1
Stale screenshot file
|
end-to-end-tests
Process completed with exit code 1.
|
Slow Test:
read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 1.0m
|
Slow Test:
spaces/spaces.spec.ts#L1
spaces/spaces.spec.ts took 55.2s
|
Slow Test:
right-panel/right-panel.spec.ts#L1
right-panel/right-panel.spec.ts took 50.3s
|
Slow Test:
settings/account-user-settings-tab.spec.ts#L1
settings/account-user-settings-tab.spec.ts took 40.3s
|
Slow Test:
right-panel/file-panel.spec.ts#L1
right-panel/file-panel.spec.ts took 36.1s
|
Slow Test:
read-receipts/redactions-in-threads.spec.ts#L1
read-receipts/redactions-in-threads.spec.ts took 2.5m
|
Slow Test:
read-receipts/redactions-main-timeline.spec.ts#L1
read-receipts/redactions-main-timeline.spec.ts took 1.8m
|
Slow Test:
read-receipts/new-messages-main-timeline.spec.ts#L1
read-receipts/new-messages-main-timeline.spec.ts took 1.3m
|
Slow Test:
read-receipts/read-receipts.spec.ts#L1
read-receipts/read-receipts.spec.ts took 1.0m
|
Slow Test:
read-receipts/reactions-in-threads.spec.ts#L1
read-receipts/reactions-in-threads.spec.ts took 55.5s
|
Slow Test:
spotlight/spotlight.spec.ts#L1
spotlight/spotlight.spec.ts took 2.1m
|
Slow Test:
spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
|
Slow Test:
threads/threads.spec.ts#L1
threads/threads.spec.ts took 34.3s
|
Slow Test:
user-onboarding/user-onboarding-new.spec.ts#L1
user-onboarding/user-onboarding-new.spec.ts took 30.3s
|
Slow Test:
widgets/widget-pip-close.spec.ts#L1
widgets/widget-pip-close.spec.ts took 20.4s
|
Slow Test:
messages/messages.spec.ts#L1
messages/messages.spec.ts took 2.1m
|
Slow Test:
pinned-messages/pinned-messages.spec.ts#L1
pinned-messages/pinned-messages.spec.ts took 1.6m
|
Slow Test:
login/login.spec.ts#L1
login/login.spec.ts took 56.5s
|
Slow Test:
integration-manager/read_events.spec.ts#L1
integration-manager/read_events.spec.ts took 35.2s
|
Slow Test:
knock/knock-into-room.spec.ts#L1
knock/knock-into-room.spec.ts took 35.0s
|
Slow Test:
read-receipts/new-messages-in-threads.spec.ts#L1
read-receipts/new-messages-in-threads.spec.ts took 1.9m
|
Slow Test:
read-receipts/editing-messages-in-threads.spec.ts#L1
read-receipts/editing-messages-in-threads.spec.ts took 1.5m
|
Slow Test:
read-receipts/editing-messages-main-timeline.spec.ts#L1
read-receipts/editing-messages-main-timeline.spec.ts took 1.3m
|
Slow Test:
read-receipts/editing-messages-thread-roots.spec.ts#L1
read-receipts/editing-messages-thread-roots.spec.ts took 59.7s
|
Slow Test:
composer/RTE.spec.ts#L1
composer/RTE.spec.ts took 1.2m
|
Slow Test:
audio-player/audio-player.spec.ts#L1
audio-player/audio-player.spec.ts took 1.2m
|
Slow Test:
crypto/event-shields.spec.ts#L1
crypto/event-shields.spec.ts took 1.0m
|
Slow Test:
crypto/crypto.spec.ts#L1
crypto/crypto.spec.ts took 59.7s
|
Slow Test:
crypto/device-verification.spec.ts#L1
crypto/device-verification.spec.ts took 43.2s
|
🎭 Playwright Run Summary
10 skipped
71 passed (8.9m)
|
🎭 Playwright Run Summary
14 skipped
62 passed (9.3m)
|
🎭 Playwright Run Summary
1 failed
timeline/timeline.spec.ts:467:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout
3 skipped
67 passed (9.5m)
|
🎭 Playwright Run Summary
1 skipped
78 passed (9.9m)
|
🎭 Playwright Run Summary
1 failed
read-receipts/high-level.spec.ts:217:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread
32 skipped
41 passed (10.6m)
|
🎭 Playwright Run Summary
78 passed (10.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
670 KB |
|
all-blob-reports-2
Expired
|
348 KB |
|
all-blob-reports-3
Expired
|
12.6 MB |
|
all-blob-reports-4
Expired
|
331 KB |
|
all-blob-reports-5
Expired
|
755 KB |
|
all-blob-reports-6
Expired
|
5.97 MB |
|
html-report
Expired
|
19 MB |
|
webapp
Expired
|
36.9 MB |
|