1) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process Error: Screenshot comparison failed: 160 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process/release-announcement-Threads-Activity-Centre-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process/release-announcement-Threads-Activity-Centre-diff.png Call log: - expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 160 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 160 pixels (ratio 0.01 of all image pixels) are different. at release-announcement/index.ts:45 43 | async assertReleaseAnnouncementIsVisible(name: string) { 44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible(); > 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`); | ^ 46 | } 47 | 48 | /** at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/element-web/element-web/playwright/e2e/release-announcement/index.ts:45:33) at /home/runner/work/element-web/element-web/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9

1) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 160 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry1/release-announcement-Threads-Activity-Centre-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry1/release-announcement-Threads-Activity-Centre-diff.png Call log: - expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 160 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 160 pixels (ratio 0.01 of all image pixels) are different. at release-announcement/index.ts:45 43 | async assertReleaseAnnouncementIsVisible(name: string) { 44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible(); > 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`); | ^ 46 | } 47 | 48 | /** at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/element-web/element-web/playwright/e2e/release-announcement/index.ts:45:33) at /home/runner/work/element-web/element-web/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9

1) release-announcement/releaseAnnouncement.spec.ts:21:9 › Release announcement › should display the release announcement process Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 160 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/release-announcement/releaseAnnouncement.spec.ts/release-announcement-Threads-Activity-Centre-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry2/release-announcement-Threads-Activity-Centre-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/release-announcement-relea-4147f-elease-announcement-process-retry2/release-announcement-Threads-Activity-Centre-diff.png Call log: - expect.toHaveScreenshot(release-announcement-Threads-Activity-Centre.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 160 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 160 pixels (ratio 0.01 of all image pixels) are different. at release-announcement/index.ts:45 43 | async assertReleaseAnnouncementIsVisible(name: string) { 44 | await expect(this.getReleaseAnnouncement(name)).toBeVisible(); > 45 | await expect(this.page).toMatchScreenshot(`release-announcement-${name}.png`); | ^ 46 | } 47 | 48 | /** at Helpers.assertReleaseAnnouncementIsVisible (/home/runner/work/element-web/element-web/playwright/e2e/release-announcement/index.ts:45:33) at /home/runner/work/element-web/element-web/playwright/e2e/release-announcement/releaseAnnouncement.spec.ts:23:9

2) settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly Error: Screenshot comparison failed: 1028 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1028 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1028 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

2) settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1028 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1028 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1028 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

2) settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1028 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1028 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1028 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

3) spaces/spaces.spec.ts:219:9 › Spaces › should render subspaces in the space panel only when expanded Error: Screenshot comparison failed: 104 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/spaces.spec.ts/space-panel-collapsed-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-spaces-Spaces-shoul-49b57-ce-panel-only-when-expanded/space-panel-collapsed-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-spaces-Spaces-shoul-49b57-ce-panel-only-when-expanded/space-panel-collapsed-diff.png Call log: - expect.toHaveScreenshot(space-panel-collapsed.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_SpacePanel') - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 104 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_SpacePanel') - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 104 pixels (ratio 0.01 of all image pixels) are different. 246 | 247 | await checkA11y(); > 248 | await expect(page.locator(".mx_SpacePanel")).toMatchScreenshot("space-panel-collapsed.png"); | ^ 249 | 250 | // This finds the expand button with the class name "mx_SpaceButton_toggleCollapse". Note there is another 251 | // button with the same name with different class name "mx_SpacePanel_toggleCollapse". at /home/runner/work/element-web/element-web/playwright/e2e/spaces/spaces.spec.ts:248:54

3) spaces/spaces.spec.ts:219:9 › Spaces › should render subspaces in the space panel only when expanded Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 104 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/spaces.spec.ts/space-panel-collapsed-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-spaces-Spaces-shoul-49b57-ce-panel-only-when-expanded-retry1/space-panel-collapsed-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-spaces-Spaces-shoul-49b57-ce-panel-only-when-expanded-retry1/space-panel-collapsed-diff.png Call log: - expect.toHaveScreenshot(space-panel-collapsed.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_SpacePanel') - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 104 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_SpacePanel') - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 104 pixels (ratio 0.01 of all image pixels) are different. 246 | 247 | await checkA11y(); > 248 | await expect(page.locator(".mx_SpacePanel")).toMatchScreenshot("space-panel-collapsed.png"); | ^ 249 | 250 | // This finds the expand button with the class name "mx_SpaceButton_toggleCollapse". Note there is another 251 | // button with the same name with different class name "mx_SpacePanel_toggleCollapse". at /home/runner/work/element-web/element-web/playwright/e2e/spaces/spaces.spec.ts:248:54

3) spaces/spaces.spec.ts:219:9 › Spaces › should render subspaces in the space panel only when expanded Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 104 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/spaces.spec.ts/space-panel-collapsed-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-spaces-Spaces-shoul-49b57-ce-panel-only-when-expanded-retry2/space-panel-collapsed-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-spaces-Spaces-shoul-49b57-ce-panel-only-when-expanded-retry2/space-panel-collapsed-diff.png Call log: - expect.toHaveScreenshot(space-panel-collapsed.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_SpacePanel') - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 104 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_SpacePanel') - locator resolved to <nav aria-label="Spaces" class="mx_SpacePanel collapsed">…</nav> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 104 pixels (ratio 0.01 of all image pixels) are different. 246 | 247 | await checkA11y(); > 248 | await expect(page.locator(".mx_SpacePanel")).toMatchScreenshot("space-panel-collapsed.png"); | ^ 249 | 250 | // This finds the expand button with the class name "mx_SpaceButton_toggleCollapse". Note there is another 251 | // button with the same name with different class name "mx_SpacePanel_toggleCollapse". at /home/runner/work/element-web/element-web/playwright/e2e/spaces/spaces.spec.ts:248:54

Process completed with exit code 1.

read-receipts/redactions-thread-roots.spec.ts took 1.1m

right-panel/right-panel.spec.ts took 52.3s

right-panel/file-panel.spec.ts took 37.8s

settings/account-user-settings-tab.spec.ts took 36.1s

settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 33.6s