Playwright #730
Annotations
10 errors, 4 warnings, and 1 notice
Run Playwright tests:
tests/playwright/sanity/accordion.test.ts#L18
1) accordion.test.ts:5:5 › Accordion ─────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1140px by 185px, received 646px by 267px. 9137 pixels (ratio 0.04 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/accordion.test.ts-snapshots/accordion-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/accordion-Accordion/accordion-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/accordion-Accordion/accordion-diff.jpeg
16 | .locator( '.elementor-widget-wrap > .elementor-background-overlay' )
17 | .screenshot( { type: 'jpeg', quality: 90 } ) )
> 18 | .toMatchSnapshot( 'accordion.jpeg' );
| ^
19 | } );
20 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/accordion.test.ts:18:4
|
Run Playwright tests:
tests/playwright/sanity/accordion.test.ts#L18
1) accordion.test.ts:5:5 › Accordion ─────────────────────────────────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1140px by 185px, received 646px by 267px. 9137 pixels (ratio 0.04 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/accordion.test.ts-snapshots/accordion-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/accordion-Accordion-retry1/accordion-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/accordion-Accordion-retry1/accordion-diff.jpeg
16 | .locator( '.elementor-widget-wrap > .elementor-background-overlay' )
17 | .screenshot( { type: 'jpeg', quality: 90 } ) )
> 18 | .toMatchSnapshot( 'accordion.jpeg' );
| ^
19 | } );
20 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/accordion.test.ts:18:4
|
Run Playwright tests:
tests/playwright/sanity/atomic-widgets.test.ts#L56
2) atomic-widgets.test.ts:52:6 › Atomic Widgets › Widgets are displayed in front end ─────────────
Error: Screenshot comparison failed:
Timeout 5000ms exceeded.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/atomic-widgets.test.ts-snapshots/atomic-widgets-frontend-linux.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.page-content')
- Timeout 5000ms exceeded.
54 | await editor.page.setViewportSize( { width: 1920, height: 1080 } );
55 | await expect.soft( editor.page.locator( '.page-content' ) )
> 56 | .toHaveScreenshot( 'atomic-widgets-frontend.png' );
| ^
57 | } );
58 | } );
59 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/atomic-widgets.test.ts:56:5
|
Run Playwright tests:
tests/playwright/sanity/atomic-widgets.test.ts#L56
2) atomic-widgets.test.ts:52:6 › Atomic Widgets › Widgets are displayed in front end ─────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Timeout 5000ms exceeded.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/atomic-widgets.test.ts-snapshots/atomic-widgets-frontend-linux.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.page-content')
- Timeout 5000ms exceeded.
54 | await editor.page.setViewportSize( { width: 1920, height: 1080 } );
55 | await expect.soft( editor.page.locator( '.page-content' ) )
> 56 | .toHaveScreenshot( 'atomic-widgets-frontend.png' );
| ^
57 | } );
58 | } );
59 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/atomic-widgets.test.ts:56:5
|
Run Playwright tests:
tests/playwright/sanity/basic-gallery.test.ts#L24
3) basic-gallery.test.ts:8:5 › Basic Gallery ─────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1120px by 300px, received 626px by 301px. 38607 pixels (ratio 0.12 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/basic-gallery.test.ts-snapshots/gallery-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/basic-gallery-Basic-Gallery/gallery-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/basic-gallery-Basic-Gallery/gallery-diff.jpeg
22 | .locator( 'div#gallery-1' )
23 | .screenshot( { type: 'jpeg', quality: 90 } ) )
> 24 | .toMatchSnapshot( 'gallery.jpeg' );
| ^
25 | } );
26 |
27 | test( 'Basic Gallery Lightbox', async ( { page, apiRequests }, testInfo ) => {
at /home/runner/work/elementor/elementor/tests/playwright/sanity/basic-gallery.test.ts:24:4
|
Run Playwright tests:
tests/playwright/sanity/basic-gallery.test.ts#L24
3) basic-gallery.test.ts:8:5 › Basic Gallery ─────────────────────────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1120px by 300px, received 626px by 301px. 38607 pixels (ratio 0.12 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/basic-gallery.test.ts-snapshots/gallery-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/basic-gallery-Basic-Gallery-retry1/gallery-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/basic-gallery-Basic-Gallery-retry1/gallery-diff.jpeg
22 | .locator( 'div#gallery-1' )
23 | .screenshot( { type: 'jpeg', quality: 90 } ) )
> 24 | .toMatchSnapshot( 'gallery.jpeg' );
| ^
25 | } );
26 |
27 | test( 'Basic Gallery Lightbox', async ( { page, apiRequests }, testInfo ) => {
at /home/runner/work/elementor/elementor/tests/playwright/sanity/basic-gallery.test.ts:24:4
|
Run Playwright tests:
tests/playwright/sanity/button.test.ts#L73
4) button.test.ts:62:5 › Verify Button with Icon styling ─────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1620px by 120px, received 646px by 121px. 30201 pixels (ratio 0.16 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts-snapshots/button-container-linux.png
Received: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling/button-container-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling/button-container-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con')
- locator resolved to <div data-id="4a087071" data-model-cid="c787" data-ne…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1620px by 120px, received 646px by 121px. 30201 pixels (ratio 0.16 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con')
- locator resolved to <div data-id="4a087071" data-model-cid="c787" data-ne…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1620px by 120px, received 646px by 121px. 30201 pixels (ratio 0.16 of all image pixels) are different.
71 |
72 | // Assert
> 73 | await expect.soft( editor.getPreviewFrame().locator( '.e-con' ) ).toHaveScreenshot( 'button-container.png' );
| ^
74 |
75 | const buttonFirst = editor.getPreviewFrame().locator( '.elementor-widget-button a' ).first();
76 | await buttonFirst.hover();
at /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts:73:68
|
Run Playwright tests:
tests/playwright/sanity/button.test.ts#L78
4) button.test.ts:62:5 › Verify Button with Icon styling ─────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 186px by 40px, received 185px by 41px. 746 pixels (ratio 0.10 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts-snapshots/button-hover-first-linux.png
Received: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling/button-hover-first-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling/button-hover-first-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.elementor-widget-button a').first()
- locator resolved to <a href="#" class="elementor-button elementor-butto…>…</a>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 186px by 40px, received 185px by 41px. 746 pixels (ratio 0.10 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.elementor-widget-button a').first()
- locator resolved to <a href="#" class="elementor-button elementor-butto…>…</a>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 186px by 40px, received 185px by 41px. 746 pixels (ratio 0.10 of all image pixels) are different.
76 | await buttonFirst.hover();
77 |
> 78 | await expect.soft( buttonFirst ).toHaveScreenshot( 'button-hover-first.png' );
| ^
79 |
80 | const buttonLast = editor.getPreviewFrame().locator( '.elementor-widget-button a' ).last();
81 | await buttonLast.hover();
at /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts:78:35
|
Run Playwright tests:
tests/playwright/sanity/button.test.ts#L83
4) button.test.ts:62:5 › Verify Button with Icon styling ─────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 234px by 40px, received 232px by 41px. 1123 pixels (ratio 0.12 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts-snapshots/button-hover-last-linux.png
Received: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling/button-hover-last-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling/button-hover-last-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.elementor-widget-button a').last()
- locator resolved to <a href="#" class="elementor-button elementor-butto…>…</a>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 234px by 40px, received 232px by 41px. 1123 pixels (ratio 0.12 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.elementor-widget-button a').last()
- locator resolved to <a href="#" class="elementor-button elementor-butto…>…</a>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 234px by 40px, received 232px by 41px. 1123 pixels (ratio 0.12 of all image pixels) are different.
81 | await buttonLast.hover();
82 |
> 83 | await expect.soft( buttonLast ).toHaveScreenshot( 'button-hover-last.png' );
| ^
84 | } );
85 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts:83:34
|
Run Playwright tests:
tests/playwright/sanity/button.test.ts#L73
4) button.test.ts:62:5 › Verify Button with Icon styling ─────────────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1620px by 120px, received 646px by 121px. 30201 pixels (ratio 0.16 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts-snapshots/button-container-linux.png
Received: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling-retry1/button-container-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/button-Verify-Button-with-Icon-styling-retry1/button-container-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con')
- locator resolved to <div data-id="4a087071" data-model-cid="c787" data-ne…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1620px by 120px, received 646px by 121px. 30201 pixels (ratio 0.16 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con')
- locator resolved to <div data-id="4a087071" data-model-cid="c787" data-ne…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1620px by 120px, received 646px by 121px. 30201 pixels (ratio 0.16 of all image pixels) are different.
71 |
72 | // Assert
> 73 | await expect.soft( editor.getPreviewFrame().locator( '.e-con' ) ).toHaveScreenshot( 'button-container.png' );
| ^
74 |
75 | const buttonFirst = editor.getPreviewFrame().locator( '.elementor-widget-button a' ).first();
76 | await buttonFirst.hover();
at /home/runner/work/elementor/elementor/tests/playwright/sanity/button.test.ts:73:68
|
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run Playwright tests:
assets/dev/js/editor/elements/views/widget.test.ts#L1
assets/dev/js/editor/elements/views/widget.test.ts took 37.4s
|
Run Playwright tests:
assets/js/frontend/utils/url-actions.test.ts#L1
assets/js/frontend/utils/url-actions.test.ts took 18.2s
|
Run Playwright tests:
assets/dev/js/editor/regions/panel/pages/menu/exit-to.test.ts#L1
assets/dev/js/editor/regions/panel/pages/menu/exit-to.test.ts took 17.2s
|
Run Playwright tests
4 failed
accordion.test.ts:5:5 › Accordion ──────────────────────────────────────────────────────────────
atomic-widgets.test.ts:52:6 › Atomic Widgets › Widgets are displayed in front end ──────────────
basic-gallery.test.ts:8:5 › Basic Gallery ──────────────────────────────────────────────────────
button.test.ts:62:5 › Verify Button with Icon styling ──────────────────────────────────────────
1 flaky
container-grid.test.ts:24:6 › Container Grid tests @container › Test grid container ────────────
1 skipped
35 passed (4.5m)
|
Loading