Playwright #742
Annotations
10 errors, 3 warnings, and 1 notice
Run Playwright tests:
tests/playwright/sanity/modules/container/container-1.test.ts#L43
1) modules/container/container-1.test.ts:28:6 › Container tests @container › Background slideshow
Error: Screenshot comparison failed:
Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts-snapshots/editor-container-background-slideshow-linux.png
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow/editor-container-background-slideshow-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow/editor-container-background-slideshow-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con').first()
- locator resolved to <div data-id="5ef75b3" data-model-cid="c785" data-nes…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con').first()
- locator resolved to <div data-id="5ef75b3" data-model-cid="c785" data-nes…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
41 | await test.step( 'Verify background slideshow', async () => {
42 | await editor.togglePreviewMode();
> 43 | await expect.soft( editor.getPreviewFrame().locator( '.e-con' ).nth( 0 ) ).toHaveScreenshot( 'editor-container-background-slideshow.png' );
| ^
44 | await editor.togglePreviewMode();
45 | await editor.publishAndViewPage();
46 | } );
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:43:79
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:41:3
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-1.test.ts#L49
1) modules/container/container-1.test.ts:28:6 › Container tests @container › Background slideshow
Error: Screenshot comparison failed:
Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts-snapshots/frontend-container-background-slideshow-linux.png
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow/frontend-container-background-slideshow-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow/frontend-container-background-slideshow-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con')
- locator resolved to <div data-id="5ef75b3" data-element_type="container" …>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con')
- locator resolved to <div data-id="5ef75b3" data-element_type="container" …>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
47 |
48 | await test.step( 'Verify background slideshow on the frontend', async () => {
> 49 | await expect.soft( page.locator( '.e-con' ) ).toHaveScreenshot( 'frontend-container-background-slideshow.png' );
| ^
50 | } );
51 | } );
52 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:49:50
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:48:14
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-1.test.ts#L43
1) modules/container/container-1.test.ts:28:6 › Container tests @container › Background slideshow
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts-snapshots/editor-container-background-slideshow-linux.png
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow-retry1/editor-container-background-slideshow-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow-retry1/editor-container-background-slideshow-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con').first()
- locator resolved to <div data-id="3dc37ef" data-model-cid="c785" data-nes…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con').first()
- locator resolved to <div data-id="3dc37ef" data-model-cid="c785" data-nes…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
41 | await test.step( 'Verify background slideshow', async () => {
42 | await editor.togglePreviewMode();
> 43 | await expect.soft( editor.getPreviewFrame().locator( '.e-con' ).nth( 0 ) ).toHaveScreenshot( 'editor-container-background-slideshow.png' );
| ^
44 | await editor.togglePreviewMode();
45 | await editor.publishAndViewPage();
46 | } );
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:43:79
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:41:3
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-1.test.ts#L49
1) modules/container/container-1.test.ts:28:6 › Container tests @container › Background slideshow
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts-snapshots/frontend-container-background-slideshow-linux.png
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow-retry1/frontend-container-background-slideshow-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-b3d47-tainer-Background-slideshow-retry1/frontend-container-background-slideshow-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con')
- locator resolved to <div data-id="3dc37ef" data-element_type="container" …>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con')
- locator resolved to <div data-id="3dc37ef" data-element_type="container" …>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1920px by 52px, received 646px by 53px. 31717 pixels (ratio 0.32 of all image pixels) are different.
47 |
48 | await test.step( 'Verify background slideshow on the frontend', async () => {
> 49 | await expect.soft( page.locator( '.e-con' ) ).toHaveScreenshot( 'frontend-container-background-slideshow.png' );
| ^
50 | } );
51 | } );
52 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:49:50
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-1.test.ts:48:14
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-3.test.ts#L94
2) modules/container/container-3.test.ts:27:6 › Container tests @container › Widget display inside container flex wrap
Error: Screenshot comparison failed:
Expected an image 1920px by 548px, received 1920px by 549px.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts-snapshots/container-row-flex-wrap-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-71c45--inside-container-flex-wrap/container-row-flex-wrap-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-71c45--inside-container-flex-wrap/container-row-flex-wrap-diff.jpeg
92 | type: 'jpeg',
93 | quality: 90,
> 94 | } ) ).toMatchSnapshot( 'container-row-flex-wrap.jpeg' );
| ^
95 |
96 | await editor.togglePreviewMode();
97 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts:94:9
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-3.test.ts#L94
2) modules/container/container-3.test.ts:27:6 › Container tests @container › Widget display inside container flex wrap
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1920px by 548px, received 1920px by 549px.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts-snapshots/container-row-flex-wrap-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-71c45--inside-container-flex-wrap-retry1/container-row-flex-wrap-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-71c45--inside-container-flex-wrap-retry1/container-row-flex-wrap-diff.jpeg
92 | type: 'jpeg',
93 | quality: 90,
> 94 | } ) ).toMatchSnapshot( 'container-row-flex-wrap.jpeg' );
| ^
95 |
96 | await editor.togglePreviewMode();
97 |
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts:94:9
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-3.test.ts#L198
3) modules/container/container-3.test.ts:168:6 › Container tests @container › Spacer alignment with container column setting
Error: Screenshot comparison failed:
Expected an image 1620px by 70px, received 646px by 71px. 17414 pixels (ratio 0.16 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts-snapshots/container-column-spacer-align-center-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-f715b-th-container-column-setting/container-column-spacer-align-center-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-f715b-th-container-column-setting/container-column-spacer-align-center-diff.jpeg
196 | type: 'jpeg',
197 | quality: 90,
> 198 | } ) ).toMatchSnapshot( 'container-column-spacer-align-center.jpeg' );
| ^
199 | } );
200 |
201 | test( 'Right container padding for preset c100-c50-50', async ( { page, apiRequests }, testInfo ) => {
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts:198:9
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-3.test.ts#L198
3) modules/container/container-3.test.ts:168:6 › Container tests @container › Spacer alignment with container column setting
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1620px by 70px, received 646px by 71px. 17414 pixels (ratio 0.16 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts-snapshots/container-column-spacer-align-center-linux.jpeg
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-f715b-th-container-column-setting-retry1/container-column-spacer-align-center-actual.jpeg
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-f715b-th-container-column-setting-retry1/container-column-spacer-align-center-diff.jpeg
196 | type: 'jpeg',
197 | quality: 90,
> 198 | } ) ).toMatchSnapshot( 'container-column-spacer-align-center.jpeg' );
| ^
199 | } );
200 |
201 | test( 'Right container padding for preset c100-c50-50', async ( { page, apiRequests }, testInfo ) => {
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-3.test.ts:198:9
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-4.test.ts#L239
4) modules/container/container-4.test.ts:215:6 › Container tests @container › Test dimensions with logical properties using ltr & rtl
Error: Screenshot comparison failed:
Expected an image 1920px by 1312px, received 646px by 1604px. 422152 pixels (ratio 0.14 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-4.test.ts-snapshots/container-dimensions-rtl-linux.png
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-4b940-al-properties-using-ltr-rtl/container-dimensions-rtl-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-4b940-al-properties-using-ltr-rtl/container-dimensions-rtl-diff.png
237 | .locator( '.e-con.e-parent>>nth=0' )
238 | .screenshot( { type: 'png' } ) )
> 239 | .toMatchSnapshot( 'container-dimensions-rtl.png' );
| ^
240 | } );
241 |
242 | await test.step( 'Set user language to English', async () => {
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-4.test.ts:239:7
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-4.test.ts:230:4
|
Run Playwright tests:
tests/playwright/sanity/modules/container/container-4.test.ts#L263
4) modules/container/container-4.test.ts:215:6 › Container tests @container › Test dimensions with logical properties using ltr & rtl
Error: Screenshot comparison failed:
Expected an image 1920px by 1312px, received 646px by 1604px. 422152 pixels (ratio 0.14 of all image pixels) are different.
Expected: /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-4.test.ts-snapshots/container-dimensions-rtl-with-ltr-ui-linux.png
Received: /home/runner/work/elementor/elementor/test-results/modules-container-containe-4b940-al-properties-using-ltr-rtl/container-dimensions-rtl-with-ltr-ui-actual.png
Diff: /home/runner/work/elementor/elementor/test-results/modules-container-containe-4b940-al-properties-using-ltr-rtl/container-dimensions-rtl-with-ltr-ui-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.e-con.e-parent').first()
- locator resolved to <div data-id="67bf76c9" data-model-cid="c787" data-ne…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1920px by 1312px, received 646px by 1604px. 422152 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.e-con.e-parent').first()
- locator resolved to <div data-id="67bf76c9" data-model-cid="c787" data-ne…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1920px by 1312px, received 646px by 1604px. 422152 pixels (ratio 0.14 of all image pixels) are different.
261 | await expect.soft( editor.getPreviewFrame()
262 | .locator( '.e-con.e-parent >> nth=0' ) )
> 263 | .toHaveScreenshot( 'container-dimensions-rtl-with-ltr-ui.png' );
| ^
264 | } );
265 | } finally {
266 | await wpAdmin.setSiteLanguage( '' );
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-4.test.ts:263:7
at /home/runner/work/elementor/elementor/tests/playwright/sanity/modules/container/container-4.test.ts:255:4
|
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run Playwright tests:
modules/container/container-2.test.ts#L1
modules/container/container-2.test.ts took 1.7m
|
Run Playwright tests:
modules/nested-accordion/nested-accordion-atomic-repeaters.test.ts#L1
modules/nested-accordion/nested-accordion-atomic-repeaters.test.ts took 36.6s
|
Run Playwright tests
8 failed
modules/container/container-1.test.ts:28:6 › Container tests @container › Background slideshow ─
modules/container/container-3.test.ts:27:6 › Container tests @container › Widget display inside container flex wrap
modules/container/container-3.test.ts:168:6 › Container tests @container › Spacer alignment with container column setting
modules/container/container-4.test.ts:215:6 › Container tests @container › Test dimensions with logical properties using ltr & rtl
modules/floating-buttons/floating-elements-admin.test.ts:7:6 › Verify floating buttons editor, admin page and front page behavior › Verify editor behavior by creating post through API and also FE behavior
modules/floating-buttons/floating-elements-admin.test.ts:130:6 › Verify floating buttons editor, admin page and front page behavior › Verify floating elements admin page behavior
modules/nested-accordion/nested-accordion-content.test.ts:33:6 › Nested Accordion Content Tests @nested-accordion › Nested Accordion Title Icon and Text Vertical Alignment
modules/nested-accordion/nested-accordion-content.test.ts:155:6 › Nested Accordion Content Tests @nested-accordion › Nested Accordion test SVG Icon and No Icon when Title Icons is disabled
1 skipped
29 passed (7.3m)
|
Loading