Skip to content

Switch performance tests to Playwright #78275

Switch performance tests to Playwright

Switch performance tests to Playwright #78275

Triggered via pull request July 12, 2023 13:55
Status Success
Total duration 37m 52s
Artifacts 2

end2end-test.yml

on: pull_request
Matrix: e2e-playwright
Matrix: e2e-puppeteer
Report to GitHub
4m 22s
Report to GitHub
Fit to window
Zoom out
Zoom in

Annotations

7 errors and 4 notices
[chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes: test/e2e/specs/editor/blocks/image.spec.js#L789
1) [chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes Error: expect(received).toHaveAttribute(expected) Expected pattern: /137f10e9-7271-4293-b5b2-eca860d1b538/ Received string: "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
[chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes: test/e2e/specs/editor/blocks/image.spec.js#L789
1) [chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toHaveAttribute(expected) Expected pattern: /0e88e71d-c900-4342-a378-6a226b8c7734/ Received string: "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
[chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation: test/e2e/specs/editor/blocks/image.spec.js#L789
2) [chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation Error: expect(received).toHaveAttribute(expected) Expected pattern: /7584b1e8-b14a-4117-8d31-571609017621/ Received string: "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
[chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation: test/e2e/specs/editor/blocks/image.spec.js#L789
2) [chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toHaveAttribute(expected) Expected pattern: /a0b30bd5-07fa-497a-b15e-0c740a415619/ Received string: "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
[chromium] › editor/blocks/image.spec.js:1060:4 › Image - interactivity › tests using uploaded image › Animation Select visibility › Animation selector should appear if Behavior is Lightbox: test/e2e/specs/editor/blocks/image.spec.js#L789
3) [chromium] › editor/blocks/image.spec.js:1060:4 › Image - interactivity › tests using uploaded image › Animation Select visibility › Animation selector should appear if Behavior is Lightbox Error: expect(received).toHaveAttribute(expected) Expected pattern: /59dc92a1-e6e7-4b3e-af84-933092e9eff0/ Received string: "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
[chromium] › editor/blocks/image.spec.js:1127:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should open and focus appropriately using enter key: test/e2e/specs/editor/blocks/image.spec.js#L789
4) [chromium] › editor/blocks/image.spec.js:1127:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should open and focus appropriately using enter key Error: expect(received).toHaveAttribute(expected) Expected pattern: /c0dafcc6-fd82-42e1-9787-fa0eef6f309f/ Received string: "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
[chromium] › editor/blocks/image.spec.js:1137:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should close and focus appropriately using enter key on close button: test/e2e/specs/editor/blocks/image.spec.js#L789
5) [chromium] › editor/blocks/image.spec.js:1137:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should close and focus appropriately using enter key on close button Error: expect(received).toHaveAttribute(expected) Expected pattern: /bc37559b-6181-4096-bff2-9a69f520638f/ Received string: "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - waiting for locator('role=document[name="Block: Image"i]').locator('role=img') - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" - locator resolved to <img alt="This image has an empty alt attribute" src=…/> - unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff" 787 | const image = imageBlock.locator( 'role=img' ); 788 | await expect( image ).toBeVisible(); > 789 | await expect( image ).toHaveAttribute( | ^ 790 | 'src', 791 | new RegExp( filename ) 792 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
🎭 Playwright Run Summary
179 passed (12.3m)
🎭 Playwright Run Summary
2 skipped 164 passed (15.1m)
🎭 Playwright Run Summary
151 passed (16.4m)
🎭 Playwright Run Summary
5 flaky [chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes [chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation [chromium] › editor/blocks/image.spec.js:1060:4 › Image - interactivity › tests using uploaded image › Animation Select visibility › Animation selector should appear if Behavior is Lightbox [chromium] › editor/blocks/image.spec.js:1127:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should open and focus appropriately using enter key [chromium] › editor/blocks/image.spec.js:1137:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should close and focus appropriately using enter key on close button 176 passed (20.9m)

Artifacts

Produced during runtime
Name Size
failures-artifacts Expired
24.7 MB
flaky-tests-report Expired
84.3 KB