Skip to content

End to End Tests

End to End Tests #7650

Triggered via workflow run February 22, 2024 15:37
@renovaterenovate[bot]
completed b9bdd18
Status Failure
Total duration 18m 55s
Artifacts 11

end-to-end-tests.yaml

on: workflow_run
Prepare
3s
Prepare
Matrix: tests
Report results
38s
Report results
Fit to window
Zoom out
Zoom in

Annotations

13 errors, 7 warnings, and 1 notice
Run Tests 8/8
The process '/usr/bin/xvfb-run' failed with exit code 1
Run Tests 4/8
Failed to FinalizeArtifact: Unable to make request: ECONNRESET If you are using self-hosted runners, please make sure your runner has access to all GitHub endpoints: https://docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners/about-self-hosted-runners#communication-between-self-hosted-runners-and-github
Run Tests 4/8
The process '/usr/bin/xvfb-run' failed with exit code 1
[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L96
1) [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-mix-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Legacy-Crypto/tac-panel-mix-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Legacy-Crypto/tac-panel-mix-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 94 | 95 | // Verify that we don't have a visual regression > 96 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-mix-unread.png"); | ^ 97 | }); 98 | 99 | test("should update with a thread is read", async ({ roomAlpha: room1, roomBeta: room2, util, msg }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:96:42
[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L96
1) [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-mix-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Legacy-Crypto-retry1/tac-panel-mix-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Legacy-Crypto-retry1/tac-panel-mix-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 94 | 95 | // Verify that we don't have a visual regression > 96 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-mix-unread.png"); | ^ 97 | }); 98 | 99 | test("should update with a thread is read", async ({ roomAlpha: room1, roomBeta: room2, util, msg }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:96:42
[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L96
1) [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-mix-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Legacy-Crypto-retry2/tac-panel-mix-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Legacy-Crypto-retry2/tac-panel-mix-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 94 | 95 | // Verify that we don't have a visual regression > 96 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-mix-unread.png"); | ^ 97 | }); 98 | 99 | test("should update with a thread is read", async ({ roomAlpha: room1, roomBeta: room2, util, msg }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:96:42
[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L119
2) [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-notification-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Legacy-Crypto/tac-panel-notification-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Legacy-Crypto/tac-panel-notification-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 117 | { room: room2.name, notificationLevel: "notification" }, 118 | ]); > 119 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-notification-unread.png"); | ^ 120 | }); 121 | }); 122 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:119:42
[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L119
2) [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-notification-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Legacy-Crypto-retry1/tac-panel-notification-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Legacy-Crypto-retry1/tac-panel-notification-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 117 | { room: room2.name, notificationLevel: "notification" }, 118 | ]); > 119 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-notification-unread.png"); | ^ 120 | }); 121 | }); 122 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:119:42
[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L119
2) [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-notification-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Legacy-Crypto-retry2/tac-panel-notification-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Legacy-Crypto-retry2/tac-panel-notification-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 117 | { room: room2.name, notificationLevel: "notification" }, 118 | ]); > 119 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-notification-unread.png"); | ^ 120 | }); 121 | }); 122 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:119:42
[Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L96
3) [Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-mix-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Rust-Crypto/tac-panel-mix-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Rust-Crypto/tac-panel-mix-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 94 | 95 | // Verify that we don't have a visual regression > 96 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-mix-unread.png"); | ^ 97 | }); 98 | 99 | test("should update with a thread is read", async ({ roomAlpha: room1, roomBeta: room2, util, msg }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:96:42
[Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L96
3) [Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-mix-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Rust-Crypto-retry1/tac-panel-mix-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Rust-Crypto-retry1/tac-panel-mix-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 94 | 95 | // Verify that we don't have a visual regression > 96 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-mix-unread.png"); | ^ 97 | }); 98 | 99 | test("should update with a thread is read", async ({ roomAlpha: room1, roomBeta: room2, util, msg }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:96:42
[Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L96
3) [Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-mix-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Rust-Crypto-retry2/tac-panel-mix-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b82e7-entre-should-show-the-rooms-with-unread-threads-Rust-Crypto-retry2/tac-panel-mix-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 94 | 95 | // Verify that we don't have a visual regression > 96 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-mix-unread.png"); | ^ 97 | }); 98 | 99 | test("should update with a thread is read", async ({ roomAlpha: room1, roomBeta: room2, util, msg }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:96:42
[Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read: matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L119
4) [Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read Error: Screenshot comparison failed: Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-panel-notification-unread-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Rust-Crypto/tac-panel-notification-unread-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/spaces-threads-activity-centre-threadsActivity-b6cad-vity-Centre-should-update-with-a-thread-is-read-Rust-Crypto/tac-panel-notification-unread-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('menu', { name: 'Threads' }) - locator resolved to <div dir="ltr" role="menu" id="radix-1" tabindex="-1"…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 302px by 172px, received 294px by 172px. 443 pixels (ratio 0.01 of all image pixels) are different. 117 | { room: room2.name, notificationLevel: "notification" }, 118 | ]); > 119 | await expect(util.getTacPanel()).toMatchScreenshot("tac-panel-notification-unread.png"); | ^ 120 | }); 121 | }); 122 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:119:42
🎭 Playwright Run Summary
4 failed [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads [Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read [Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:82:9 › Threads Activity Centre › should show the rooms with unread threads [Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:99:9 › Threads Activity Centre › should update with a thread is read 3 flaky [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A [Rust Crypto] › crypto/verification.spec.ts:245:9 › User verification › can receive a verification request when there is no existing DM [Rust Crypto] › read-receipts/redactions.spec.ts:691:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart 121 skipped 652 passed (16.8m)
Prepare
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Report results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e, bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 6.4m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.4m
Slow Test: [Legacy Crypto] › read-receipts/new-messages.spec.ts#L1
[Legacy Crypto] › read-receipts/new-messages.spec.ts took 4.1m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 4.1m
Slow Test: [Legacy Crypto] › read-receipts/high-level.spec.ts#L1
[Legacy Crypto] › read-receipts/high-level.spec.ts took 3.8m

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
993 KB
all-blob-reports-2 Expired
594 KB
all-blob-reports-3 Expired
6.03 MB
all-blob-reports-4 Expired
14.7 MB
all-blob-reports-4 Expired
14.7 MB
all-blob-reports-4 Expired
14.7 MB
all-blob-reports-5 Expired
6.26 MB
all-blob-reports-6 Expired
570 KB
all-blob-reports-7 Expired
5.69 MB
all-blob-reports-8 Expired
14.9 MB
html-report--attempt-1 Expired
44.8 MB