Skip to content

SDKs: add Hydrogen & Remix tests #10827

SDKs: add Hydrogen & Remix tests

SDKs: add Hydrogen & Remix tests #10827

Triggered via pull request June 4, 2024 18:37
Status Failure
Total duration 19m 18s
Artifacts 3

ci.yml

on: pull_request
Matrix: build
Matrix: Gen 1 React SDK
Matrix: Gen 2 SDK Snippets
Matrix: Gen 2 SDKs
Fit to window
Zoom out
Zoom in

Annotations

17 errors, 6 warnings, and 32 notices
Gen 2 SDKs checks
Process completed with exit code 1.
[react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns: packages/sdks-tests/src/snippet-tests/quickstart.spec.ts#L1
1) [react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns Test timeout of 30000ms exceeded.
[react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns: packages/sdks-tests/src/helpers/index.ts#L102
1) [react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns Error: expect.toBeVisible: Target page, context or browser has been closed at ../helpers/index.ts:102 100 | 101 | export const findTextInPage = async ({ page, text }: { page: Page; text: string }) => { > 102 | await expect(page.locator(`text=${text}`)).toBeVisible(); | ^ 103 | }; 104 | 105 | export const checkIsRN = (sdk: Sdk) => sdk === 'reactNative'; at findTextInPage (/home/runner/work/builder/builder/packages/sdks-tests/src/helpers/index.ts:102:46) at /home/runner/work/builder/builder/packages/sdks-tests/src/snippet-tests/quickstart.spec.ts:28:11
Gen 2 SDK Snippets (react-native)
Process completed with exit code 1.
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time: packages/sdks-tests/src/e2e-tests/accordion.spec.ts#L1
1) [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time Test timeout of 30000ms exceeded.
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time: packages/sdks-tests/src/e2e-tests/accordion.spec.ts#L67
1) [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time Error: page.goto: Test timeout of 30000ms exceeded. Call log: - navigating to "http://localhost:19006/accordion-one-at-a-time", waiting until "load" 65 | ) 66 | ); > 67 | await page.goto('/accordion-one-at-a-time'); | ^ 68 | 69 | for (let i = 1; i <= 3; i++) { 70 | await page.locator(`text=Item ${i}`).click({ timeout: 10000 }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/accordion.spec.ts:67:16
Gen 2 SDKs (react-native)
Process completed with exit code 1.
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
1) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR ──── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is the default variation!').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is the default variation!').locator('visible=true') 105 | await page.goto('/ab-test'); 106 | > 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible(); | ^ 108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden(); 109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 110 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
2) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR ─── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is variation 1').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is variation 1').locator('visible=true') 131 | await page.goto('/ab-test'); 132 | > 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible(); | ^ 134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden(); 135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 136 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
3) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR ──── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is the default variation!').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is the default variation!').locator('visible=true') 105 | await page.goto('/ab-test'); 106 | > 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible(); | ^ 108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden(); 109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 110 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
4) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR ─── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is variation 1').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is variation 1').locator('visible=true') 131 | await page.goto('/ab-test'); 132 | > 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible(); | ^ 134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden(); 135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 136 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
5) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR ──── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is the default variation!').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is the default variation!').locator('visible=true') 105 | await page.goto('/ab-test'); 106 | > 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible(); | ^ 108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden(); 109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 110 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
6) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR ─── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is variation 1').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is variation 1').locator('visible=true') 131 | await page.goto('/ab-test'); 132 | > 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible(); | ^ 134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden(); 135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 136 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
7) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR ──── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is the default variation!').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is the default variation!').locator('visible=true') 105 | await page.goto('/ab-test'); 106 | > 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible(); | ^ 108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden(); 109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 110 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
8) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR ─── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is variation 1').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is variation 1').locator('visible=true') 131 | await page.goto('/ab-test'); 132 | > 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible(); | ^ 134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden(); 135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 136 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
9) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR ──── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is the default variation!').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is the default variation!').locator('visible=true') 105 | await page.goto('/ab-test'); 106 | > 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible(); | ^ 108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden(); 109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 110 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR: packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
10) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR ── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('This is variation 1').locator('visible=true') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('This is variation 1').locator('visible=true') 131 | await page.goto('/ab-test'); 132 | > 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible(); | ^ 134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden(); 135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden(); 136 | }); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
🎭 Playwright Run Summary
3 passed (7.3s)
🎭 Playwright Run Summary
3 passed (6.6s)
🎭 Playwright Run Summary
3 passed (12.0s)
🎭 Playwright Run Summary
3 passed (6.7s)
🎭 Playwright Run Summary
3 passed (7.8s)
🎭 Playwright Run Summary
3 passed (8.2s)
🎭 Playwright Run Summary
3 passed (7.8s)
🎭 Playwright Run Summary
3 passed (6.9s)
🎭 Playwright Run Summary
3 passed (7.1s)
🎭 Playwright Run Summary
3 passed (6.9s)
🎭 Playwright Run Summary
3 passed (9.6s)
🎭 Playwright Run Summary
79 skipped 69 passed (55.7s)
🎭 Playwright Run Summary
3 passed (14.7s)
🎭 Playwright Run Summary
1 failed [react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns 2 passed (49.1s)
🎭 Playwright Run Summary
14 skipped 134 passed (2.3m)
🎭 Playwright Run Summary
34 skipped 114 passed (2.3m)
🎭 Playwright Run Summary
15 skipped 133 passed (2.2m)
🎭 Playwright Run Summary
7 skipped 141 passed (2.3m)
🎭 Playwright Run Summary
8 skipped 140 passed (2.0m)
🎭 Playwright Run Summary
7 skipped 141 passed (2.4m)
🎭 Playwright Run Summary
7 skipped 141 passed (2.5m)
🎭 Playwright Run Summary
12 skipped 136 passed (2.3m)
🎭 Playwright Run Summary
14 skipped 134 passed (2.4m)
🎭 Playwright Run Summary
14 skipped 134 passed (2.7m)
🎭 Playwright Run Summary
8 skipped 140 passed (2.6m)
🎭 Playwright Run Summary
1 failed [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time 79 skipped 68 passed (2.8m)
🎭 Playwright Run Summary
14 skipped 134 passed (3.9m)
🎭 Playwright Run Summary
7 skipped 141 passed (4.8m)
🎭 Playwright Run Summary
15 skipped 133 passed (5.2m)
🎭 Playwright Run Summary
10 skipped 138 passed (8.7m)
🎭 Playwright Run Summary
9 skipped 139 passed (9.3m)
🎭 Playwright Run Summary
125 failed [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #6/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #6/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #7/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #7/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #8/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #8/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #9/10: Render default w/ SSR ───── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #9/10: Render variant w/ SSR ──── [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #10/10: Render default w/ SSR ──── [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #10/10: Render variant w/ SSR ─── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #1/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #1/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #2/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #2/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #3/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #3/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #4/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #4/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #5/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #5/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #6/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #6/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #7/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #7/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #8/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #8/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #9/10: Render default w/ SSR ── [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #9/10: Render variant w/ SSR ── [hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #10/10: Render default w/ SSR ─ [hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #10/10: Render variant w/ SSR ─ [hydrogen] › accordion.spec.ts:5:3 › Ac
build (widgets)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build (webcomponents)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Gen 2 SDK Snippets (react-native)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Gen 2 SDKs (react-native)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Gen 2 SDKs (hydrogen)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "hydrogen-playwright-report", "react-native-playwright-report", "react-native-snippet-playwright-report". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime
Name Size
hydrogen-playwright-report
3.11 MB
react-native-playwright-report
8.32 MB
react-native-snippet-playwright-report
2.03 MB