SDKs: add Hydrogen & Remix tests #10827
ci.yml
on: pull_request
Matrix: build
Matrix: Gen 1 React SDK
Matrix: Gen 2 SDK Snippets
Matrix: Gen 2 SDKs
Annotations
17 errors, 6 warnings, and 32 notices
Gen 2 SDKs checks
Process completed with exit code 1.
|
[react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns:
packages/sdks-tests/src/snippet-tests/quickstart.spec.ts#L1
1) [react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns
Test timeout of 30000ms exceeded.
|
[react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns:
packages/sdks-tests/src/helpers/index.ts#L102
1) [react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns
Error: expect.toBeVisible: Target page, context or browser has been closed
at ../helpers/index.ts:102
100 |
101 | export const findTextInPage = async ({ page, text }: { page: Page; text: string }) => {
> 102 | await expect(page.locator(`text=${text}`)).toBeVisible();
| ^
103 | };
104 |
105 | export const checkIsRN = (sdk: Sdk) => sdk === 'reactNative';
at findTextInPage (/home/runner/work/builder/builder/packages/sdks-tests/src/helpers/index.ts:102:46)
at /home/runner/work/builder/builder/packages/sdks-tests/src/snippet-tests/quickstart.spec.ts:28:11
|
Gen 2 SDK Snippets (react-native)
Process completed with exit code 1.
|
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time:
packages/sdks-tests/src/e2e-tests/accordion.spec.ts#L1
1) [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time
Test timeout of 30000ms exceeded.
|
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time:
packages/sdks-tests/src/e2e-tests/accordion.spec.ts#L67
1) [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time
Error: page.goto: Test timeout of 30000ms exceeded.
Call log:
- navigating to "http://localhost:19006/accordion-one-at-a-time", waiting until "load"
65 | )
66 | );
> 67 | await page.goto('/accordion-one-at-a-time');
| ^
68 |
69 | for (let i = 1; i <= 3; i++) {
70 | await page.locator(`text=Item ${i}`).click({ timeout: 10000 });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/accordion.spec.ts:67:16
|
Gen 2 SDKs (react-native)
Process completed with exit code 1.
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
1) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
2) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
3) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
4) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
5) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
6) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
7) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
8) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
9) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
10) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR ──
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
🎭 Playwright Run Summary
3 passed (7.3s)
|
🎭 Playwright Run Summary
3 passed (6.6s)
|
🎭 Playwright Run Summary
3 passed (12.0s)
|
🎭 Playwright Run Summary
3 passed (6.7s)
|
🎭 Playwright Run Summary
3 passed (7.8s)
|
🎭 Playwright Run Summary
3 passed (8.2s)
|
🎭 Playwright Run Summary
3 passed (7.8s)
|
🎭 Playwright Run Summary
3 passed (6.9s)
|
🎭 Playwright Run Summary
3 passed (7.1s)
|
🎭 Playwright Run Summary
3 passed (6.9s)
|
🎭 Playwright Run Summary
3 passed (9.6s)
|
🎭 Playwright Run Summary
79 skipped
69 passed (55.7s)
|
🎭 Playwright Run Summary
3 passed (14.7s)
|
🎭 Playwright Run Summary
1 failed
[react-native] › quickstart.spec.ts:18:3 › Quickstart › loads homepage and navigates to columns
2 passed (49.1s)
|
🎭 Playwright Run Summary
14 skipped
134 passed (2.3m)
|
🎭 Playwright Run Summary
34 skipped
114 passed (2.3m)
|
🎭 Playwright Run Summary
15 skipped
133 passed (2.2m)
|
🎭 Playwright Run Summary
7 skipped
141 passed (2.3m)
|
🎭 Playwright Run Summary
8 skipped
140 passed (2.0m)
|
🎭 Playwright Run Summary
7 skipped
141 passed (2.4m)
|
🎭 Playwright Run Summary
7 skipped
141 passed (2.5m)
|
🎭 Playwright Run Summary
12 skipped
136 passed (2.3m)
|
🎭 Playwright Run Summary
14 skipped
134 passed (2.4m)
|
🎭 Playwright Run Summary
14 skipped
134 passed (2.7m)
|
🎭 Playwright Run Summary
8 skipped
140 passed (2.6m)
|
🎭 Playwright Run Summary
1 failed
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time
79 skipped
68 passed (2.8m)
|
🎭 Playwright Run Summary
14 skipped
134 passed (3.9m)
|
🎭 Playwright Run Summary
7 skipped
141 passed (4.8m)
|
🎭 Playwright Run Summary
15 skipped
133 passed (5.2m)
|
🎭 Playwright Run Summary
10 skipped
138 passed (8.7m)
|
🎭 Playwright Run Summary
9 skipped
139 passed (9.3m)
|
🎭 Playwright Run Summary
125 failed
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #6/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #6/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #7/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #7/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #8/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #8/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #9/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #9/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #10/10: Render default w/ SSR ────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #10/10: Render variant w/ SSR ───
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #1/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #1/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #2/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #2/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #3/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #3/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #4/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #4/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #5/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #5/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #6/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #6/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #7/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #7/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #8/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #8/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #9/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #9/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #10/10: Render default w/ SSR ─
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #10/10: Render variant w/ SSR ─
[hydrogen] › accordion.spec.ts:5:3 › Ac
|
build (widgets)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
|
build (webcomponents)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
|
Gen 2 SDK Snippets (react-native)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Gen 2 SDKs (react-native)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Gen 2 SDKs (hydrogen)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "hydrogen-playwright-report", "react-native-playwright-report", "react-native-snippet-playwright-report".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
hydrogen-playwright-report
|
3.11 MB |
|
react-native-playwright-report
|
8.32 MB |
|
react-native-snippet-playwright-report
|
2.03 MB |
|