SDKs: add Hydrogen & Remix tests #10829
samijaberci.yml
on: pull_request
Matrix: build
Matrix: Gen 1 React SDK
Matrix: Gen 2 SDK Snippets
Matrix: Gen 2 SDKs
Annotations
14 errors, 5 warnings, and 32 notices
|
Gen 2 SDKs checks
Process completed with exit code 1.
|
|
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time:
packages/sdks-tests/src/e2e-tests/accordion.spec.ts#L1
1) [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time
Test timeout of 30000ms exceeded.
|
|
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time:
packages/sdks-tests/src/e2e-tests/accordion.spec.ts#L67
1) [react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time
Error: page.goto: net::ERR_ABORTED; maybe frame was detached?
Call log:
- navigating to "http://localhost:19006/accordion-one-at-a-time", waiting until "load"
65 | )
66 | );
> 67 | await page.goto('/accordion-one-at-a-time');
| ^
68 |
69 | for (let i = 1; i <= 3; i++) {
70 | await page.locator(`text=Item ${i}`).click({ timeout: 10000 });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/accordion.spec.ts:67:16
|
|
Gen 2 SDKs (react-native)
Process completed with exit code 1.
|
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
1) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
2) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
3) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
4) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
5) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
6) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
7) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
8) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR ───
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
|
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L107
9) [hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR ────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is the default variation!').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is the default variation!').locator('visible=true')
105 | await page.goto('/ab-test');
106 |
> 107 | await expect(page.getByText(TEXTS.DEFAULT_CONTENT).locator('visible=true')).toBeVisible();
| ^
108 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_1 })).toBeHidden();
109 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
110 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:107:85
|
|
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR:
packages/sdks-tests/src/e2e-tests/ab-test.spec.ts#L133
10) [hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR ──
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('This is variation 1').locator('visible=true')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('This is variation 1').locator('visible=true')
131 | await page.goto('/ab-test');
132 |
> 133 | await expect(page.getByText(TEXTS.VARIANT_1).locator('visible=true')).toBeVisible();
| ^
134 | await expect(page.locator(SELECTOR, { hasText: TEXTS.DEFAULT_CONTENT })).toBeHidden();
135 | await expect(page.locator(SELECTOR, { hasText: TEXTS.VARIANT_2 })).toBeHidden();
136 | });
at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/ab-test.spec.ts:133:79
|
|
build (widgets)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
|
|
build (webcomponents)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
|
|
Gen 2 SDKs (react-native)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
|
Gen 2 SDKs (hydrogen)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "hydrogen-playwright-report", "react-native-playwright-report".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
|
🎭 Playwright Run Summary
3 passed (15.4s)
|
|
🎭 Playwright Run Summary
3 passed (7.9s)
|
|
🎭 Playwright Run Summary
3 passed (7.4s)
|
|
🎭 Playwright Run Summary
3 passed (8.5s)
|
|
🎭 Playwright Run Summary
3 passed (7.2s)
|
|
🎭 Playwright Run Summary
3 passed (8.2s)
|
|
🎭 Playwright Run Summary
3 passed (12.3s)
|
|
🎭 Playwright Run Summary
79 skipped
69 passed (56.1s)
|
|
🎭 Playwright Run Summary
34 skipped
114 passed (2.3m)
|
|
🎭 Playwright Run Summary
3 passed (6.8s)
|
|
🎭 Playwright Run Summary
8 skipped
140 passed (2.1m)
|
|
🎭 Playwright Run Summary
14 skipped
134 passed (2.4m)
|
|
🎭 Playwright Run Summary
12 skipped
136 passed (2.3m)
|
|
🎭 Playwright Run Summary
15 skipped
133 passed (2.2m)
|
|
🎭 Playwright Run Summary
3 passed (7.0s)
|
|
🎭 Playwright Run Summary
7 skipped
141 passed (2.5m)
|
|
🎭 Playwright Run Summary
7 skipped
141 passed (2.5m)
|
|
🎭 Playwright Run Summary
7 skipped
141 passed (2.4m)
|
|
🎭 Playwright Run Summary
14 skipped
134 passed (2.7m)
|
|
🎭 Playwright Run Summary
14 skipped
134 passed (2.5m)
|
|
🎭 Playwright Run Summary
8 skipped
140 passed (2.6m)
|
|
🎭 Playwright Run Summary
3 passed (19.7s)
|
|
🎭 Playwright Run Summary
3 passed (6.6s)
|
|
🎭 Playwright Run Summary
3 passed (7.1s)
|
|
🎭 Playwright Run Summary
3 passed (6.9s)
|
|
🎭 Playwright Run Summary
1 failed
[react-native] › accordion.spec.ts:57:3 › Accordion › oneAtATime - Only one item opens at a time
79 skipped
68 passed (2.8m)
|
|
🎭 Playwright Run Summary
14 skipped
134 passed (3.9m)
|
|
🎭 Playwright Run Summary
7 skipped
141 passed (4.9m)
|
|
🎭 Playwright Run Summary
15 skipped
133 passed (5.2m)
|
|
🎭 Playwright Run Summary
10 skipped
138 passed (8.7m)
|
|
🎭 Playwright Run Summary
9 skipped
139 passed (9.2m)
|
|
🎭 Playwright Run Summary
125 failed
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #1/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #1/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #2/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #2/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #3/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #3/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #4/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #4/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #5/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #5/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #6/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #6/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #7/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #7/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #8/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #8/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #9/10: Render default w/ SSR ─────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #9/10: Render variant w/ SSR ────
[hydrogen] › ab-test.spec.ts:86:7 › A/B tests › entire page › #10/10: Render default w/ SSR ────
[hydrogen] › ab-test.spec.ts:112:7 › A/B tests › entire page › #10/10: Render variant w/ SSR ───
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #1/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #1/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #2/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #2/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #3/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #3/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #4/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #4/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #5/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #5/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #6/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #6/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #7/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #7/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #8/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #8/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #9/10: Render default w/ SSR ──
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #9/10: Render variant w/ SSR ──
[hydrogen] › ab-test.spec.ts:155:7 › A/B tests › nested symbol › #10/10: Render default w/ SSR ─
[hydrogen] › ab-test.spec.ts:189:7 › A/B tests › nested symbol › #10/10: Render variant w/ SSR ─
[hydrogen] › accordion.spec.ts:5:3 › Ac
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
hydrogen-playwright-report
Expired
|
3.33 MB |
|
|
react-native-playwright-report
Expired
|
11.5 MB |
|