chore: Add integration tests runner #22717
Triggered via pull request
May 21, 2024 17:31
keithwillcode
synchronize
#15148
Status
Failure
Total duration
17m 50s
Artifacts
15
pr.yml
on: pull_request_target
Detect changes
19s
Linters
/
lint
2m 45s
Production builds
/
Build API v1
1m 44s
Production builds
/
Build API v2
8m 0s
Matrix: E2E App Store tests / e2e-app-store
Matrix: E2E React embeds tests / e2e-embed
Matrix: E2E embeds tests / e2e-embed
Matrix: E2E tests / e2e
Analyze Build
/
analyze
1m 26s
required
0s
Annotations
21 errors, 4 warnings, and 12 notices
Analyze Build / analyze
Server Error
|
[@calcom/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType:
apps/web/playwright/teams.e2e.ts#L156
1) [@***com/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType
Error: expect(received).toBe(expected) // Object.is equality
Expected: true
Received: false
154 | return BookingTitle === bookingTitle;
155 | })
> 156 | ).toBe(true);
| ^
157 |
158 | // Since all the users have the same leastRecentlyBooked value
159 | // Anyone of the teammates could be the Host of the booking.
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/teams.e2e.ts:156:7
|
[@calcom/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType:
apps/web/playwright/teams.e2e.ts#L156
1) [@***com/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBe(expected) // Object.is equality
Expected: true
Received: false
154 | return BookingTitle === bookingTitle;
155 | })
> 156 | ).toBe(true);
| ^
157 |
158 | // Since all the users have the same leastRecentlyBooked value
159 | // Anyone of the teammates could be the Host of the booking.
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/teams.e2e.ts:156:7
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L15
1) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload
Error: Expected to provide an iframe, got null
13 | await page.click("#add-inline-embed-in-a-new-namespace-without-reload-button");
14 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/pro" });
> 15 | expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, {
| ^
16 | pathname: "/pro",
17 | searchParams: {
18 | case: "addInlineEmbedInANewNamespaceWithoutReload",
at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:15:27
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
1) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload
Test timeout of 60000ms exceeded while tearing down "context".
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L28
2) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace
Error: Expected to provide an iframe, got null
26 | await page.click("#double-install-snippet-with-inline-embed-non-default-namespace-button");
27 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/pro" });
> 28 | expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, {
| ^
29 | pathname: "/pro",
30 | searchParams: {
31 | case: "doubleInstallSnippetWithInlineEmbedWithNonDefaultNamespace",
at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:28:27
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
2) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace
Test timeout of 60000ms exceeded.
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
2) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace
Pending operations:
- locator.count at packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:34:43
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace):
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L45
3) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace)
Error: Expected to provide an iframe, got null
43 | await page.click("#double-install-snippet-with-inline-embed-default-namespace-button");
44 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/pro" });
> 45 | expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, {
| ^
46 | pathname: "/pro",
47 | searchParams: {
48 | case: "doubleInstallSnippetWithInlineEmbed",
at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:45:27
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace):
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
3) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace)
Test timeout of 60000ms exceeded.
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace):
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
3) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace)
Pending operations:
- locator.count at packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:51:43
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
4) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs
Test timeout of 60000ms exceeded.
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs:
packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L62
4) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs
locator.getAttribute: Target closed
=========================== logs ===========================
waiting for locator('iframe').first()
============================================================
60 | await page.goto("/");
61 | await page.click("#two-different-namespace-with-different-init-config");
> 62 | const namespace1IframeSrc = await page.locator("iframe").nth(0).getAttribute("src");
| ^
63 | const namespace2IframeSrc = await page.locator("iframe").nth(1).getAttribute("src");
64 | expect(namespace1IframeSrc).toContain("http://***:3000/pro");
65 | expect(namespace2IframeSrc).toContain("http://127.0.0.1:3000/pro");
at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:62:69
|
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:57:7 › Popup Tests › should open embed iframe on click - Configured with light theme:
packages/embeds/embed-core/playwright/tests/action-based.e2e.ts#L66
1) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:57:7 › Popup Tests › should open embed iframe on click - Configured with light theme
Error: Expected to provide an iframe, got null
64 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/free" });
65 |
> 66 | await expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, {
| ^
67 | pathname: "/free",
68 | });
69 | // expect(await page.screenshot()).toMatchSnapshot("event-types-list.png");
at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:66:31
|
[@calcom/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified:
apps/web/playwright/profile.e2e.ts#L393
1) [@***com/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified
Error: expect(received).toEqual(expected) // deep equality
Expected: true
Received: false
391 | }
392 |
> 393 | expect(await page.getByTestId("profile-form-email-1-unverified-badge").isVisible()).toEqual(true);
| ^
394 | await page.getByTestId("secondary-email-action-group-button").nth(1).click();
395 | expect(await page.locator("button[data-testid=resend-verify-email-button]").isDisabled()).toEqual(false);
396 | await page.getByTestId("resend-verify-email-button").click();
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/profile.e2e.ts:393:89
|
[@calcom/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified:
apps/web/playwright/profile.e2e.ts#L393
1) [@***com/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toEqual(expected) // deep equality
Expected: true
Received: false
391 | }
392 |
> 393 | expect(await page.getByTestId("profile-form-email-1-unverified-badge").isVisible()).toEqual(true);
| ^
394 | await page.getByTestId("secondary-email-action-group-button").nth(1).click();
395 | expect(await page.locator("button[data-testid=resend-verify-email-button]").isDisabled()).toEqual(false);
396 | await page.getByTestId("resend-verify-email-button").click();
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/profile.e2e.ts:393:89
|
[@calcom/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected:
apps/web/playwright/booking-pages.e2e.ts#L1
1) [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected
Test timeout of 60000ms exceeded.
|
[@calcom/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected:
apps/web/playwright/booking-pages.e2e.ts#L280
1) [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected
page.waitForSelector: Target closed
=========================== logs ===========================
waiting for locator('[data-testid="event-type-link"]') to be visible
============================================================
278 | await pageTwo.waitForURL(initialUrl);
279 |
> 280 | await pageTwo.waitForSelector('[data-testid="event-type-link"]');
| ^
281 | const eventTypeLink = pageTwo.locator('[data-testid="event-type-link"]').first();
282 | await eventTypeLink.click();
283 |
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/booking-pages.e2e.ts:280:19
|
[@calcom/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected:
apps/web/playwright/booking-pages.e2e.ts#L1
1) [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected
Pending operations:
- page.waitForSelector at apps/web/playwright/booking-pages.e2e.ts:280:19
|
[@calcom/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org:
apps/web/playwright/organization/organization-invitation.e2e.ts#L1
1) [@***com/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org
Test timeout of 60000ms exceeded.
|
[@calcom/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org:
apps/web/playwright/lib/testUtils.ts#L213
1) [@***com/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org
page.waitForResponse: Page closed
=========================== logs ===========================
waiting for response "**/api/trpc/teams/createInvite?batch=1"
============================================================
at apps/web/playwright/lib/testUtils.ts:213
211 |
212 | export async function getInviteLink(page: Page) {
> 213 | const response = await page.waitForResponse("**/api/trpc/teams/createInvite?batch=1");
| ^
214 | const json = await response.json();
215 | return json[0].result.data.json.inviteLink as string;
216 | }
at getInviteLink (/home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/lib/testUtils.ts:213:31)
at copyInviteLink (/home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/organization/organization-invitation.e2e.ts:557:41)
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/organization/organization-invitation.e2e.ts:252:28
at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/organization/organization-invitation.e2e.ts:251:7
|
🎭 Playwright Run Summary
5 skipped
8 passed (22.9s)
|
🎭 Playwright Run Summary
2 skipped
30 passed (46.0s)
|
🎭 Playwright Run Summary
2 passed (16.4s)
|
🎭 Playwright Run Summary
3 passed (4.4s)
|
🎭 Playwright Run Summary
1 flaky
[@***com/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType
12 skipped
42 passed (56.6s)
|
🎭 Playwright Run Summary
1 skipped
25 passed (1.1m)
|
🎭 Playwright Run Summary
4 flaky
[@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload
[@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace
[@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace)
[@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs
2 passed (1.0m)
|
🎭 Playwright Run Summary
1 flaky
[@***com/embed-core] › packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:57:7 › Popup Tests › should open embed iframe on click - Configured with light theme
3 skipped
14 passed (1.0m)
|
🎭 Playwright Run Summary
1 flaky
[@***com/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified
3 skipped
33 passed (1.2m)
|
🎭 Playwright Run Summary
1 flaky
[@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected
3 skipped
68 passed (1.9m)
|
🎭 Playwright Run Summary
1 flaky
[@***com/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org
5 skipped
22 passed (1.5m)
|
🎭 Playwright Run Summary
2 skipped
63 passed (3.3m)
|
Production builds / Build API v1
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: buildjet/cache@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Linters / lint
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: ataylorme/eslint-annotate-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Production builds / Build API v2
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: buildjet/cache@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Analyze Build / analyze
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: dawidd6/action-download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
app-store-results-1_2
|
191 KB |
|
app-store-results-2_2
|
177 KB |
|
bundle
|
2.31 KB |
|
embed-core-results-1_2
|
880 KB |
|
embed-core-results-2_2
|
1.91 MB |
|
embed-react-results-1_2
|
176 KB |
|
embed-react-results-2_2
|
173 KB |
|
lint-results
|
293 KB |
|
test-results-1_7
|
197 KB |
|
test-results-2_7
|
2.61 MB |
|
test-results-3_7
|
233 KB |
|
test-results-4_7
|
215 KB |
|
test-results-5_7
|
7.71 MB |
|
test-results-6_7
|
4.99 MB |
|
test-results-7_7
|
4.73 MB |
|