Skip to content

chore: Add integration tests runner #22717

chore: Add integration tests runner

chore: Add integration tests runner #22717

Triggered via pull request May 21, 2024 17:31
@keithwillcodekeithwillcode
synchronize #15148
Status Failure
Total duration 17m 50s
Artifacts 15

pr.yml

on: pull_request_target
Detect changes
19s
Detect changes
Analyze Build  /  ...  /  Web App
Analyze Build / Production builds / Web App
Matrix: E2E App Store tests / e2e-app-store
Matrix: E2E React embeds tests / e2e-embed
Matrix: E2E embeds tests / e2e-embed
Matrix: E2E tests / e2e
Fit to window
Zoom out
Zoom in

Annotations

21 errors, 4 warnings, and 12 notices
Analyze Build / analyze
Server Error
[@calcom/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType: apps/web/playwright/teams.e2e.ts#L156
1) [@***com/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType Error: expect(received).toBe(expected) // Object.is equality Expected: true Received: false 154 | return BookingTitle === bookingTitle; 155 | }) > 156 | ).toBe(true); | ^ 157 | 158 | // Since all the users have the same leastRecentlyBooked value 159 | // Anyone of the teammates could be the Host of the booking. at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/teams.e2e.ts:156:7
[@calcom/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType: apps/web/playwright/teams.e2e.ts#L156
1) [@***com/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBe(expected) // Object.is equality Expected: true Received: false 154 | return BookingTitle === bookingTitle; 155 | }) > 156 | ).toBe(true); | ^ 157 | 158 | // Since all the users have the same leastRecentlyBooked value 159 | // Anyone of the teammates could be the Host of the booking. at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/teams.e2e.ts:156:7
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L15
1) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload Error: Expected to provide an iframe, got null 13 | await page.click("#add-inline-embed-in-a-new-namespace-without-reload-button"); 14 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/pro" }); > 15 | expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, { | ^ 16 | pathname: "/pro", 17 | searchParams: { 18 | case: "addInlineEmbedInANewNamespaceWithoutReload", at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:15:27
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
1) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload Test timeout of 60000ms exceeded while tearing down "context".
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L28
2) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace Error: Expected to provide an iframe, got null 26 | await page.click("#double-install-snippet-with-inline-embed-non-default-namespace-button"); 27 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/pro" }); > 28 | expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, { | ^ 29 | pathname: "/pro", 30 | searchParams: { 31 | case: "doubleInstallSnippetWithInlineEmbedWithNonDefaultNamespace", at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:28:27
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
2) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace Test timeout of 60000ms exceeded.
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
2) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace Pending operations: - locator.count at packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:34:43
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace): packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L45
3) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace) Error: Expected to provide an iframe, got null 43 | await page.click("#double-install-snippet-with-inline-embed-default-namespace-button"); 44 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/pro" }); > 45 | expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, { | ^ 46 | pathname: "/pro", 47 | searchParams: { 48 | case: "doubleInstallSnippetWithInlineEmbed", at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:45:27
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace): packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
3) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace) Test timeout of 60000ms exceeded.
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace): packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
3) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace) Pending operations: - locator.count at packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:51:43
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L1
4) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs Test timeout of 60000ms exceeded.
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs: packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts#L62
4) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs locator.getAttribute: Target closed =========================== logs =========================== waiting for locator('iframe').first() ============================================================ 60 | await page.goto("/"); 61 | await page.click("#two-different-namespace-with-different-init-config"); > 62 | const namespace1IframeSrc = await page.locator("iframe").nth(0).getAttribute("src"); | ^ 63 | const namespace2IframeSrc = await page.locator("iframe").nth(1).getAttribute("src"); 64 | expect(namespace1IframeSrc).toContain("http://***:3000/pro"); 65 | expect(namespace2IframeSrc).toContain("http://127.0.0.1:3000/pro"); at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:62:69
[@calcom/embed-core] › packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:57:7 › Popup Tests › should open embed iframe on click - Configured with light theme: packages/embeds/embed-core/playwright/tests/action-based.e2e.ts#L66
1) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:57:7 › Popup Tests › should open embed iframe on click - Configured with light theme Error: Expected to provide an iframe, got null 64 | const embedIframe = await getEmbedIframe({ ***Namespace, page, pathname: "/free" }); 65 | > 66 | await expect(embedIframe).toBeEmbedCalLink(***Namespace, embeds.getActionFiredDetails, { | ^ 67 | pathname: "/free", 68 | }); 69 | // expect(await page.screenshot()).toMatchSnapshot("event-types-list.png"); at /home/runner/actions-runner/_work/***.com/***.com/packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:66:31
[@calcom/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified: apps/web/playwright/profile.e2e.ts#L393
1) [@***com/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified Error: expect(received).toEqual(expected) // deep equality Expected: true Received: false 391 | } 392 | > 393 | expect(await page.getByTestId("profile-form-email-1-unverified-badge").isVisible()).toEqual(true); | ^ 394 | await page.getByTestId("secondary-email-action-group-button").nth(1).click(); 395 | expect(await page.locator("button[data-testid=resend-verify-email-button]").isDisabled()).toEqual(false); 396 | await page.getByTestId("resend-verify-email-button").click(); at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/profile.e2e.ts:393:89
[@calcom/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified: apps/web/playwright/profile.e2e.ts#L393
1) [@***com/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: true Received: false 391 | } 392 | > 393 | expect(await page.getByTestId("profile-form-email-1-unverified-badge").isVisible()).toEqual(true); | ^ 394 | await page.getByTestId("secondary-email-action-group-button").nth(1).click(); 395 | expect(await page.locator("button[data-testid=resend-verify-email-button]").isDisabled()).toEqual(false); 396 | await page.getByTestId("resend-verify-email-button").click(); at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/profile.e2e.ts:393:89
[@calcom/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected: apps/web/playwright/booking-pages.e2e.ts#L1
1) [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected Test timeout of 60000ms exceeded.
[@calcom/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected: apps/web/playwright/booking-pages.e2e.ts#L280
1) [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected page.waitForSelector: Target closed =========================== logs =========================== waiting for locator('[data-testid="event-type-link"]') to be visible ============================================================ 278 | await pageTwo.waitForURL(initialUrl); 279 | > 280 | await pageTwo.waitForSelector('[data-testid="event-type-link"]'); | ^ 281 | const eventTypeLink = pageTwo.locator('[data-testid="event-type-link"]').first(); 282 | await eventTypeLink.click(); 283 | at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/booking-pages.e2e.ts:280:19
[@calcom/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected: apps/web/playwright/booking-pages.e2e.ts#L1
1) [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected Pending operations: - page.waitForSelector at apps/web/playwright/booking-pages.e2e.ts:280:19
[@calcom/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org: apps/web/playwright/organization/organization-invitation.e2e.ts#L1
1) [@***com/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org Test timeout of 60000ms exceeded.
[@calcom/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org: apps/web/playwright/lib/testUtils.ts#L213
1) [@***com/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org page.waitForResponse: Page closed =========================== logs =========================== waiting for response "**/api/trpc/teams/createInvite?batch=1" ============================================================ at apps/web/playwright/lib/testUtils.ts:213 211 | 212 | export async function getInviteLink(page: Page) { > 213 | const response = await page.waitForResponse("**/api/trpc/teams/createInvite?batch=1"); | ^ 214 | const json = await response.json(); 215 | return json[0].result.data.json.inviteLink as string; 216 | } at getInviteLink (/home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/lib/testUtils.ts:213:31) at copyInviteLink (/home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/organization/organization-invitation.e2e.ts:557:41) at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/organization/organization-invitation.e2e.ts:252:28 at /home/runner/actions-runner/_work/***.com/***.com/apps/web/playwright/organization/organization-invitation.e2e.ts:251:7
🎭 Playwright Run Summary
5 skipped 8 passed (22.9s)
🎭 Playwright Run Summary
2 skipped 30 passed (46.0s)
🎭 Playwright Run Summary
2 passed (16.4s)
🎭 Playwright Run Summary
3 passed (4.4s)
🎭 Playwright Run Summary
1 flaky [@***com/web] › apps/web/playwright/teams.e2e.ts:122:7 › Teams - NonOrg -- legacy › Can create a booking for Round Robin EventType 12 skipped 42 passed (56.6s)
🎭 Playwright Run Summary
1 skipped 25 passed (1.1m)
🎭 Playwright Run Summary
4 flaky [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:10:9 › Namespacing › Inline Embed › Add inline embed using a namespace without reload [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:23:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed using a namespace [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:37:9 › Namespacing › Inline Embed › Double install Embed Snippet with inline embed without a namespace(i.e. default namespace) [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts:54:7 › Namespacing › Different namespaces can have different init configs 2 passed (1.0m)
🎭 Playwright Run Summary
1 flaky [@***com/embed-core] › packages/embeds/embed-core/playwright/tests/action-based.e2e.ts:57:7 › Popup Tests › should open embed iframe on click - Configured with light theme 3 skipped 14 passed (1.0m)
🎭 Playwright Run Summary
1 flaky [@***com/web] › apps/web/playwright/profile.e2e.ts:375:7 › Update Profile › Can resend verification link if the secondary email is unverified 3 skipped 33 passed (1.2m)
🎭 Playwright Run Summary
1 flaky [@***com/web] › apps/web/playwright/booking-pages.e2e.ts:271:7 › pro user -- legacy › Time slots should be reserved when selected 3 skipped 68 passed (1.9m)
🎭 Playwright Run Summary
1 flaky [@***com/web] › apps/web/playwright/organization/organization-invitation.e2e.ts:199:9 › Organization › Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done › nonexisting user is invited to Org 5 skipped 22 passed (1.5m)
🎭 Playwright Run Summary
2 skipped 63 passed (3.3m)
Production builds / Build API v1
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: buildjet/cache@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Linters / lint
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: ataylorme/eslint-annotate-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Production builds / Build API v2
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: buildjet/cache@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Analyze Build / analyze
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: dawidd6/action-download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Artifacts

Produced during runtime
Name Size
app-store-results-1_2
191 KB
app-store-results-2_2
177 KB
bundle
2.31 KB
embed-core-results-1_2
880 KB
embed-core-results-2_2
1.91 MB
embed-react-results-1_2
176 KB
embed-react-results-2_2
173 KB
lint-results
293 KB
test-results-1_7
197 KB
test-results-2_7
2.61 MB
test-results-3_7
233 KB
test-results-4_7
215 KB
test-results-5_7
7.71 MB
test-results-6_7
4.99 MB
test-results-7_7
4.73 MB