-
Notifications
You must be signed in to change notification settings - Fork 6.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: Add integration tests runner #15148
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 3 Ignored Deployments
|
Thank you for following the naming conventions! 🙏 Feel free to join our discord and post your PR link. |
Current Playwright Test Results Summary✅ 321 Passing - Run may still be in progress, this comment will be updated as current testing workflow or job completes... (Last updated on 05/21/2024 05:48:22pm UTC) Run DetailsRunning Workflow PR Update on Github Actions Commit: baac2d2 Started: 05/21/2024 05:44:35pm UTC
|
Test Case | Last 7 days Failures | Last 7 days Flakes |
---|---|---|
Organization Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done nonexisting user is invited to Org
Retry 1 • Initial Attempt |
0.82% (2)2 / 243 runsfailed over last 7 days |
0.41% (1)1 / 243 runflaked over last 7 days |
📄 apps/web/playwright/booking-pages.e2e.ts • 1 Flake
Test Case Results
Test Case | Last 7 days Failures | Last 7 days Flakes |
---|---|---|
pro user -- legacy Time slots should be reserved when selected
Retry 1 • Initial Attempt |
0% (0)0 / 231 runsfailed over last 7 days |
8.66% (20)20 / 231 runsflaked over last 7 days |
📄 packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 9 Flakes
Top 1 Common Error Messages
|
9 Test Cases Affected |
Test Case Results
Test Case | Last 7 days Failures | Last 7 days Flakes |
---|---|---|
Popup Tests should open embed iframe on click - Configured with light theme
Retry 1 • Initial Attempt |
2.49% (6)6 / 241 runsfailed over last 7 days |
60.17% (145)145 / 241 runsflaked over last 7 days |
Popup Tests should be able to reschedule
Retry 1 • Initial Attempt |
-161.11% (-145)-145 / 90 runsfailed over last 7 days |
161.11% (145)145 / 90 runsflaked over last 7 days |
Popup Tests should open Routing Forms embed on click
Retry 1 • Initial Attempt |
-161.11% (-145)-145 / 90 runsfailed over last 7 days |
161.11% (145)145 / 90 runsflaked over last 7 days |
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when no theme is configured through Embed API
Retry 1 • Initial Attempt |
-157.78% (-142)-142 / 90 runsfailed over last 7 days |
158.89% (143)143 / 90 runsflaked over last 7 days |
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe(Booker Profile Page) with dark theme when configured with dark theme using Embed API
Retry 1 • Initial Attempt |
-159.55% (-142)-142 / 89 runsfailed over last 7 days |
159.55% (142)142 / 89 runsflaked over last 7 days |
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when configured with 'auto' theme using Embed API
Retry 1 • Initial Attempt |
-159.55% (-142)-142 / 89 runsfailed over last 7 days |
159.55% (142)142 / 89 runsflaked over last 7 days |
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe(Event Booking Page) with dark theme when configured with dark theme using Embed API
Retry 1 • Initial Attempt |
-159.55% (-142)-142 / 89 runsfailed over last 7 days |
159.55% (142)142 / 89 runsflaked over last 7 days |
Popup Tests prendered embed should be loaded and apply the config given to it
Retry 1 • Initial Attempt |
-159.55% (-142)-142 / 89 runsfailed over last 7 days |
159.55% (142)142 / 89 runsflaked over last 7 days |
Popup Tests should open on clicking child element
Retry 1 • Initial Attempt |
-157.30% (-140)-140 / 89 runsfailed over last 7 days |
157.30% (140)140 / 89 runsflaked over last 7 days |
📄 packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts • 4 Flakes
Top 1 Common Error Messages
|
4 Test Cases Affected |
Test Case Results
Test Case | Last 7 days Failures | Last 7 days Flakes |
---|---|---|
Namespacing Different namespaces can have different init configs
Retry 1 • Initial Attempt |
0% (0)0 / 239 runsfailed over last 7 days |
61.09% (146)146 / 239 runsflaked over last 7 days |
Namespacing Inline Embed Add inline embed using a namespace without reload
Retry 1 • Initial Attempt |
0% (0)0 / 240 runsfailed over last 7 days |
63.33% (152)152 / 240 runsflaked over last 7 days |
Namespacing Inline Embed Double install Embed Snippet with inline embed without a namespace(i.e. default namespace)
Retry 1 • Initial Attempt |
0% (0)0 / 240 runsfailed over last 7 days |
64.17% (154)154 / 240 runsflaked over last 7 days |
Namespacing Inline Embed Double install Embed Snippet with inline embed using a namespace
Retry 1 • Initial Attempt |
0.42% (1)1 / 240 runfailed over last 7 days |
61.25% (147)147 / 240 runsflaked over last 7 days |
📄 apps/web/playwright/profile.e2e.ts • 1 Flake
Test Case Results
Test Case | Last 7 days Failures | Last 7 days Flakes |
---|---|---|
Update Profile Can resend verification link if the secondary email is unverified
Retry 2 • Retry 1 • Initial Attempt |
11.70% (33)33 / 282 runsfailed over last 7 days |
32.62% (92)92 / 282 runsflaked over last 7 days |
📄 apps/web/playwright/teams.e2e.ts • 1 Flake
Test Case Results
Test Case | Last 7 days Failures | Last 7 days Flakes |
---|---|---|
Teams - NonOrg -- legacy Can create a booking for Round Robin EventType
Retry 2 • Retry 1 • Initial Attempt |
7.91% (20)20 / 253 runsfailed over last 7 days |
30.43% (77)77 / 253 runsflaked over last 7 days |
e2e: | ||
name: E2E tests | ||
name: Tests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Waiting on checks to auto merge.
📦 Next.js Bundle Analysis for @calcom/webThis analysis was generated by the Next.js Bundle Analysis action. 🤖 This PR introduced no changes to the JavaScript bundle! 🙌 |
What does this PR do?
Adds an integration test runner. We have new integration tests coming in #14860.
Mandatory Tasks (DO NOT REMOVE)
How should this be tested?