Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: make email dependent test adjustments #15054

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

emrysal
Copy link
Contributor

@emrysal emrysal commented May 15, 2024

No description provided.

Copy link
Contributor

github-actions bot commented May 15, 2024

Thank you for following the naming conventions! 🙏 Feel free to join our discord and post your PR link.

Copy link

vercel bot commented May 15, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

3 Ignored Deployments
Name Status Preview Comments Updated (UTC)
ai ⬜️ Ignored (Inspect) Visit Preview May 15, 2024 3:34pm
cal ⬜️ Ignored (Inspect) Visit Preview May 15, 2024 3:34pm
calcom-web-canary ⬜️ Ignored (Inspect) Visit Preview May 15, 2024 3:34pm

Copy link
Contributor

📦 Next.js Bundle Analysis for @calcom/web

This analysis was generated by the Next.js Bundle Analysis action. 🤖

This PR introduced no changes to the JavaScript bundle! 🙌

Copy link

deploysentinel bot commented May 15, 2024

Current Playwright Test Results Summary

✅ 306 Passing - ❌ 5 Failing - ⚠️ 17 Flaky

Run may still be in progress, this comment will be updated as current testing workflow or job completes...

(Last updated on 05/15/2024 03:48:59pm UTC)

Run Details

Running Workflow PR Update on Github Actions

Commit: 1183b03

Started: 05/15/2024 03:45:28pm UTC

❌ Failures

📄   apps/web/playwright/team/team-invitation.e2e.ts • 2 Failures

Top 1 Common Error Messages

expect(received).toBe(expected) // Object.is equality

2 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Team Invitation (non verified)
Retry 2Retry 1Initial Attempt
Error: expect(received).toBe(expected) // Object.is equality...
expect(received).toBe(expected) // Object.is equality

Expected: 1
Received: undefined
5.77% (15) 15 / 260 runs
failed over last 7 days
5.77% (15) 15 / 260 runs
flaked over last 7 days
Team Invitation (verified)
Retry 2Retry 1Initial Attempt
Error: expect(received).toBe(expected) // Object.is equality...
expect(received).toBe(expected) // Object.is equality

Expected: 1
Received: undefined
3.46% (9) 9 / 260 runs
failed over last 7 days
6.54% (17) 17 / 260 runs
flaked over last 7 days

📄   packages/app-store/routing-forms/playwright/tests/basic.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Routing Forms Seeded Routing Form Test preview should return correct route
Retry 2Retry 1Initial Attempt
Error: Test timeout of 60000ms exceeded.
Test timeout of 60000ms exceeded.
0.81% (2) 2 / 247 runs
failed over last 7 days
34.82% (86) 86 / 247 runs
flaked over last 7 days

📄   apps/web/playwright/profile.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Update Profile Can add a new email as a secondary email
Retry 2Retry 1Initial Attempt
Error: expect(received).toBe(expected) // Object.is equality...
expect(received).toBe(expected) // Object.is equality

Expected: 1
Received: undefined
0.71% (2) 2 / 282 runs
failed over last 7 days
0.35% (1) 1 / 282 run
flaked over last 7 days

📄   apps/web/playwright/organization/organization-invitation.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Organization Email matching orgAutoAcceptEmail and a Verified Organization with DNS Setup Done nonexisting user is invited to Org
Retry 1Initial Attempt
Error: expect(received).toBe(expected) // Object.is equality...
expect(received).toBe(expected) // Object.is equality

Expected: 1
Received: undefined
1.18% (3) 3 / 254 runs
failed over last 7 days
1.57% (4) 4 / 254 runs
flaked over last 7 days

⚠️ Flakes

📄   apps/web/playwright/integrations-stripe.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Stripe integration Paid booking should be able to be rescheduled
Retry 1Initial Attempt
2.99% (7) 7 / 234 runs
failed over last 7 days
13.68% (32) 32 / 234 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 9 Flakes

Top 1 Common Error Messages

null

9 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Popup Tests should open embed iframe on click - Configured with light theme
Retry 1Initial Attempt
-1.20% (-3) -3 / 249 runs
failed over last 7 days
60.64% (151) 151 / 249 runs
flaked over last 7 days
Popup Tests should be able to reschedule
Retry 1Initial Attempt
-149.50% (-151) -151 / 101 runs
failed over last 7 days
149.50% (151) 151 / 101 runs
flaked over last 7 days
Popup Tests should open Routing Forms embed on click
Retry 1Initial Attempt
-147.52% (-149) -149 / 101 runs
failed over last 7 days
147.52% (149) 149 / 101 runs
flaked over last 7 days
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when no theme is configured through Embed API
Retry 1Initial Attempt
-141.58% (-143) -143 / 101 runs
failed over last 7 days
143.56% (145) 145 / 101 runs
flaked over last 7 days
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when configured with 'auto' theme using Embed API
Retry 1Initial Attempt
-146.46% (-145) -145 / 99 runs
failed over last 7 days
146.46% (145) 145 / 99 runs
flaked over last 7 days
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe(Booker Profile Page) with dark theme when configured with dark theme using Embed API
Retry 1Initial Attempt
-146.46% (-145) -145 / 99 runs
failed over last 7 days
146.46% (145) 145 / 99 runs
flaked over last 7 days
Popup Tests prendered embed should be loaded and apply the config given to it
Retry 1Initial Attempt
-146.46% (-145) -145 / 99 runs
failed over last 7 days
146.46% (145) 145 / 99 runs
flaked over last 7 days
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe(Event Booking Page) with dark theme when configured with dark theme using Embed API
Retry 1Initial Attempt
-146.46% (-145) -145 / 99 runs
failed over last 7 days
146.46% (145) 145 / 99 runs
flaked over last 7 days
Popup Tests should open on clicking child element
Retry 1Initial Attempt
-144.90% (-142) -142 / 98 runs
failed over last 7 days
144.90% (142) 142 / 98 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/namespacing.e2e.ts • 4 Flakes

Top 1 Common Error Messages

null

4 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Namespacing Inline Embed Double install Embed Snippet with inline embed using a namespace
Retry 1Initial Attempt
0.40% (1) 1 / 247 run
failed over last 7 days
57.89% (143) 143 / 247 runs
flaked over last 7 days
Namespacing Different namespaces can have different init configs
Retry 1Initial Attempt
0% (0) 0 / 245 runs
failed over last 7 days
57.55% (141) 141 / 245 runs
flaked over last 7 days
Namespacing Inline Embed Double install Embed Snippet with inline embed without a namespace(i.e. default namespace)
Retry 1Initial Attempt
0% (0) 0 / 247 runs
failed over last 7 days
60.73% (150) 150 / 247 runs
flaked over last 7 days
Namespacing Inline Embed Add inline embed using a namespace without reload
Retry 1Initial Attempt
0.40% (1) 1 / 247 run
failed over last 7 days
57.49% (142) 142 / 247 runs
flaked over last 7 days

📄   apps/web/playwright/webhook.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
MEETING_ENDED, MEETING_STARTED should create/remove scheduledWebhookTriggers for existing bookings
Retry 1Initial Attempt
5% (6) 6 / 120 runs
failed over last 7 days
36.67% (44) 44 / 120 runs
flaked over last 7 days

📄   apps/web/playwright/teams.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Teams - NonOrg -- legacy Can create a booking for Round Robin EventType
Retry 1Initial Attempt
6.25% (16) 16 / 256 runs
failed over last 7 days
28.52% (73) 73 / 256 runs
flaked over last 7 days

📄   apps/web/playwright/profile.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Update Profile Can resend verification link if the secondary email is unverified
Retry 1Initial Attempt
13.83% (39) 39 / 282 runs
failed over last 7 days
32.62% (92) 92 / 282 runs
flaked over last 7 days

View Detailed Build Results


Copy link
Contributor

This PR is being marked as stale due to inactivity.

@github-actions github-actions bot added the Stale label May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core area: core, team members only foundation Stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants