Skip to content

fix: Stripe e2e regression#13062

Merged
PeerRich merged 2 commits intomainfrom
fix/stripe-e2e-regression
Jan 7, 2024
Merged

fix: Stripe e2e regression#13062
PeerRich merged 2 commits intomainfrom
fix/stripe-e2e-regression

Conversation

@exception
Copy link
Copy Markdown
Contributor

What does this PR do?

Fixes # (issue)

Requirement/Documentation

  • If there is a requirement document, please, share it here.
  • If there is ab UI/UX design document, please, share it here.

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • Chore (refactoring code, technical debt, workflow improvements)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Tests (Unit/Integration/E2E or any other test)
  • This change requires a documentation update

How should this be tested?

  • Are there environment variables that should be set?
  • What are the minimal test data to have?
  • What is expected (happy path) to have (input and output)?
  • Any other important info that could help to test that PR

Mandatory Tasks

  • Make sure you have self-reviewed the code. A decent size PR without self-review might be rejected.

Checklist

  • I haven't read the contributing guide
  • My code doesn't follow the style guidelines of this project
  • I haven't commented my code, particularly in hard-to-understand areas
  • I haven't checked if my PR needs changes to the documentation
  • I haven't checked if my changes generate no new warnings
  • I haven't added tests that prove my fix is effective or that my feature works
  • I haven't checked if new and existing unit tests pass locally with my changes

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 5, 2024

Thank you for following the naming conventions! 🙏 Feel free to join our discord and post your PR link.

@keithwillcode keithwillcode added admin cal-ai core area: core, team members only devops labels Jan 5, 2024
@vercel
Copy link
Copy Markdown

vercel Bot commented Jan 5, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
ai ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 5, 2024 8:30pm
api ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 5, 2024 8:30pm
dev ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 5, 2024 8:30pm
3 Ignored Deployments
Name Status Preview Comments Updated (UTC)
cal ⬜️ Ignored (Inspect) Visit Preview Jan 5, 2024 8:30pm
cal-demo ⬜️ Ignored (Inspect) Jan 5, 2024 8:30pm
ui ⬜️ Ignored (Inspect) Visit Preview Jan 5, 2024 8:30pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 5, 2024

📦 Next.js Bundle Analysis for @calcom/web

This analysis was generated by the Next.js Bundle Analysis action. 🤖

This PR introduced no changes to the JavaScript bundle! 🙌

@deploysentinel
Copy link
Copy Markdown

deploysentinel Bot commented Jan 5, 2024

Current Playwright Test Results Summary

✅ 347 Passing - ❌ 4 Failing - ⚠️ 13 Flaky

Run may still be in progress, this comment will be updated as current testing workflow or job completes...

(Last updated on 01/05/2024 08:24:25pm UTC)

Run Details

Running Workflow Pre-release checks on Github Actions

Commit: 5e20728

Started: 01/05/2024 08:17:52pm UTC

❌ Failures

📄   apps/web/playwright/booking-limits.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Booking limits multiple
Retry 2Retry 1Initial Attempt
Error: expect(received).toBe(expected) // Object.is equality...
expect(received).toBe(expected) // Object.is equality

Expected: true
Received: false
98.04% (50) 50 / 51 runs
failed over last 7 days
0% (0) 0 / 51 runs
flaked over last 7 days

📄   apps/web/playwright/integrations-stripe.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Stripe integration When event is paid and confirmed Cancelled paid booking should be refunded
Retry 1Initial Attempt
Error: page.waitForURL: Timeout 30000ms exceeded....
page.waitForURL: Timeout 30000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
90.20% (46) 46 / 51 runs
failed over last 7 days
0% (0) 0 / 51 runs
flaked over last 7 days

📄   packages/app-store/routing-forms/playwright/tests/basic.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Routing Forms Zero State Routing Forms F1<-F2 Relationship Create relationship by adding F1 as route.Editing F1 should update F2
Retry 2Retry 1Initial Attempt
Error: Test timeout of 60000ms exceeded.
Test timeout of 60000ms exceeded.
72.73% (40) 40 / 55 runs
failed over last 7 days
0% (0) 0 / 55 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Popup Tests should be able to reschedule
Retry 2Retry 1Initial Attempt
Error: Test timeout of 60000ms exceeded.
Test timeout of 60000ms exceeded.
7.27% (4) 4 / 55 runs
failed over last 7 days
87.27% (48) 48 / 55 runs
flaked over last 7 days

⚠️ Flakes

📄   apps/web/playwright/organization/organization-invitation.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Organization Email matching orgAutoAcceptEmail and a Verified Organization Team Invitation
Retry 2Retry 1Initial Attempt
3.57% (2) 2 / 56 runs
failed over last 7 days
26.79% (15) 15 / 56 runs
flaked over last 7 days

📄   apps/web/playwright/manage-booking-questions.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Manage Booking Questions For Team EventType Do a booking with a user added question and verify a few thing in b/w
Retry 1Initial Attempt
0% (0) 0 / 37 runs
failed over last 7 days
2.70% (1) 1 / 37 run
flaked over last 7 days

📄   apps/web/playwright/reschedule.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Reschedule Tests Attendee should be able to reschedule a booking
Retry 1Initial Attempt
0% (0) 0 / 55 runs
failed over last 7 days
3.64% (2) 2 / 55 runs
flaked over last 7 days

📄   apps/web/playwright/booking/radioGroupQuestion.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Booking With Radio Question and Each Other Question Booking With Radio Question and Address Question Booking With Radio Question and Short text question Radio required and Short text required
Retry 2Retry 1Initial Attempt
0% (0) 0 / 52 runs
failed over last 7 days
1.92% (1) 1 / 52 run
flaked over last 7 days

📄   apps/web/playwright/booking/checkboxGroupQuestion.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Booking With Checkbox Group Question and Each Other Question Booking With Checkbox Group Question and Address Question Booking With Checkbox Group Question and select Question Checkbox Group and select not required
Retry 1Initial Attempt
0% (0) 0 / 50 runs
failed over last 7 days
4% (2) 2 / 50 runs
flaked over last 7 days

📄   apps/web/playwright/booking/longTextQuestion.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Booking With Long Text Question and Each Other Question Booking With Long Text Question and Phone Question Long Text and Phone required
Retry 1Initial Attempt
0% (0) 0 / 50 runs
failed over last 7 days
4% (2) 2 / 50 runs
flaked over last 7 days

📄   apps/web/playwright/event-types.e2e.ts • 3 Flakes

Top 1 Common Error Messages

null

3 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Event Types tests user -- future can add multiple organizer address
Retry 1Initial Attempt
0% (0) 0 / 57 runs
failed over last 7 days
12.28% (7) 7 / 57 runs
flaked over last 7 days
Event Types tests user -- legacy enabling recurring event comes with default options
Retry 1Initial Attempt
0% (0) 0 / 56 runs
failed over last 7 days
12.50% (7) 7 / 56 runs
flaked over last 7 days
Event Types tests user -- legacy Different Locations Tests can select 'display on booking page' option when multiple organizer input type are present
Retry 1Initial Attempt
0% (0) 0 / 55 runs
failed over last 7 days
1.82% (1) 1 / 55 run
flaked over last 7 days

📄   apps/web/playwright/webhook.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
FORM_SUBMITTED on submitting team form, triggers team webhook
Retry 2Retry 1Initial Attempt
3.57% (2) 2 / 56 runs
failed over last 7 days
19.64% (11) 11 / 56 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 3 Flakes

Top 1 Common Error Messages

null

3 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Popup Tests should open embed iframe on click - Configured with light theme
Retry 1Initial Attempt
0% (0) 0 / 55 runs
failed over last 7 days
61.82% (34) 34 / 55 runs
flaked over last 7 days
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when no theme is configured through Embed API
Retry 1Initial Attempt
0% (0) 0 / 54 runs
failed over last 7 days
88.89% (48) 48 / 54 runs
flaked over last 7 days
Popup Tests should open Routing Forms embed on click
Retry 1Initial Attempt
0% (0) 0 / 54 runs
failed over last 7 days
50% (27) 27 / 54 runs
flaked over last 7 days

View Detailed Build Results


@PeerRich PeerRich merged commit d76060e into main Jan 7, 2024
@PeerRich PeerRich deleted the fix/stripe-e2e-regression branch January 7, 2024 05:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

admin cal-ai core area: core, team members only devops

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants