Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Create E2E tests for bookings with custom/required Select + other questions (teste2e-selectQuestion) #11564

Merged
merged 19 commits into from
Oct 31, 2023

Conversation

gitstart-app[bot]
Copy link
Contributor

@gitstart-app gitstart-app bot commented Sep 27, 2023

HOW TO RUN THE TESTS

Run

yarn e2e selectQuestion

DEMO

image

@vercel
Copy link

vercel bot commented Sep 27, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
api 🛑 Canceled (Inspect) Oct 30, 2023 4:17pm
dev ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 30, 2023 4:17pm
5 Ignored Deployments
Name Status Preview Comments Updated (UTC)
ai ⬜️ Ignored (Inspect) Visit Preview Oct 30, 2023 4:17pm
cal ⬜️ Ignored (Inspect) Visit Preview Oct 30, 2023 4:17pm
cal-demo ⬜️ Ignored (Inspect) Visit Preview Oct 30, 2023 4:17pm
qa ⬜️ Ignored (Inspect) Visit Preview Oct 30, 2023 4:17pm
ui ⬜️ Ignored (Inspect) Visit Preview Oct 30, 2023 4:17pm

@github-actions
Copy link
Contributor

github-actions bot commented Sep 27, 2023

Thank you for following the naming conventions! 🙏 Feel free to join our discord and post your PR link to collect XP and win prizes!

@github-actions
Copy link
Contributor

github-actions bot commented Sep 27, 2023

📦 Next.js Bundle Analysis for @calcom/web

This analysis was generated by the Next.js Bundle Analysis action. 🤖

This PR introduced no changes to the JavaScript bundle! 🙌

@deploysentinel
Copy link

deploysentinel bot commented Sep 27, 2023

Current Playwright Test Results Summary

✅ 251 Passing - ⚠️ 8 Flaky

Run may still be in progress, this comment will be updated as current testing workflow or job completes...

(Last updated on 10/30/2023 04:25:43pm UTC)

Run Details

Running Workflow PR Update on Github Actions

Commit: 373df95

Started: 10/30/2023 04:19:18pm UTC

⚠️ Flakes

📄   apps/web/playwright/webhook.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
FORM_SUBMITTED on submitting team form, triggers team webhook
Retry 1Initial Attempt
0.99% (3) 3 / 303 runs
failed over last 7 days
12.87% (39) 39 / 303 runs
flaked over last 7 days

📄   apps/web/playwright/integrations-stripe.e2e.ts • 2 Flakes

Top 1 Common Error Messages

null

2 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Stripe integration When event is paid and confirmed Cancelled paid booking should be refunded
Retry 1Initial Attempt
0% (0) 0 / 305 runs
failed over last 7 days
3.61% (11) 11 / 305 runs
flaked over last 7 days
Stripe integration When event is paid and confirmed Payment should confirm pending payment booking
Retry 1Initial Attempt
0% (0) 0 / 305 runs
failed over last 7 days
1.64% (5) 5 / 305 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/preview.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Preview Preview - embed-core should load
Retry 1Initial Attempt
0% (0) 0 / 319 runs
failed over last 7 days
10.34% (33) 33 / 319 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 3 Flakes

Top 1 Common Error Messages

null

3 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Popup Tests should open embed iframe on click - Configured with light theme
Retry 1Initial Attempt
2.80% (9) 9 / 321 runs
failed over last 7 days
46.42% (149) 149 / 321 runs
flaked over last 7 days
Popup Tests should open Routing Forms embed on click
Retry 1Initial Attempt
0.31% (1) 1 / 321 run
failed over last 7 days
18.69% (60) 60 / 321 runs
flaked over last 7 days
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when no theme is configured through Embed API
Retry 1Initial Attempt
2.82% (9) 9 / 319 runs
failed over last 7 days
55.49% (177) 177 / 319 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/inline.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Inline Iframe Inline Iframe - Configured with Dark Theme
Retry 1Initial Attempt
2.82% (9) 9 / 319 runs
failed over last 7 days
19.12% (61) 61 / 319 runs
flaked over last 7 days

View Detailed Build Results


@keithwillcode
Copy link
Contributor

@gitstart-calcom Nice. Thanks a lot. One question I'm curious of: Do all of these combinations of input checks need to be E2E tests? Is there anyway we could pull this off with component/unit tests? Reason I ask is because these are more expensive and slower to run + higher maintenance moving forward.

@gitstart-calcom
Copy link
Contributor

Hi @keithwillcode! Since we are checking more than just the component I think we can't do that using unit tests. In this tests, we simulate:
. Create an event type and edit it adding the questions
. Schedule a meeting and check if the questions have the correct behavior (and all the other components).
. Reschedule and cancel the meeting.

Also, since we are using functions to add and confirm the questions, it will be simple to change in the future, if needed

@vercel vercel bot temporarily deployed to Preview – api October 30, 2023 16:12 Inactive
@PeerRich PeerRich merged commit f80dc07 into main Oct 31, 2023
36 of 37 checks passed
@PeerRich PeerRich deleted the teste2e-selectQuestion branch October 31, 2023 19:44
hbjORbj pushed a commit to codemod-com/cal.com-demo that referenced this pull request Nov 28, 2023
…er questions (teste2e-selectQuestion) (calcom#11564)

Co-authored-by: gitstart-calcom <gitstart-calcom@users.noreply.github.com>
Co-authored-by: GitStart-Cal.com <121884634+gitstart-calcom@users.noreply.github.com>
Co-authored-by: gitstart-calcom <gitstart@users.noreply.github.com>
Co-authored-by: Morgan <33722304+ThyMinimalDev@users.noreply.github.com>
hbjORbj pushed a commit to codemod-com/cal.com-demo that referenced this pull request Dec 21, 2023
…er questions (teste2e-selectQuestion) (calcom#11564)

Co-authored-by: gitstart-calcom <gitstart-calcom@users.noreply.github.com>
Co-authored-by: GitStart-Cal.com <121884634+gitstart-calcom@users.noreply.github.com>
Co-authored-by: gitstart-calcom <gitstart@users.noreply.github.com>
Co-authored-by: Morgan <33722304+ThyMinimalDev@users.noreply.github.com>
zomars pushed a commit that referenced this pull request Jan 29, 2024
…er questions (teste2e-selectQuestion) (#11564)

Co-authored-by: gitstart-calcom <gitstart-calcom@users.noreply.github.com>
Co-authored-by: GitStart-Cal.com <121884634+gitstart-calcom@users.noreply.github.com>
Co-authored-by: gitstart-calcom <gitstart@users.noreply.github.com>
Co-authored-by: Morgan <33722304+ThyMinimalDev@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Low priority Created by Linear-GitHub Sync
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants