Skip to content

fix: Flaky 2FA test due to waiting redundant Enter#10236

Merged
emrysal merged 1 commit intomainfrom
bugfix/flaky-login-2fa-test-fix
Jul 19, 2023
Merged

fix: Flaky 2FA test due to waiting redundant Enter#10236
emrysal merged 1 commit intomainfrom
bugfix/flaky-login-2fa-test-fix

Conversation

@emrysal
Copy link
Copy Markdown
Contributor

@emrysal emrysal commented Jul 18, 2023

What does this PR do?

These occasionally fail depending on whether or not 2fa6 is dismissed or not.

@emrysal emrysal requested a review from a team July 18, 2023 18:14
@vercel
Copy link
Copy Markdown

vercel Bot commented Jul 18, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
api ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 18, 2023 6:19pm
cal ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 18, 2023 6:19pm
cal-demo ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 18, 2023 6:19pm
ui ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 18, 2023 6:19pm

@emrysal emrysal enabled auto-merge (squash) July 18, 2023 18:14
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jul 18, 2023

Thank you for following the naming conventions! 🙏

@zomars zomars added the core area: core, team members only label Jul 18, 2023
@emrysal emrysal changed the title Fix: Flaky 2FA test due to waiting redundant Enter fix: Flaky 2FA test due to waiting redundant Enter Jul 18, 2023
@alwaysmeticulous
Copy link
Copy Markdown

alwaysmeticulous Bot commented Jul 18, 2023

🤖 Meticulous spotted visual differences in 57 of 272 screens tested: view and approve differences detected.

Last updated for commit c004ee9. This comment will update as new commits are pushed.

@github-actions
Copy link
Copy Markdown
Contributor

📦 Next.js Bundle Analysis for @calcom/web

This analysis was generated by the Next.js Bundle Analysis action. 🤖

This PR introduced no changes to the JavaScript bundle! 🙌

@deploysentinel
Copy link
Copy Markdown

deploysentinel Bot commented Jul 18, 2023

Current Playwright Test Results Summary

✅ 94 Passing - ⚠️ 4 Flaky

Run may still be in progress, this comment will be updated as current testing workflow or job completes...

(Last updated on 07/18/2023 06:24:49pm UTC)

Run Details

Running Workflow PR Update on Github Actions

Commit: c004ee9

Started: 07/18/2023 06:22:30pm UTC

⚠️ Flakes

📄   packages/app-store/routing-forms/playwright/tests/basic.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Routing Forms Seeded Routing Form Routing Link - Reporting and CSV Download
Retry 1Initial Attempt
5.97% (12) 12 / 201 runs
failed over last 7 days
41.79% (84) 84 / 201 runs
flaked over last 7 days

📄   apps/web/playwright/embed-code-generator.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Embed Code Generator Tests Event Types Page open Embed Dialog and choose element-click for First Event Type
Retry 1Initial Attempt
0% (0) 0 / 344 runs
failed over last 7 days
5.52% (19) 19 / 344 runs
flaked over last 7 days

📄   apps/web/playwright/login.2fa.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
2FA Tests should allow a user to enable 2FA and login using 2FA
Retry 1Initial Attempt
14.84% (50) 50 / 337 runs
failed over last 7 days
20.47% (69) 69 / 337 runs
flaked over last 7 days

📄   packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Popup Tests should be able to reschedule
Retry 2Retry 1Initial Attempt
1.24% (2) 2 / 161 runs
failed over last 7 days
98.14% (158) 158 / 161 runs
flaked over last 7 days

View Detailed Build Results


@PeerRich PeerRich added Low priority Created by Linear-GitHub Sync automated-tests area: unit tests, e2e tests, playwright labels Jul 18, 2023
@emrysal emrysal merged commit e8f5090 into main Jul 19, 2023
@emrysal emrysal deleted the bugfix/flaky-login-2fa-test-fix branch July 19, 2023 06:19
fritterhoff pushed a commit to hm-edu/cal.com that referenced this pull request Jul 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated-tests area: unit tests, e2e tests, playwright core area: core, team members only Low priority Created by Linear-GitHub Sync

Projects

No open projects
Status: No status

Development

Successfully merging this pull request may close these issues.

4 participants