-
Notifications
You must be signed in to change notification settings - Fork 276
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Development
: Fix flaky e2e tests
#8420
Conversation
…n CI" This reverts commit c3d9941.
WalkthroughThis update involves refactoring and enhancing test suites for better reliability and maintainability. Changes include renaming tests for consistency, updating assertion methods for improved visibility checks, and adding new tests to cover more functionalities like test run creation, modification, and deletion. Overall, the changes aim to streamline testing processes and improve code quality. Changes
Possibly related issues
Recent Review DetailsConfiguration used: CodeRabbit UI Files selected for processing (5)
Additional comments not posted (11)
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
General
: Fix flaky E2E tests - exam test run and complaints
General
: Fix flaky E2E tests - exam test run and complaintsDevelopment
: Fix flaky e2e tests
Checklist
General
Client
Motivation and Context
Exam test run tests have flaky assertions and fail sometimes. Exam assessment complaint tests fail in CI build due to .
Description
This PR fixes flaky assertions and improves isolation of some test exam tests.
It also fixes exam complaint tests by changing complaint message assertions.
Steps for Testing
Steps for running the tests:
npm install && npm run playwright:setup && npx playwright test e2e/exercise/quiz-exercise/QuizExerciseManagement.spec.ts
npx playwright test e2e/exam/ExamTestRun.spec.ts && npx playwright test e2e/exam/test-exam/TestExamTestRun.spec.ts
npx playwright test e2e/exam/ExamAssessment.spec.ts
Testserver States
Note
These badges show the state of the test servers.
Green = Currently available, Red = Currently locked
Review Progress
Code Review
Manual Tests
Summary by CodeRabbit