DX-240 Add Flakeguard Auto-Reruns for In-Memory and Docker Tests in Merge Queue

[lukaszcl]

This pull request introduces Flakeguard auto-reruns for both in-memory and Docker-based end-to-end (e2e) tests for the merge queue. This enhancement aims to improve the reliability and stability of our CI/CD pipeline by automatically retrying tests identified as flaky, reducing the likelihood of false failures blocking merges.

Key Changes:

• Integration of Flakeguard: Implemented Flakeguard to detect and automatically retry flaky tests in the merge queue workflows.
• Targeted Test Types: Configured Flakeguard to target in-memory and Docker-based e2e tests.
• Workflow Updates: Modified the CI workflow definitions to incorporate Flakeguard's retry logic.
• Improved Merge Queue Stability: Reduced the impact of transient test failures on the merge process.
• Updated test definitions: Added test_go_project_path field in integration-in-memory.yml and e2e-tests.yml test definitions. You can read more about this field in the E2E Workflow Doc

Motivation:

Flaky tests have been a recurring issue, leading to unnecessary delays and manual interventions in the merge queue. By automating the retry process for these tests, we can:

• Reduce Merge Time: Eliminate the need for manual reruns and approvals due to flaky failures.
• Increase Developer Productivity: Minimize disruptions caused by false negatives.
• Enhance CI Reliability: Ensure a more consistent and trustworthy pipeline.

[cl-sonarqube-production]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube