Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: mark some unreliable tests #9382

Merged
merged 4 commits into from
Jun 10, 2024
Merged

Conversation

emmettbutler
Copy link
Collaborator

@emmettbutler emmettbutler commented May 24, 2024

Marking recently-failed tests

https://app.circleci.com/pipelines/github/DataDog/dd-trace-py/62400/workflows/eddd6d71-2921-41de-8b17-4a43d22ce511/jobs/3891138
https://app.circleci.com/pipelines/github/DataDog/dd-trace-py/62385/workflows/19270a5d-be1d-4007-bdcb-8711682e4e6d/jobs/3890437

Checklist

  • Change(s) are motivated and described in the PR description
  • Testing strategy is described if automated tests are not included in the PR
  • Risks are described (performance impact, potential for breakage, maintainability)
  • Change is maintainable (easy to change, telemetry, documentation)
  • Library release note guidelines are followed or label changelog/no-changelog is set
  • Documentation is included (in-code, generated user docs, public corp docs)
  • Backport labels are set (if applicable)
  • If this PR changes the public interface, I've notified @DataDog/apm-tees.

@emmettbutler emmettbutler requested review from a team as code owners May 24, 2024 18:48
@datadog-dd-trace-py-rkomorn
Copy link

datadog-dd-trace-py-rkomorn bot commented May 24, 2024

Datadog Report

Branch report: emmett.butler/flaky-tests-may
Commit report: f4deea1
Test service: dd-trace-py

✅ 0 Failed, 98 Passed, 1810 Skipped, 8m 25.36s Total duration (3m 1.35s time saved)

@emmettbutler
Copy link
Collaborator Author

@P403n1x87 are you ok with this change?

@emmettbutler emmettbutler enabled auto-merge (squash) June 10, 2024 16:52
@emmettbutler emmettbutler added the changelog/no-changelog A changelog entry is not required for this PR. label Jun 10, 2024
@pr-commenter
Copy link

pr-commenter bot commented Jun 10, 2024

Benchmarks

Benchmark execution time: 2024-06-10 18:17:51

Comparing candidate commit f4deea1 in PR branch emmett.butler/flaky-tests-may with baseline commit 1e22549 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 221 metrics, 9 unstable metrics.

@emmettbutler emmettbutler merged commit eda0f8f into main Jun 10, 2024
58 checks passed
@emmettbutler emmettbutler deleted the emmett.butler/flaky-tests-may branch June 10, 2024 18:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog/no-changelog A changelog entry is not required for this PR.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants