ci: parallel system tests

[gnufede]

CI: Introduces concurrency to System Tests execution in order to decrease wall time.

Decreases wall time for system tests from ~37 min to ~23 min.

Checklist

• Change(s) are motivated and described in the PR description
• Testing strategy is described if automated tests are not included in the PR
• Risks are described (performance impact, potential for breakage, maintainability)
• Change is maintainable (easy to change, telemetry, documentation)
• Library release note guidelines are followed or label changelog/no-changelog is set
• Documentation is included (in-code, generated user docs, public corp docs)
• Backport labels are set (if applicable)
• If this PR changes the public interface, I've notified @DataDog/apm-tees.
• If change touches code that signs or publishes builds or packages, or handles credentials of any kind, I've requested a review from @DataDog/security-design-and-guidance.

Reviewer Checklist

• Title is accurate
• All changes are related to the pull request's stated goal
• Description motivates each change
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Change is maintainable (easy to change, telemetry, documentation)
• Release note makes sense to a user of the library
• Author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[datadog-dd-trace-py-rkomorn]

Datadog Report

Branch report: gnufede/ci-parallel-system-tests
Commit report: 77783bd
Test service: dd-trace-py

✅ 0 Failed, 1 Passed, 175 Skipped, 16.8s Total duration (3m 59.81s time saved)

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-04-01 17:11:00

Comparing candidate commit 805117c in PR branch gnufede/ci-parallel-system-tests with baseline commit 689c9be in branch main.

Found 1 performance improvements and 3 performance regressions! Performance is the same for 197 metrics, 9 unstable metrics.

scenario:flasksimple-tracer

• 🟩 execution_time [-254.615µs; -205.713µs] or [-3.910%; -3.159%]

scenario:httppropagationextract-tracecontext_headers

• 🟥 max_rss_usage [+595.614KB; +742.139KB] or [+2.815%; +3.507%]

scenario:httppropagationextract-wsgi_valid_headers_all

• 🟥 max_rss_usage [+456.258KB; +699.224KB] or [+2.151%; +3.296%]

scenario:sethttpmeta-all-enabled

• 🟥 max_rss_usage [+481.109KB; +748.510KB] or [+2.240%; +3.486%]

[emmettbutler]

@gnufede I'm going to force-merge this, then make the test-requirement changes once it's show to be working properly in main.

[github-actions]

The backport to 2.5 failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-2.5 2.5
# Navigate to the new working tree
cd .worktrees/backport-2.5
# Create a new branch
git switch --create backport-8813-to-2.5
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 ad2fe2554a53d6bbee12a0f5a97f44c54f27b508
# Push it to GitHub
git push --set-upstream origin backport-8813-to-2.5
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-2.5

Then, create a pull request where the base branch is 2.5 and the compare/head branch is backport-8813-to-2.5.

[github-actions]

The backport to 2.6 failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-2.6 2.6
# Navigate to the new working tree
cd .worktrees/backport-2.6
# Create a new branch
git switch --create backport-8813-to-2.6
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 ad2fe2554a53d6bbee12a0f5a97f44c54f27b508
# Push it to GitHub
git push --set-upstream origin backport-8813-to-2.6
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-2.6

Then, create a pull request where the base branch is 2.6 and the compare/head branch is backport-8813-to-2.6.

[github-actions]

The backport to 2.7 failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-2.7 2.7
# Navigate to the new working tree
cd .worktrees/backport-2.7
# Create a new branch
git switch --create backport-8813-to-2.7
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 ad2fe2554a53d6bbee12a0f5a97f44c54f27b508
# Push it to GitHub
git push --set-upstream origin backport-8813-to-2.7
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-2.7

Then, create a pull request where the base branch is 2.7 and the compare/head branch is backport-8813-to-2.7.