Skip to content

chore(ci): set rustup profile to minimal so we do not download docs#1814

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
Mar 27, 2026
Merged

chore(ci): set rustup profile to minimal so we do not download docs#1814
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
ekump/APMSP-2774-use-minimial-rustup-profile-on-ci

Conversation

@ekump
Copy link
Copy Markdown
Contributor

@ekump ekump commented Mar 27, 2026 •
edited
Loading

What does this PR do?

Using the minimal rustup profile means we don't have to download rust-docs, which is ~600mb and unnecessary.

likely to have a minimal impact on CI run time, but is good hygiene nonetheless.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@ekump ekump force-pushed the ekump/APMSP-2774-use-minimial-rustup-profile-on-ci branch from 7591f5c to a52b285 Compare March 27, 2026 18:14
@datadog-prod-us1-4
Copy link
Copy Markdown

datadog-prod-us1-4 bot commented Mar 27, 2026 •
edited by datadog-datadog-prod-us1 bot
Loading

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 71.18% (-0.05%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: a52b285 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback!

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Mar 27, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.17%. Comparing base (7824b52) to head (a52b285).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1814      +/-   ##
==========================================
- Coverage   71.22%   71.17%   -0.05%     
==========================================
  Files         414      414              
  Lines       65912    65912              
==========================================
- Hits        46945    46914      -31     
- Misses      18967    18998      +31
Components Coverage Δ
libdd-crashtracker 65.22% <ø> (ø)
libdd-crashtracker-ffi 34.47% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 86.53% <ø> (ø)
libdd-data-pipeline-ffi 69.94% <ø> (ø)
libdd-common 79.79% <ø> (ø)
libdd-common-ffi 73.87% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 70.31% <ø> (-2.25%) ⬇️
libdd-profiling 81.61% <ø> (-0.02%) ⬇️
libdd-profiling-ffi 64.94% <ø> (ø)
datadog-sidecar 31.62% <ø> (ø)
datdog-sidecar-ffi 13.26% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 87.24% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 88.64% <ø> (ø)
datadog-tracer-flare 86.88% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ekump ekump marked this pull request as ready for review March 27, 2026 18:32
@ekump ekump requested a review from a team as a code owner March 27, 2026 18:32
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 27, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-27 18:31:53

Comparing candidate commit a52b285 in PR branch ekump/APMSP-2774-use-minimial-rustup-profile-on-ci with baseline commit 7824b52 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 61 metrics, 0 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:single_flag_killswitch/rules-based

  • 🟥 execution_time [+49.831ns; +50.915ns] or [+25.837%; +26.398%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.040ms 49.445ms ± 1.280ms 49.272ms ± 0.062ms 49.334ms 49.543ms 57.827ms 60.875ms 23.55% 8.005 63.748 2.58% 0.091ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.268ms; 49.623ms] or [-0.359%; +0.359%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.262ms 4.267ms ± 0.003ms 4.266ms ± 0.001ms 4.268ms 4.270ms 4.274ms 4.297ms 0.72% 5.419 47.195 0.07% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.266ms; 4.267ms] or [-0.010%; +0.010%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 13.930µs 14.517µs ± 0.435µs 14.522µs ± 0.144µs 14.645µs 15.197µs 16.144µs 17.039µs 17.33% 1.736 6.910 2.99% 0.031µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [14.457µs; 14.578µs] or [-0.415%; +0.415%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.398µs 496.133µs ± 0.523µs 496.051µs ± 0.193µs 496.256µs 496.852µs 498.192µs 500.234µs 0.84% 3.608 21.088 0.11% 0.037µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1999064.660op/s 2015591.093op/s ± 2116.530op/s 2015920.960op/s ± 785.888op/s 2016650.192op/s 2017823.276op/s 2018166.323op/s 2018577.190op/s 0.13% -3.576 20.766 0.10% 149.661op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.238µs 371.175µs ± 0.337µs 371.232µs ± 0.253µs 371.431µs 371.686µs 371.790µs 371.830µs 0.16% -0.285 -0.587 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2689403.901op/s 2694146.860op/s ± 2443.322op/s 2693732.352op/s ± 1837.857op/s 2695975.515op/s 2698495.824op/s 2699627.519op/s 2700964.373op/s 0.27% 0.289 -0.584 0.09% 172.769op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.877µs 168.279µs ± 0.158µs 168.285µs ± 0.106µs 168.382µs 168.546µs 168.639µs 168.767µs 0.29% 0.094 -0.041 0.09% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5925312.674op/s 5942523.887op/s ± 5576.815op/s 5942314.225op/s ± 3744.513op/s 5946386.207op/s 5952396.196op/s 5954633.715op/s 5956744.614op/s 0.24% -0.089 -0.044 0.09% 394.340op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.824µs 36.997µs ± 0.112µs 36.997µs ± 0.102µs 37.095µs 37.173µs 37.207µs 37.213µs 0.58% 0.169 -1.222 0.30% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26872359.831op/s 27029706.279op/s ± 81700.165op/s 27029446.119op/s ± 74297.356op/s 27107487.466op/s 27144018.891op/s 27155762.702op/s 27156423.275op/s 0.47% -0.162 -1.226 0.30% 5777.074op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.322µs 46.483µs ± 0.229µs 46.450µs ± 0.037µs 46.497µs 46.577µs 47.783µs 48.498µs 4.41% 7.581 60.693 0.49% 0.016µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20619317.230op/s 21513783.704op/s ± 102322.625op/s 21528684.939op/s ± 17123.904op/s 21543333.281op/s 21563539.682op/s 21580491.946op/s 21588211.110op/s 0.28% -7.504 59.703 0.47% 7235.302op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.060µs; 496.205µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2015297.762op/s; 2015884.424op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.129µs; 371.222µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2693808.239op/s; 2694485.481op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [168.257µs; 168.301µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5941750.994op/s; 5943296.780op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.981µs; 37.012µs] or [-0.042%; +0.042%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27018383.421op/s; 27041029.136op/s] or [-0.042%; +0.042%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.451µs; 46.515µs] or [-0.068%; +0.068%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21499602.772op/s; 21527964.636op/s] or [-0.066%; +0.066%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 290.915µs 291.382µs ± 0.525µs 291.276µs ± 0.160µs 291.474µs 291.838µs 293.829µs 295.983µs 1.62% 5.660 40.908 0.18% 0.037µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [291.310µs; 291.455µs] or [-0.025%; +0.025%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.070ns 255.101ns ± 11.634ns 250.910ns ± 4.531ns 257.982ns 285.926ns 288.639ns 289.361ns 15.32% 1.707 2.054 4.55% 0.823ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.488ns; 256.713ns] or [-0.632%; +0.632%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 14.804ms 14.840ms ± 0.017ms 14.839ms ± 0.009ms 14.847ms 14.871ms 14.892ms 14.919ms 0.54% 1.224 2.906 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [14.838ms; 14.843ms] or [-0.016%; +0.016%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.688µs 186.106µs ± 0.271µs 186.064µs ± 0.154µs 186.233µs 186.518µs 186.686µs 188.395µs 1.25% 3.190 23.786 0.15% 0.019µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5308006.358op/s 5373284.928op/s ± 7788.898op/s 5374502.380op/s ± 4440.436op/s 5378248.160op/s 5382932.029op/s 5384170.883op/s 5385376.898op/s 0.20% -3.123 23.046 0.14% 550.758op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.818µs 17.874µs ± 0.049µs 17.870µs ± 0.019µs 17.891µs 17.915µs 17.953µs 18.466µs 3.33% 8.695 101.349 0.28% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54153407.046op/s 55946201.125op/s ± 150958.403op/s 55959116.928op/s ± 60219.629op/s 56016996.219op/s 56070281.790op/s 56088788.421op/s 56122571.697op/s 0.29% -8.467 97.698 0.27% 10674.371op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.524µs 10.583µs ± 0.023µs 10.578µs ± 0.012µs 10.593µs 10.631µs 10.652µs 10.661µs 0.78% 0.916 1.030 0.22% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 93798689.396op/s 94491988.979op/s ± 206924.106op/s 94531599.589op/s ± 109864.690op/s 94628667.360op/s 94754684.462op/s 94852942.178op/s 95019801.837op/s 0.52% -0.902 1.003 0.22% 14631.744op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.069µs; 186.144µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5372205.462op/s; 5374364.395op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.868µs; 17.881µs] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55925279.742op/s; 55967122.508op/s] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.580µs; 10.586µs] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/good throughput [94463311.288op/s; 94520666.670op/s] or [-0.030%; +0.030%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 238.598ns 243.244ns ± 3.381ns 243.080ns ± 2.290ns 245.044ns 249.668ns 253.478ns 258.324ns 6.27% 1.051 1.852 1.39% 0.239ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [242.776ns; 243.713ns] or [-0.193%; +0.193%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.425µs 2.454µs ± 0.019µs 2.450µs ± 0.005µs 2.455µs 2.513µs 2.525µs 2.528µs 3.17% 2.464 5.507 0.79% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.452µs; 2.457µs] or [-0.110%; +0.110%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.647µs 146.379µs ± 1.667µs 146.098µs ± 0.472µs 146.639µs 148.225µs 153.236µs 162.280µs 11.08% 5.618 44.255 1.14% 0.118µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.148µs; 146.610µs] or [-0.158%; +0.158%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.528µs 34.200µs ± 1.235µs 33.625µs ± 0.044µs 33.709µs 36.876µs 36.910µs 37.220µs 10.69% 1.697 0.909 3.60% 0.087µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.029µs; 34.371µs] or [-0.501%; +0.501%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.192ms 14.262ms ± 0.032ms 14.257ms ± 0.013ms 14.271ms 14.320ms 14.384ms 14.467ms 1.47% 2.524 10.351 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.258ms; 14.267ms] or [-0.031%; +0.031%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.976µs 5.062µs ± 0.047µs 5.069µs ± 0.044µs 5.094µs 5.136µs 5.137µs 5.140µs 1.40% -0.022 -1.265 0.93% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.056µs; 5.069µs] or [-0.129%; +0.129%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.348ms 3.393ms ± 0.021ms 3.389ms ± 0.011ms 3.401ms 3.437ms 3.462ms 3.473ms 2.49% 1.321 2.112 0.60% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.390ms; 3.396ms] or [-0.084%; +0.084%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 5.332µs 5.381µs ± 0.021µs 5.379µs ± 0.011µs 5.390µs 5.413µs 5.430µs 5.532µs 2.85% 1.836 11.911 0.39% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [5.378µs; 5.384µs] or [-0.055%; +0.055%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.619µs 160.650µs ± 0.334µs 160.628µs ± 0.116µs 160.746µs 161.072µs 161.545µs 163.067µs 1.52% 2.530 17.588 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.604µs; 160.696µs] or [-0.029%; +0.029%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.920µs 3.924µs 0.30% -0.491 9.680 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254872593.618op/s 255616323.871op/s ± 183551.120op/s 255627761.175op/s ± 96546.411op/s 255724166.869op/s 255821039.611op/s 255867259.048op/s 256822474.981op/s 0.47% 0.516 9.808 0.07% 12979.024op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.843µs 79.581µs ± 0.328µs 79.536µs ± 0.204µs 79.762µs 80.183µs 80.389µs 80.716µs 1.48% 0.598 0.266 0.41% 0.023µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12389068.672op/s 12566022.721op/s ± 51608.118op/s 12572860.852op/s ± 32189.995op/s 12600930.264op/s 12639338.678op/s 12657855.595op/s 12683431.613op/s 0.88% -0.574 0.225 0.41% 3649.245op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.339µs 72.979µs ± 0.355µs 72.940µs ± 0.238µs 73.178µs 73.682µs 73.889µs 74.142µs 1.65% 0.721 0.334 0.49% 0.025µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13487650.297op/s 13702950.101op/s ± 66489.596op/s 13709820.234op/s ± 44551.583op/s 13754564.253op/s 13794978.291op/s 13813702.630op/s 13823739.508op/s 0.83% -0.695 0.276 0.48% 4701.524op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.915µs 3.917µs 3.918µs 0.18% -2.037 17.364 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255211830.810op/s 255643381.019op/s ± 163706.801op/s 255660474.894op/s ± 99308.498op/s 255743201.420op/s 255827140.973op/s 255893661.604op/s 256929355.581op/s 0.50% 2.066 17.630 0.06% 11575.819op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.206µs 69.640µs ± 0.245µs 69.562µs ± 0.123µs 69.767µs 70.126µs 70.383µs 70.797µs 1.78% 1.450 2.738 0.35% 0.017µs 1 200
credit_card/is_card_number/378282246310005 throughput 14124811.939op/s 14359656.911op/s ± 50227.308op/s 14375576.618op/s ± 25555.312op/s 14393875.769op/s 14413587.112op/s 14429513.377op/s 14449514.150op/s 0.51% -1.422 2.604 0.35% 3551.607op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.226µs 52.304µs ± 0.036µs 52.301µs ± 0.020µs 52.322µs 52.359µs 52.417µs 52.466µs 0.32% 0.933 2.177 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19059924.801op/s 19118920.544op/s ± 13007.027op/s 19120271.337op/s ± 7142.995op/s 19127142.324op/s 19138199.215op/s 19143131.137op/s 19147722.887op/s 0.14% -0.926 2.154 0.07% 919.736op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.706µs 5.846µs ± 0.057µs 5.844µs ± 0.039µs 5.887µs 5.941µs 5.969µs 5.998µs 2.64% 0.046 -0.308 0.97% 0.004µs 1 200
credit_card/is_card_number/x371413321323331 throughput 166719477.417op/s 171061219.501op/s ± 1671500.745op/s 171118004.260op/s ± 1153281.229op/s 172135037.628op/s 173884081.964op/s 174460771.748op/s 175251208.772op/s 2.42% 0.003 -0.311 0.97% 118192.951op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.891µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.920µs 3.921µs 0.24% -1.308 15.089 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255036090.050op/s 255624707.313op/s ± 186740.693op/s 255646097.021op/s ± 89124.220op/s 255721908.975op/s 255848763.266op/s 255881857.565op/s 257018298.255op/s 0.54% 1.342 15.334 0.07% 13204.561op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.989µs 64.456µs ± 0.188µs 64.433µs ± 0.114µs 64.557µs 64.811µs 64.977µs 65.090µs 1.02% 0.599 0.386 0.29% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15363240.178op/s 15514497.756op/s ± 45146.490op/s 15520002.921op/s ± 27456.666op/s 15545626.478op/s 15580620.364op/s 15603751.969op/s 15627729.844op/s 0.69% -0.581 0.359 0.29% 3192.339op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.797µs 58.065µs ± 0.151µs 58.036µs ± 0.101µs 58.159µs 58.345µs 58.446µs 58.481µs 0.77% 0.622 -0.144 0.26% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17099438.970op/s 17222162.100op/s ± 44667.630op/s 17230551.405op/s ± 29861.927op/s 17256416.762op/s 17285780.458op/s 17296687.679op/s 17301789.005op/s 0.41% -0.611 -0.163 0.26% 3158.478op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.917µs 3.920µs 3.922µs 0.26% -0.412 6.638 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254977394.065op/s 255615913.143op/s ± 185703.503op/s 255627976.848op/s ± 97851.462op/s 255726749.022op/s 255845124.309op/s 255882653.139op/s 256753175.852op/s 0.44% 0.431 6.734 0.07% 13131.221op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.490µs 54.827µs ± 0.200µs 54.768µs ± 0.097µs 54.928µs 55.210µs 55.529µs 55.732µs 1.76% 1.511 3.028 0.36% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17943111.512op/s 18239345.495op/s ± 66142.258op/s 18258788.097op/s ± 32199.568op/s 18285214.576op/s 18312024.424op/s 18324620.790op/s 18351919.415op/s 0.51% -1.481 2.893 0.36% 4676.964op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.224µs 52.302µs ± 0.034µs 52.303µs ± 0.021µs 52.321µs 52.356µs 52.388µs 52.470µs 0.32% 0.753 2.460 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19058609.891op/s 19119820.763op/s ± 12273.856op/s 19119456.426op/s ± 7563.413op/s 19128179.901op/s 19137547.008op/s 19143977.180op/s 19148185.011op/s 0.15% -0.746 2.427 0.06% 867.893op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.713µs 5.860µs ± 0.061µs 5.858µs ± 0.045µs 5.905µs 5.953µs 5.984µs 6.055µs 3.36% 0.024 -0.366 1.05% 0.004µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165151587.356op/s 170671454.764op/s ± 1790272.055op/s 170693833.740op/s ± 1304563.560op/s 171909132.463op/s 173375182.677op/s 174511133.583op/s 175047759.818op/s 2.55% 0.027 -0.392 1.05% 126591.351op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255590885.451op/s; 255641762.291op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.536µs; 79.626µs] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12558870.332op/s; 12573175.109op/s] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.929µs; 73.028µs] or [-0.067%; +0.067%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13693735.282op/s; 13712164.919op/s] or [-0.067%; +0.067%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255620692.831op/s; 255666069.207op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.606µs; 69.674µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number/378282246310005 throughput [14352695.890op/s; 14366617.933op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.299µs; 52.309µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19117117.895op/s; 19120723.193op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.838µs; 5.854µs] or [-0.135%; +0.135%] None None None
credit_card/is_card_number/x371413321323331 throughput [170829565.574op/s; 171292873.429op/s] or [-0.135%; +0.135%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255598826.849op/s; 255650587.777op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.430µs; 64.482µs] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15508240.887op/s; 15520754.626op/s] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.044µs; 58.086µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17215971.596op/s; 17228352.604op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255590176.424op/s; 255641649.862op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.800µs; 54.855µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18230178.814op/s; 18248512.176op/s] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.297µs; 52.306µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19118119.725op/s; 19121521.801op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.851µs; 5.868µs] or [-0.145%; +0.145%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [170423340.275op/s; 170919569.253op/s] or [-0.145%; +0.145%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.263ms 4.269ms ± 0.008ms 4.268ms ± 0.001ms 4.270ms 4.273ms 4.278ms 4.381ms 2.64% 11.763 152.005 0.20% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.268ms; 4.270ms] or [-0.027%; +0.027%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_serialize_compressed_pprof_timestamped_x1000 execution_time 930.762µs 934.941µs ± 1.884µs 934.879µs ± 0.960µs 935.830µs 937.364µs 939.531µs 949.266µs 1.54% 2.765 18.255 0.20% 0.133µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_serialize_compressed_pprof_timestamped_x1000 execution_time [934.680µs; 935.202µs] or [-0.028%; +0.028%] None None None

Group 21

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a52b285 1774635294 ekump/APMSP-2774-use-minimial-rustup-profile-on-ci
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 726.441µs 727.488µs ± 0.543µs 727.388µs ± 0.295µs 727.698µs 728.593µs 729.318µs 729.685µs 0.32% 1.301 2.346 0.07% 0.038µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [727.413µs; 727.563µs] or [-0.010%; +0.010%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts bot commented Mar 27, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 101.90 MB 101.90 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.76 MB 8.76 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 118.84 MB 118.84 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.36 MB 11.36 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.39 MB 27.39 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 80.69 KB 80.69 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 187.19 MB 187.19 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 924.91 MB 924.91 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.06 MB 9.06 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 80.69 KB 80.69 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 26.98 MB 26.98 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 61.28 MB 61.28 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 23.20 MB 23.20 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 81.94 KB 81.94 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 191.47 MB 191.45 MB -0% (-16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 908.20 MB 908.20 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 6.90 MB 6.90 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 81.94 KB 81.94 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 29.11 MB 29.11 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 57.68 MB 57.68 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 88.72 MB 88.72 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.32 MB 10.32 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 111.54 MB 111.54 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 12.07 MB 12.07 MB 0% (0 B) 👌

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit d75fe5e into main Mar 27, 2026
90 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the ekump/APMSP-2774-use-minimial-rustup-profile-on-ci branch March 27, 2026 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrisonlevi morrisonlevi morrisonlevi approved these changes

Assignees

No one assigned

Labels

ci-build mergequeue-status: done

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ekump @codecov-commenter @morrisonlevi