Skip to content

ci(versioning): release proposal workflow improvements#1763

Merged
iunanua merged 16 commits intomainfrom
igor/versioning/use-commit-headless-and-check-deps
Mar 27, 2026
Merged

ci(versioning): release proposal workflow improvements#1763
iunanua merged 16 commits intomainfrom
igor/versioning/use-commit-headless-and-check-deps

Conversation

@iunanua
Copy link
Copy Markdown
Contributor

@iunanua iunanua commented Mar 18, 2026

What does this PR do?

  • use commit-headless to sign commits
  • add a new workflow input to allow selecting the starting ref (sha, branch or tag) commit where to start the release from
  • add a new boolean input to bypass standard checks like the proposal ongoing checks or the existing tag check to allow testing the workflow. With the bypass enabled, release-proposal-testing and release-testing branch prefixes are used instead of the "official" ones.

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 18, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-03-26 14:23:18

Comparing candidate commit 963d11b in PR branch igor/versioning/use-commit-headless-and-check-deps with baseline commit e8f9d68 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 61 metrics, 0 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:receiver_entry_point/report/2598

  • 🟥 execution_time [+195.150µs; +203.667µs] or [+5.711%; +5.960%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.141ms 4.145ms ± 0.003ms 4.144ms ± 0.001ms 4.146ms 4.150ms 4.155ms 4.180ms 0.86% 5.514 48.984 0.08% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.145ms; 4.146ms] or [-0.012%; +0.012%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.970µs 5.054µs ± 0.054µs 5.073µs ± 0.046µs 5.090µs 5.136µs 5.141µs 5.143µs 1.37% -0.018 -1.431 1.06% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.046µs; 5.061µs] or [-0.147%; +0.147%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.466µs 146.282µs ± 1.873µs 145.962µs ± 0.522µs 146.549µs 147.805µs 151.756µs 165.373µs 13.30% 6.596 58.112 1.28% 0.132µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.023µs; 146.542µs] or [-0.177%; +0.177%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 14.774ms 14.802ms ± 0.014ms 14.799ms ± 0.008ms 14.810ms 14.830ms 14.839ms 14.865ms 0.45% 0.978 1.448 0.10% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [14.800ms; 14.804ms] or [-0.014%; +0.014%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 13.866µs 13.977µs ± 0.041µs 13.973µs ± 0.023µs 13.999µs 14.024µs 14.063µs 14.249µs 1.98% 2.264 13.871 0.29% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [13.971µs; 13.983µs] or [-0.040%; +0.040%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.423µs 496.699µs ± 1.374µs 496.246µs ± 0.314µs 496.670µs 499.722µs 502.468µs 504.526µs 1.67% 2.719 8.643 0.28% 0.097µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1982058.626op/s 2013306.470op/s ± 5528.074op/s 2015130.270op/s ± 1276.335op/s 2016344.997op/s 2017458.323op/s 2018391.154op/s 2018475.103op/s 0.17% -2.693 8.443 0.27% 390.894op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.565µs 371.419µs ± 0.349µs 371.406µs ± 0.229µs 371.650µs 372.001µs 372.249µs 372.789µs 0.37% 0.292 0.553 0.09% 0.025µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2682484.461op/s 2692376.512op/s ± 2526.246op/s 2692474.464op/s ± 1660.036op/s 2694030.205op/s 2696332.609op/s 2697477.360op/s 2698581.895op/s 0.23% -0.285 0.540 0.09% 178.633op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.925µs 168.225µs ± 0.151µs 168.216µs ± 0.105µs 168.320µs 168.482µs 168.600µs 168.731µs 0.31% 0.410 -0.090 0.09% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5926606.924op/s 5944427.991op/s ± 5331.846op/s 5944751.945op/s ± 3722.788op/s 5948487.189op/s 5952198.447op/s 5954211.354op/s 5955044.642op/s 0.17% -0.406 -0.098 0.09% 377.018op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.872µs 37.081µs ± 0.088µs 37.085µs ± 0.048µs 37.132µs 37.178µs 37.239µs 37.785µs 1.89% 2.260 18.892 0.24% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26465212.196op/s 26967917.348op/s ± 63771.358op/s 26965292.663op/s ± 34758.677op/s 26999968.818op/s 27066292.547op/s 27099446.262op/s 27120956.853op/s 0.58% -2.150 17.864 0.24% 4509.316op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.287µs 46.441µs ± 0.072µs 46.431µs ± 0.051µs 46.486µs 46.575µs 46.619µs 46.677µs 0.53% 0.449 0.023 0.16% 0.005µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21423838.509op/s 21532876.523op/s ± 33446.014op/s 21537185.875op/s ± 23841.527op/s 21558086.307op/s 21582298.232op/s 21597743.530op/s 21604310.369op/s 0.31% -0.440 0.011 0.15% 2364.990op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.509µs; 496.890µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2012540.332op/s; 2014072.608op/s] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.371µs; 371.468µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2692026.399op/s; 2692726.625op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [168.204µs; 168.246µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5943689.049op/s; 5945166.934op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.069µs; 37.094µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26959079.251op/s; 26976755.445op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.431µs; 46.451µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21528241.227op/s; 21537511.819op/s] or [-0.022%; +0.022%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.975ms 14.020ms ± 0.029ms 14.014ms ± 0.012ms 14.029ms 14.073ms 14.118ms 14.185ms 1.22% 2.220 7.742 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.016ms; 14.024ms] or [-0.029%; +0.029%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.337µs 2.365µs ± 0.015µs 2.361µs ± 0.005µs 2.370µs 2.406µs 2.412µs 2.419µs 2.49% 1.818 3.479 0.61% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.363µs; 2.367µs] or [-0.085%; +0.085%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.343ns 192.909ns ± 2.166ns 192.451ns ± 1.497ns 194.309ns 196.946ns 200.370ns 201.954ns 4.94% 1.288 2.121 1.12% 0.153ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.609ns; 193.210ns] or [-0.156%; +0.156%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 737.294µs 738.358µs ± 0.489µs 738.349µs ± 0.331µs 738.659µs 739.089µs 739.727µs 740.415µs 0.28% 0.619 1.410 0.07% 0.035µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [738.290µs; 738.426µs] or [-0.009%; +0.009%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_serialize_compressed_pprof_timestamped_x1000 execution_time 912.443µs 915.506µs ± 1.771µs 915.417µs ± 0.763µs 916.203µs 917.172µs 918.331µs 935.422µs 2.19% 7.151 78.294 0.19% 0.125µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_serialize_compressed_pprof_timestamped_x1000 execution_time [915.261µs; 915.751µs] or [-0.027%; +0.027%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.048µs 34.733µs ± 1.228µs 34.165µs ± 0.050µs 34.254µs 37.379µs 37.425µs 37.980µs 11.17% 1.697 0.920 3.53% 0.087µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.563µs; 34.903µs] or [-0.490%; +0.490%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.149ms 4.154ms ± 0.008ms 4.153ms ± 0.001ms 4.155ms 4.160ms 4.174ms 4.252ms 2.39% 9.341 106.748 0.19% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.153ms; 4.155ms] or [-0.027%; +0.027%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.583ms 3.617ms ± 0.017ms 3.613ms ± 0.008ms 3.624ms 3.650ms 3.676ms 3.680ms 1.87% 1.144 1.596 0.48% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.614ms; 3.619ms] or [-0.066%; +0.066%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 5.417µs 5.472µs ± 0.026µs 5.471µs ± 0.020µs 5.492µs 5.512µs 5.533µs 5.552µs 1.48% 0.216 -0.527 0.48% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [5.469µs; 5.476µs] or [-0.067%; +0.067%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 162.812µs 163.402µs ± 0.362µs 163.395µs ± 0.257µs 163.600µs 164.082µs 164.463µs 164.850µs 0.89% 0.826 0.962 0.22% 0.026µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [163.352µs; 163.452µs] or [-0.031%; +0.031%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.629µs 186.080µs ± 0.283µs 186.043µs ± 0.172µs 186.227µs 186.541µs 186.885µs 187.962µs 1.03% 2.019 9.757 0.15% 0.020µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5320213.873op/s 5374052.633op/s ± 8150.275op/s 5375098.414op/s ± 4954.533op/s 5379779.328op/s 5384120.476op/s 5385676.256op/s 5387085.483op/s 0.22% -1.984 9.483 0.15% 576.312op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.797µs 17.875µs ± 0.030µs 17.873µs ± 0.015µs 17.889µs 17.929µs 17.953µs 18.003µs 0.73% 0.500 1.768 0.17% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55545736.865op/s 55943791.503op/s ± 95372.392op/s 55949334.318op/s ± 48065.019op/s 55997312.129op/s 56078909.162op/s 56176772.795op/s 56190766.631op/s 0.43% -0.482 1.735 0.17% 6743.846op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.529µs 10.580µs ± 0.023µs 10.576µs ± 0.014µs 10.596µs 10.622µs 10.634µs 10.649µs 0.69% 0.217 0.051 0.21% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 93907662.161op/s 94521585.642op/s ± 203023.283op/s 94552439.972op/s ± 123446.250op/s 94644221.527op/s 94879503.536op/s 94930063.007op/s 94979840.529op/s 0.45% -0.205 0.042 0.21% 14355.914op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.041µs; 186.119µs] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5372923.083op/s; 5375182.183op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.871µs; 17.879µs] or [-0.024%; +0.024%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55930573.807op/s; 55957009.199op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.576µs; 10.583µs] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/good throughput [94493448.567op/s; 94549722.716op/s] or [-0.030%; +0.030%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.957ms 49.201ms ± 0.761ms 49.078ms ± 0.065ms 49.155ms 49.338ms 51.644ms 57.650ms 17.47% 8.786 85.380 1.54% 0.054ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.096ms; 49.307ms] or [-0.214%; +0.214%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 285.850µs 286.358µs ± 0.485µs 286.282µs ± 0.143µs 286.445µs 286.692µs 288.261µs 291.298µs 1.75% 6.718 58.911 0.17% 0.034µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [286.291µs; 286.425µs] or [-0.023%; +0.023%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.897µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.923µs 0.23% -0.596 6.469 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254875618.006op/s 255437041.454op/s ± 190544.562op/s 255452233.656op/s ± 110751.235op/s 255556063.529op/s 255668407.934op/s 255728991.524op/s 256613778.393op/s 0.45% 0.615 6.573 0.07% 13473.535op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.173µs 79.881µs ± 0.165µs 79.901µs ± 0.071µs 79.977µs 80.073µs 80.134µs 80.409µs 0.64% -1.627 4.824 0.21% 0.012µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12436481.411op/s 12518633.413op/s ± 25944.548op/s 12515532.049op/s ± 11142.427op/s 12525218.185op/s 12561793.795op/s 12612996.733op/s 12630536.849op/s 0.92% 1.652 4.896 0.21% 1834.557op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 67.853µs 67.975µs ± 0.083µs 67.967µs ± 0.044µs 68.013µs 68.089µs 68.157µs 68.673µs 1.04% 3.265 24.077 0.12% 0.006µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 14561737.932op/s 14711375.801op/s ± 17801.190op/s 14713115.375op/s ± 9599.939op/s 14722589.362op/s 14733183.246op/s 14736120.656op/s 14737691.986op/s 0.17% -3.209 23.461 0.12% 1258.734op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.924µs 0.23% -0.858 6.638 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254866605.512op/s 255438022.565op/s ± 210831.583op/s 255451681.329op/s ± 130460.820op/s 255569054.759op/s 255710623.727op/s 255805015.250op/s 256763378.528op/s 0.51% 0.878 6.762 0.08% 14908.044op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 64.796µs 64.911µs ± 0.048µs 64.907µs ± 0.033µs 64.941µs 64.998µs 65.017µs 65.031µs 0.19% 0.275 -0.509 0.07% 0.003µs 1 200
credit_card/is_card_number/378282246310005 throughput 15377171.765op/s 15405808.496op/s ± 11440.276op/s 15406676.370op/s ± 7872.309op/s 15414148.205op/s 15423632.199op/s 15427543.555op/s 15432976.128op/s 0.17% -0.271 -0.510 0.07% 808.950op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.464µs 45.646µs ± 0.082µs 45.647µs ± 0.057µs 45.702µs 45.783µs 45.830µs 45.844µs 0.43% 0.046 -0.330 0.18% 0.006µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21813081.523op/s 21907875.596op/s ± 39216.240op/s 21907434.524op/s ± 27564.398op/s 21934936.045op/s 21975592.373op/s 21992122.906op/s 21995365.576op/s 0.40% -0.037 -0.332 0.18% 2773.007op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.828µs 6.840µs ± 0.005µs 6.839µs ± 0.003µs 6.843µs 6.850µs 6.852µs 6.853µs 0.20% 0.302 -0.566 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 145925307.588op/s 146201322.663op/s ± 116468.111op/s 146216831.866op/s ± 70203.016op/s 146280113.219op/s 146380408.976op/s 146422593.341op/s 146451665.345op/s 0.16% -0.299 -0.567 0.08% 8235.539op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.919µs 3.922µs 3.924µs 0.23% -1.196 10.626 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254860275.223op/s 255437440.775op/s ± 187512.108op/s 255434991.842op/s ± 108264.077op/s 255550471.220op/s 255682073.762op/s 255716279.739op/s 256740106.060op/s 0.51% 1.221 10.802 0.07% 13259.108op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.113µs 65.730µs ± 0.076µs 65.730µs ± 0.026µs 65.764µs 65.811µs 65.829µs 65.870µs 0.21% -5.025 37.495 0.12% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15181470.668op/s 15213842.867op/s ± 17759.382op/s 15213673.812op/s ± 6083.694op/s 15218410.676op/s 15228759.407op/s 15261509.968op/s 15357843.783op/s 0.95% 5.075 37.999 0.12% 1255.778op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.373µs 53.435µs ± 0.036µs 53.427µs ± 0.020µs 53.453µs 53.500µs 53.554µs 53.620µs 0.36% 1.449 3.496 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18649713.152op/s 18714438.402op/s ± 12751.194op/s 18717235.194op/s ± 7074.710op/s 18723049.675op/s 18729396.077op/s 18733269.417op/s 18736083.724op/s 0.10% -1.443 3.460 0.07% 901.646op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.919µs 3.921µs 3.925µs 0.29% -0.660 9.177 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254766832.011op/s 255481731.791op/s ± 184295.054op/s 255495746.027op/s ± 102723.285op/s 255591955.596op/s 255694662.918op/s 255782787.313op/s 256690014.909op/s 0.47% 0.683 9.304 0.07% 13031.628op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.152µs 50.221µs ± 0.038µs 50.214µs ± 0.022µs 50.241µs 50.286µs 50.318µs 50.396µs 0.36% 0.973 1.642 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19842653.709op/s 19911812.451op/s ± 15063.037op/s 19914670.615op/s ± 8863.856op/s 19922258.367op/s 19932519.949op/s 19936126.148op/s 19939282.890op/s 0.12% -0.967 1.617 0.08% 1065.118op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.451µs 45.645µs ± 0.078µs 45.648µs ± 0.060µs 45.706µs 45.773µs 45.815µs 45.851µs 0.44% -0.121 -0.300 0.17% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21809948.112op/s 21908095.359op/s ± 37598.397op/s 21906934.960op/s ± 28597.119op/s 21936534.321op/s 21972868.463op/s 21993147.133op/s 22001485.100op/s 0.43% 0.130 -0.298 0.17% 2658.608op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.828µs 6.838µs ± 0.005µs 6.837µs ± 0.004µs 6.842µs 6.846µs 6.850µs 6.869µs 0.47% 1.182 4.528 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 145589928.799op/s 146246039.049op/s ± 112519.465op/s 146269553.992op/s ± 80753.740op/s 146329917.155op/s 146395963.286op/s 146429752.743op/s 146458321.445op/s 0.13% -1.170 4.450 0.08% 7956.328op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255410633.810op/s; 255463449.098op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.858µs; 79.904µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12515037.748op/s; 12522229.078op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [67.963µs; 67.986µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14708908.728op/s; 14713842.875op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255408803.335op/s; 255467241.795op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [64.904µs; 64.917µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 throughput [15404222.984op/s; 15407394.009op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.635µs; 45.657µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21902440.602op/s; 21913310.589op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.839µs; 6.841µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 throughput [146185181.303op/s; 146217464.023op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255411453.400op/s; 255463428.150op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.719µs; 65.740µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15211381.588op/s; 15216304.146op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.430µs; 53.440µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18712671.209op/s; 18716205.594op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255456190.269op/s; 255507273.313op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.216µs; 50.227µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19909724.859op/s; 19913900.043op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.635µs; 45.656µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21902884.583op/s; 21913306.135op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.837µs; 6.839µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [146230444.934op/s; 146261633.165op/s] or [-0.011%; +0.011%] None None None

Group 21

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 963d11b 1774533889 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.636ns 254.924ns ± 12.789ns 250.416ns ± 4.048ns 255.873ns 286.632ns 296.764ns 300.660ns 20.06% 1.803 2.338 5.00% 0.904ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.152ns; 256.696ns] or [-0.695%; +0.695%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Mar 18, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.11%. Comparing base (e8f9d68) to head (963d11b).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1763      +/-   ##
==========================================
+ Coverage   71.10%   71.11%   +0.01%     
==========================================
  Files         411      411              
  Lines       64989    64989              
==========================================
+ Hits        46209    46219      +10     
+ Misses      18780    18770      -10     
Components Coverage Δ
libdd-crashtracker 65.21% <ø> (-0.08%) ⬇️
libdd-crashtracker-ffi 34.98% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.63% <ø> (ø)
libdd-data-pipeline-ffi 73.45% <ø> (ø)
libdd-common 79.78% <ø> (ø)
libdd-common-ffi 73.87% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 72.56% <ø> (ø)
libdd-profiling 81.60% <ø> (+0.01%) ⬆️
libdd-profiling-ffi 64.94% <ø> (ø)
datadog-sidecar 31.63% <ø> (ø)
datdog-sidecar-ffi 13.34% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 87.37% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 88.95% <ø> (ø)
datadog-tracer-flare 86.88% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts bot commented Mar 18, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 101.45 MB 101.45 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.29 MB 11.29 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 118.24 MB 118.24 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.26 MB 27.26 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 80.34 KB 80.34 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.53 MB 186.52 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 921.92 MB 921.92 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.00 MB 9.00 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 80.34 KB 80.34 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 26.83 MB 26.83 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 61.01 MB 61.01 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 23.08 MB 23.08 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 81.59 KB 81.59 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.75 MB 190.65 MB --.05% (-104.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 905.45 MB 905.45 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 6.86 MB 6.86 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 81.59 KB 81.59 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 28.94 MB 28.94 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 57.39 MB 57.39 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 88.31 MB 88.31 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.28 MB 10.28 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 110.98 MB 110.98 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 12.02 MB 12.02 MB 0% (0 B) 👌

@datadog-official
Copy link
Copy Markdown

datadog-official bot commented Mar 23, 2026

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 71.12% (+0.02%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 963d11b | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback!

@iunanua iunanua changed the title ci(versioning): use commit headless to sign commits ci(versioning): release proposal workflow improvements Mar 23, 2026
@iunanua iunanua marked this pull request as ready for review March 26, 2026 14:04
@iunanua iunanua requested a review from a team as a code owner March 26, 2026 14:04
@iunanua iunanua merged commit a29b90b into main Mar 27, 2026
58 checks passed
@iunanua iunanua deleted the igor/versioning/use-commit-headless-and-check-deps branch March 27, 2026 09:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants