ci(versioning): release proposal workflow improvements#1763
Conversation
BenchmarksComparisonBenchmark execution time: 2026-03-26 14:23:18 Comparing candidate commit 963d11b in PR branch Found 0 performance improvements and 1 performance regressions! Performance is the same for 61 metrics, 0 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.141ms | 4.145ms ± 0.003ms | 4.144ms ± 0.001ms | 4.146ms | 4.150ms | 4.155ms | 4.180ms | 0.86% | 5.514 | 48.984 | 0.08% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.145ms; 4.146ms] or [-0.012%; +0.012%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.970µs | 5.054µs ± 0.054µs | 5.073µs ± 0.046µs | 5.090µs | 5.136µs | 5.141µs | 5.143µs | 1.37% | -0.018 | -1.431 | 1.06% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.046µs; 5.061µs] or [-0.147%; +0.147%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.466µs | 146.282µs ± 1.873µs | 145.962µs ± 0.522µs | 146.549µs | 147.805µs | 151.756µs | 165.373µs | 13.30% | 6.596 | 58.112 | 1.28% | 0.132µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.023µs; 146.542µs] or [-0.177%; +0.177%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 14.774ms | 14.802ms ± 0.014ms | 14.799ms ± 0.008ms | 14.810ms | 14.830ms | 14.839ms | 14.865ms | 0.45% | 0.978 | 1.448 | 0.10% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [14.800ms; 14.804ms] or [-0.014%; +0.014%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 13.866µs | 13.977µs ± 0.041µs | 13.973µs ± 0.023µs | 13.999µs | 14.024µs | 14.063µs | 14.249µs | 1.98% | 2.264 | 13.871 | 0.29% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [13.971µs; 13.983µs] or [-0.040%; +0.040%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.423µs | 496.699µs ± 1.374µs | 496.246µs ± 0.314µs | 496.670µs | 499.722µs | 502.468µs | 504.526µs | 1.67% | 2.719 | 8.643 | 0.28% | 0.097µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1982058.626op/s | 2013306.470op/s ± 5528.074op/s | 2015130.270op/s ± 1276.335op/s | 2016344.997op/s | 2017458.323op/s | 2018391.154op/s | 2018475.103op/s | 0.17% | -2.693 | 8.443 | 0.27% | 390.894op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.565µs | 371.419µs ± 0.349µs | 371.406µs ± 0.229µs | 371.650µs | 372.001µs | 372.249µs | 372.789µs | 0.37% | 0.292 | 0.553 | 0.09% | 0.025µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2682484.461op/s | 2692376.512op/s ± 2526.246op/s | 2692474.464op/s ± 1660.036op/s | 2694030.205op/s | 2696332.609op/s | 2697477.360op/s | 2698581.895op/s | 0.23% | -0.285 | 0.540 | 0.09% | 178.633op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 167.925µs | 168.225µs ± 0.151µs | 168.216µs ± 0.105µs | 168.320µs | 168.482µs | 168.600µs | 168.731µs | 0.31% | 0.410 | -0.090 | 0.09% | 0.011µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5926606.924op/s | 5944427.991op/s ± 5331.846op/s | 5944751.945op/s ± 3722.788op/s | 5948487.189op/s | 5952198.447op/s | 5954211.354op/s | 5955044.642op/s | 0.17% | -0.406 | -0.098 | 0.09% | 377.018op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.872µs | 37.081µs ± 0.088µs | 37.085µs ± 0.048µs | 37.132µs | 37.178µs | 37.239µs | 37.785µs | 1.89% | 2.260 | 18.892 | 0.24% | 0.006µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26465212.196op/s | 26967917.348op/s ± 63771.358op/s | 26965292.663op/s ± 34758.677op/s | 26999968.818op/s | 27066292.547op/s | 27099446.262op/s | 27120956.853op/s | 0.58% | -2.150 | 17.864 | 0.24% | 4509.316op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.287µs | 46.441µs ± 0.072µs | 46.431µs ± 0.051µs | 46.486µs | 46.575µs | 46.619µs | 46.677µs | 0.53% | 0.449 | 0.023 | 0.16% | 0.005µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21423838.509op/s | 21532876.523op/s ± 33446.014op/s | 21537185.875op/s ± 23841.527op/s | 21558086.307op/s | 21582298.232op/s | 21597743.530op/s | 21604310.369op/s | 0.31% | -0.440 | 0.011 | 0.15% | 2364.990op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [496.509µs; 496.890µs] or [-0.038%; +0.038%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2012540.332op/s; 2014072.608op/s] or [-0.038%; +0.038%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [371.371µs; 371.468µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2692026.399op/s; 2692726.625op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.204µs; 168.246µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5943689.049op/s; 5945166.934op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.069µs; 37.094µs] or [-0.033%; +0.033%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26959079.251op/s; 26976755.445op/s] or [-0.033%; +0.033%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.431µs; 46.451µs] or [-0.022%; +0.022%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21528241.227op/s; 21537511.819op/s] or [-0.022%; +0.022%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 13.975ms | 14.020ms ± 0.029ms | 14.014ms ± 0.012ms | 14.029ms | 14.073ms | 14.118ms | 14.185ms | 1.22% | 2.220 | 7.742 | 0.21% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.016ms; 14.024ms] or [-0.029%; +0.029%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.337µs | 2.365µs ± 0.015µs | 2.361µs ± 0.005µs | 2.370µs | 2.406µs | 2.412µs | 2.419µs | 2.49% | 1.818 | 3.479 | 0.61% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.363µs; 2.367µs] or [-0.085%; +0.085%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.343ns | 192.909ns ± 2.166ns | 192.451ns ± 1.497ns | 194.309ns | 196.946ns | 200.370ns | 201.954ns | 4.94% | 1.288 | 2.121 | 1.12% | 0.153ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.609ns; 193.210ns] or [-0.156%; +0.156%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 737.294µs | 738.358µs ± 0.489µs | 738.349µs ± 0.331µs | 738.659µs | 739.089µs | 739.727µs | 740.415µs | 0.28% | 0.619 | 1.410 | 0.07% | 0.035µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [738.290µs; 738.426µs] or [-0.009%; +0.009%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_serialize_compressed_pprof_timestamped_x1000 | execution_time | 912.443µs | 915.506µs ± 1.771µs | 915.417µs ± 0.763µs | 916.203µs | 917.172µs | 918.331µs | 935.422µs | 2.19% | 7.151 | 78.294 | 0.19% | 0.125µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_serialize_compressed_pprof_timestamped_x1000 | execution_time | [915.261µs; 915.751µs] or [-0.027%; +0.027%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 34.048µs | 34.733µs ± 1.228µs | 34.165µs ± 0.050µs | 34.254µs | 37.379µs | 37.425µs | 37.980µs | 11.17% | 1.697 | 0.920 | 3.53% | 0.087µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.563µs; 34.903µs] or [-0.490%; +0.490%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | 4.149ms | 4.154ms ± 0.008ms | 4.153ms ± 0.001ms | 4.155ms | 4.160ms | 4.174ms | 4.252ms | 2.39% | 9.341 | 106.748 | 0.19% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | [4.153ms; 4.155ms] or [-0.027%; +0.027%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.583ms | 3.617ms ± 0.017ms | 3.613ms ± 0.008ms | 3.624ms | 3.650ms | 3.676ms | 3.680ms | 1.87% | 1.144 | 1.596 | 0.48% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.614ms; 3.619ms] or [-0.066%; +0.066%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 5.417µs | 5.472µs ± 0.026µs | 5.471µs ± 0.020µs | 5.492µs | 5.512µs | 5.533µs | 5.552µs | 1.48% | 0.216 | -0.527 | 0.48% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [5.469µs; 5.476µs] or [-0.067%; +0.067%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 162.812µs | 163.402µs ± 0.362µs | 163.395µs ± 0.257µs | 163.600µs | 164.082µs | 164.463µs | 164.850µs | 0.89% | 0.826 | 0.962 | 0.22% | 0.026µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [163.352µs; 163.452µs] or [-0.031%; +0.031%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 185.629µs | 186.080µs ± 0.283µs | 186.043µs ± 0.172µs | 186.227µs | 186.541µs | 186.885µs | 187.962µs | 1.03% | 2.019 | 9.757 | 0.15% | 0.020µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5320213.873op/s | 5374052.633op/s ± 8150.275op/s | 5375098.414op/s ± 4954.533op/s | 5379779.328op/s | 5384120.476op/s | 5385676.256op/s | 5387085.483op/s | 0.22% | -1.984 | 9.483 | 0.15% | 576.312op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.797µs | 17.875µs ± 0.030µs | 17.873µs ± 0.015µs | 17.889µs | 17.929µs | 17.953µs | 18.003µs | 0.73% | 0.500 | 1.768 | 0.17% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 55545736.865op/s | 55943791.503op/s ± 95372.392op/s | 55949334.318op/s ± 48065.019op/s | 55997312.129op/s | 56078909.162op/s | 56176772.795op/s | 56190766.631op/s | 0.43% | -0.482 | 1.735 | 0.17% | 6743.846op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.529µs | 10.580µs ± 0.023µs | 10.576µs ± 0.014µs | 10.596µs | 10.622µs | 10.634µs | 10.649µs | 0.69% | 0.217 | 0.051 | 0.21% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 93907662.161op/s | 94521585.642op/s ± 203023.283op/s | 94552439.972op/s ± 123446.250op/s | 94644221.527op/s | 94879503.536op/s | 94930063.007op/s | 94979840.529op/s | 0.45% | -0.205 | 0.042 | 0.21% | 14355.914op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [186.041µs; 186.119µs] or [-0.021%; +0.021%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5372923.083op/s; 5375182.183op/s] or [-0.021%; +0.021%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.871µs; 17.879µs] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55930573.807op/s; 55957009.199op/s] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.576µs; 10.583µs] or [-0.030%; +0.030%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [94493448.567op/s; 94549722.716op/s] or [-0.030%; +0.030%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 48.957ms | 49.201ms ± 0.761ms | 49.078ms ± 0.065ms | 49.155ms | 49.338ms | 51.644ms | 57.650ms | 17.47% | 8.786 | 85.380 | 1.54% | 0.054ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.096ms; 49.307ms] or [-0.214%; +0.214%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 285.850µs | 286.358µs ± 0.485µs | 286.282µs ± 0.143µs | 286.445µs | 286.692µs | 288.261µs | 291.298µs | 1.75% | 6.718 | 58.911 | 0.17% | 0.034µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [286.291µs; 286.425µs] or [-0.023%; +0.023%] | None | None | None |
Group 20
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.897µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.923µs | 3.923µs | 0.23% | -0.596 | 6.469 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254875618.006op/s | 255437041.454op/s ± 190544.562op/s | 255452233.656op/s ± 110751.235op/s | 255556063.529op/s | 255668407.934op/s | 255728991.524op/s | 256613778.393op/s | 0.45% | 0.615 | 6.573 | 0.07% | 13473.535op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.173µs | 79.881µs ± 0.165µs | 79.901µs ± 0.071µs | 79.977µs | 80.073µs | 80.134µs | 80.409µs | 0.64% | -1.627 | 4.824 | 0.21% | 0.012µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12436481.411op/s | 12518633.413op/s ± 25944.548op/s | 12515532.049op/s ± 11142.427op/s | 12525218.185op/s | 12561793.795op/s | 12612996.733op/s | 12630536.849op/s | 0.92% | 1.652 | 4.896 | 0.21% | 1834.557op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.853µs | 67.975µs ± 0.083µs | 67.967µs ± 0.044µs | 68.013µs | 68.089µs | 68.157µs | 68.673µs | 1.04% | 3.265 | 24.077 | 0.12% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14561737.932op/s | 14711375.801op/s ± 17801.190op/s | 14713115.375op/s ± 9599.939op/s | 14722589.362op/s | 14733183.246op/s | 14736120.656op/s | 14737691.986op/s | 0.17% | -3.209 | 23.461 | 0.12% | 1258.734op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.923µs | 3.924µs | 0.23% | -0.858 | 6.638 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254866605.512op/s | 255438022.565op/s ± 210831.583op/s | 255451681.329op/s ± 130460.820op/s | 255569054.759op/s | 255710623.727op/s | 255805015.250op/s | 256763378.528op/s | 0.51% | 0.878 | 6.762 | 0.08% | 14908.044op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.796µs | 64.911µs ± 0.048µs | 64.907µs ± 0.033µs | 64.941µs | 64.998µs | 65.017µs | 65.031µs | 0.19% | 0.275 | -0.509 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15377171.765op/s | 15405808.496op/s ± 11440.276op/s | 15406676.370op/s ± 7872.309op/s | 15414148.205op/s | 15423632.199op/s | 15427543.555op/s | 15432976.128op/s | 0.17% | -0.271 | -0.510 | 0.07% | 808.950op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.464µs | 45.646µs ± 0.082µs | 45.647µs ± 0.057µs | 45.702µs | 45.783µs | 45.830µs | 45.844µs | 0.43% | 0.046 | -0.330 | 0.18% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21813081.523op/s | 21907875.596op/s ± 39216.240op/s | 21907434.524op/s ± 27564.398op/s | 21934936.045op/s | 21975592.373op/s | 21992122.906op/s | 21995365.576op/s | 0.40% | -0.037 | -0.332 | 0.18% | 2773.007op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.828µs | 6.840µs ± 0.005µs | 6.839µs ± 0.003µs | 6.843µs | 6.850µs | 6.852µs | 6.853µs | 0.20% | 0.302 | -0.566 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 145925307.588op/s | 146201322.663op/s ± 116468.111op/s | 146216831.866op/s ± 70203.016op/s | 146280113.219op/s | 146380408.976op/s | 146422593.341op/s | 146451665.345op/s | 0.16% | -0.299 | -0.567 | 0.08% | 8235.539op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.916µs | 3.919µs | 3.922µs | 3.924µs | 0.23% | -1.196 | 10.626 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254860275.223op/s | 255437440.775op/s ± 187512.108op/s | 255434991.842op/s ± 108264.077op/s | 255550471.220op/s | 255682073.762op/s | 255716279.739op/s | 256740106.060op/s | 0.51% | 1.221 | 10.802 | 0.07% | 13259.108op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.113µs | 65.730µs ± 0.076µs | 65.730µs ± 0.026µs | 65.764µs | 65.811µs | 65.829µs | 65.870µs | 0.21% | -5.025 | 37.495 | 0.12% | 0.005µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15181470.668op/s | 15213842.867op/s ± 17759.382op/s | 15213673.812op/s ± 6083.694op/s | 15218410.676op/s | 15228759.407op/s | 15261509.968op/s | 15357843.783op/s | 0.95% | 5.075 | 37.999 | 0.12% | 1255.778op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.373µs | 53.435µs ± 0.036µs | 53.427µs ± 0.020µs | 53.453µs | 53.500µs | 53.554µs | 53.620µs | 0.36% | 1.449 | 3.496 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18649713.152op/s | 18714438.402op/s ± 12751.194op/s | 18717235.194op/s ± 7074.710op/s | 18723049.675op/s | 18729396.077op/s | 18733269.417op/s | 18736083.724op/s | 0.10% | -1.443 | 3.460 | 0.07% | 901.646op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.896µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.921µs | 3.925µs | 0.29% | -0.660 | 9.177 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254766832.011op/s | 255481731.791op/s ± 184295.054op/s | 255495746.027op/s ± 102723.285op/s | 255591955.596op/s | 255694662.918op/s | 255782787.313op/s | 256690014.909op/s | 0.47% | 0.683 | 9.304 | 0.07% | 13031.628op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.152µs | 50.221µs ± 0.038µs | 50.214µs ± 0.022µs | 50.241µs | 50.286µs | 50.318µs | 50.396µs | 0.36% | 0.973 | 1.642 | 0.08% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19842653.709op/s | 19911812.451op/s ± 15063.037op/s | 19914670.615op/s ± 8863.856op/s | 19922258.367op/s | 19932519.949op/s | 19936126.148op/s | 19939282.890op/s | 0.12% | -0.967 | 1.617 | 0.08% | 1065.118op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.451µs | 45.645µs ± 0.078µs | 45.648µs ± 0.060µs | 45.706µs | 45.773µs | 45.815µs | 45.851µs | 0.44% | -0.121 | -0.300 | 0.17% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21809948.112op/s | 21908095.359op/s ± 37598.397op/s | 21906934.960op/s ± 28597.119op/s | 21936534.321op/s | 21972868.463op/s | 21993147.133op/s | 22001485.100op/s | 0.43% | 0.130 | -0.298 | 0.17% | 2658.608op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.828µs | 6.838µs ± 0.005µs | 6.837µs ± 0.004µs | 6.842µs | 6.846µs | 6.850µs | 6.869µs | 0.47% | 1.182 | 4.528 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 145589928.799op/s | 146246039.049op/s ± 112519.465op/s | 146269553.992op/s ± 80753.740op/s | 146329917.155op/s | 146395963.286op/s | 146429752.743op/s | 146458321.445op/s | 0.13% | -1.170 | 4.450 | 0.08% | 7956.328op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255410633.810op/s; 255463449.098op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.858µs; 79.904µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12515037.748op/s; 12522229.078op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.963µs; 67.986µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14708908.728op/s; 14713842.875op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255408803.335op/s; 255467241.795op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.904µs; 64.917µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15404222.984op/s; 15407394.009op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.635µs; 45.657µs] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21902440.602op/s; 21913310.589op/s] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.839µs; 6.841µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [146185181.303op/s; 146217464.023op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255411453.400op/s; 255463428.150op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.719µs; 65.740µs] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15211381.588op/s; 15216304.146op/s] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.430µs; 53.440µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18712671.209op/s; 18716205.594op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255456190.269op/s; 255507273.313op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.216µs; 50.227µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19909724.859op/s; 19913900.043op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.635µs; 45.656µs] or [-0.024%; +0.024%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21902884.583op/s; 21913306.135op/s] or [-0.024%; +0.024%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.837µs; 6.839µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [146230444.934op/s; 146261633.165op/s] or [-0.011%; +0.011%] | None | None | None |
Group 21
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 963d11b | 1774533889 | igor/versioning/use-commit-headless-and-check-deps |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 243.636ns | 254.924ns ± 12.789ns | 250.416ns ± 4.048ns | 255.873ns | 286.632ns | 296.764ns | 300.660ns | 20.06% | 1.803 | 2.338 | 5.00% | 0.904ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [253.152ns; 256.696ns] or [-0.695%; +0.695%] | None | None | None |
Baseline
Omitted due to size.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1763 +/- ##
==========================================
+ Coverage 71.10% 71.11% +0.01%
==========================================
Files 411 411
Lines 64989 64989
==========================================
+ Hits 46209 46219 +10
+ Misses 18780 18770 -10
🚀 New features to boost your workflow:
|
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
|
✅ Tests 🎉 All green!❄️ No new flaky tests detected 🎯 Code Coverage (details) 🔗 Commit SHA: 963d11b | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
What does this PR do?
release-proposal-testingandrelease-testingbranch prefixes are used instead of the "official" ones.