fix(ci): Address semver job issue#1704
fix(ci): Address semver job issue#1704gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
Conversation
BenchmarksComparisonBenchmark execution time: 2026-03-11 09:41:03 Comparing candidate commit f74acb2 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.649ms | 10.676ms ± 0.015ms | 10.674ms ± 0.008ms | 10.682ms | 10.696ms | 10.726ms | 10.780ms | 0.99% | 2.466 | 13.343 | 0.14% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.674ms; 10.678ms] or [-0.019%; +0.019%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 48.451ms | 48.816ms ± 1.018ms | 48.671ms ± 0.044ms | 48.713ms | 48.895ms | 53.683ms | 59.012ms | 21.25% | 8.139 | 69.986 | 2.08% | 0.072ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [48.675ms; 48.957ms] or [-0.289%; +0.289%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.899µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.916µs | 3.919µs | 3.921µs | 3.935µs | 0.52% | 1.147 | 15.959 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254129302.661op/s | 255428259.681op/s ± 183784.207op/s | 255445418.196op/s ± 97596.794op/s | 255538322.899op/s | 255635362.200op/s | 255716831.219op/s | 256463013.545op/s | 0.40% | -1.111 | 15.841 | 0.07% | 12995.506op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.573µs | 80.191µs ± 0.086µs | 80.198µs ± 0.043µs | 80.233µs | 80.282µs | 80.322µs | 80.595µs | 0.49% | -2.711 | 22.767 | 0.11% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12407743.464op/s | 12470279.589op/s ± 13407.175op/s | 12469076.690op/s ± 6633.509op/s | 12476374.737op/s | 12484847.640op/s | 12492230.436op/s | 12567059.084op/s | 0.79% | 2.767 | 23.089 | 0.11% | 948.030op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.801µs | 67.921µs ± 0.082µs | 67.914µs ± 0.037µs | 67.947µs | 68.038µs | 68.195µs | 68.602µs | 1.01% | 3.643 | 24.318 | 0.12% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14576741.174op/s | 14723049.716op/s ± 17804.212op/s | 14724406.370op/s ± 7975.820op/s | 14733355.875op/s | 14743083.736op/s | 14746955.909op/s | 14748945.052op/s | 0.17% | -3.596 | 23.815 | 0.12% | 1258.948op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.903µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.923µs | 3.924µs | 0.25% | 0.330 | 1.312 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254835719.729op/s | 255425163.537op/s ± 188323.965op/s | 255460301.493op/s ± 114824.209op/s | 255556535.496op/s | 255654480.500op/s | 255783003.691op/s | 256215070.641op/s | 0.30% | -0.323 | 1.323 | 0.07% | 13316.515op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.605µs | 64.713µs ± 0.053µs | 64.711µs ± 0.035µs | 64.748µs | 64.796µs | 64.828µs | 64.908µs | 0.31% | 0.460 | 0.547 | 0.08% | 0.004µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15406349.424op/s | 15452841.642op/s ± 12619.882op/s | 15453343.266op/s ± 8279.442op/s | 15460949.507op/s | 15471555.236op/s | 15477378.728op/s | 15478707.490op/s | 0.16% | -0.454 | 0.532 | 0.08% | 892.360op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.457µs | 45.720µs ± 0.101µs | 45.717µs ± 0.074µs | 45.795µs | 45.879µs | 45.909µs | 45.933µs | 0.47% | -0.194 | -0.541 | 0.22% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21770954.842op/s | 21872226.132op/s ± 48107.047op/s | 21873731.841op/s ± 35206.198op/s | 21904726.494op/s | 21955785.480op/s | 21976489.641op/s | 21998843.001op/s | 0.57% | 0.204 | -0.535 | 0.22% | 3401.682op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.579µs | 6.632µs ± 0.011µs | 6.635µs ± 0.003µs | 6.638µs | 6.642µs | 6.646µs | 6.662µs | 0.42% | -1.975 | 5.996 | 0.16% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150095330.415op/s | 150790791.351op/s ± 244608.522op/s | 150724513.272op/s ± 76945.723op/s | 150822320.009op/s | 151244616.608op/s | 151632937.636op/s | 152004766.708op/s | 0.85% | 1.995 | 6.087 | 0.16% | 17296.434op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.898µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.917µs | 3.919µs | 3.921µs | 3.921µs | 0.15% | -1.451 | 10.392 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255037591.582op/s | 255411991.912op/s ± 163282.190op/s | 255419782.265op/s ± 86977.174op/s | 255492878.049op/s | 255628270.935op/s | 255775310.925op/s | 256545475.548op/s | 0.44% | 1.471 | 10.542 | 0.06% | 11545.794op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.989µs | 65.694µs ± 0.084µs | 65.701µs ± 0.032µs | 65.730µs | 65.787µs | 65.800µs | 65.803µs | 0.15% | -5.167 | 38.554 | 0.13% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15196963.071op/s | 15222129.863op/s ± 19584.740op/s | 15220426.091op/s ± 7345.543op/s | 15228493.090op/s | 15238844.086op/s | 15291990.335op/s | 15387287.466op/s | 1.10% | 5.221 | 39.112 | 0.13% | 1384.850op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.353µs | 53.443µs ± 0.039µs | 53.440µs ± 0.030µs | 53.471µs | 53.508µs | 53.531µs | 53.553µs | 0.21% | 0.255 | -0.438 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18673077.227op/s | 18711610.286op/s ± 13823.232op/s | 18712721.062op/s ± 10576.767op/s | 18722631.534op/s | 18731639.165op/s | 18736525.258op/s | 18743152.020op/s | 0.16% | -0.252 | -0.441 | 0.07% | 977.450op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.922µs | 3.922µs | 0.19% | -1.178 | 7.656 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254946154.973op/s | 255421941.433op/s ± 199421.351op/s | 255424075.195op/s ± 135007.786op/s | 255558874.381op/s | 255692594.054op/s | 255767984.319op/s | 256725814.419op/s | 0.51% | 1.198 | 7.796 | 0.08% | 14101.219op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.149µs | 50.222µs ± 0.033µs | 50.220µs ± 0.020µs | 50.240µs | 50.277µs | 50.311µs | 50.339µs | 0.24% | 0.585 | 0.716 | 0.07% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19865133.621op/s | 19911527.639op/s ± 13029.329op/s | 19912551.045op/s ± 8116.526op/s | 19921138.686op/s | 19931021.724op/s | 19938605.307op/s | 19940567.140op/s | 0.14% | -0.581 | 0.707 | 0.07% | 921.313op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.413µs | 45.713µs ± 0.103µs | 45.716µs ± 0.074µs | 45.792µs | 45.849µs | 45.889µs | 45.944µs | 0.50% | -0.502 | -0.138 | 0.22% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21765532.540op/s | 21875932.099op/s ± 49201.317op/s | 21874396.020op/s ± 35302.732op/s | 21907395.986op/s | 21960190.138op/s | 21999200.264op/s | 22019927.129op/s | 0.67% | 0.513 | -0.121 | 0.22% | 3479.058op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.575µs | 6.630µs ± 0.013µs | 6.635µs ± 0.005µs | 6.638µs | 6.644µs | 6.647µs | 6.653µs | 0.27% | -1.531 | 2.457 | 0.20% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150314101.722op/s | 150826670.723op/s ± 296706.398op/s | 150726792.628op/s ± 108902.679op/s | 150955378.237op/s | 151427883.512op/s | 151676744.411op/s | 152089814.777op/s | 0.90% | 1.543 | 2.510 | 0.20% | 20980.311op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.915µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255402788.958op/s; 255453730.405op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.179µs; 80.203µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12468421.483op/s; 12472137.694op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.909µs; 67.932µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14720582.224op/s; 14725517.209op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.915µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255399063.647op/s; 255451263.427op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.706µs; 64.720µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15451092.648op/s; 15454590.636op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.706µs; 45.734µs] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21865558.958op/s; 21878893.306op/s] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.630µs; 6.633µs] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [150756890.962op/s; 150824691.739op/s] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.915µs; 3.916µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255389362.571op/s; 255434621.253op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.682µs; 65.706µs] or [-0.018%; +0.018%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15219415.606op/s; 15224844.119op/s] or [-0.018%; +0.018%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.437µs; 53.448µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18709694.519op/s; 18713526.053op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255394303.551op/s; 255449579.314op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.218µs; 50.227µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19909721.899op/s; 19913333.379op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.698µs; 45.727µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21869113.270op/s; 21882750.929op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.628µs; 6.632µs] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [150785550.070op/s; 150867791.377op/s] or [-0.027%; +0.027%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.319µs | 146.985µs ± 1.857µs | 146.641µs ± 0.525µs | 147.282µs | 149.014µs | 153.232µs | 165.000µs | 12.52% | 5.951 | 48.996 | 1.26% | 0.131µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.728µs; 147.242µs] or [-0.175%; +0.175%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.364µs | 2.430µs ± 0.019µs | 2.428µs ± 0.007µs | 2.438µs | 2.465µs | 2.471µs | 2.473µs | 1.84% | -0.583 | 2.031 | 0.78% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.428µs; 2.433µs] or [-0.109%; +0.109%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.679µs | 25.355µs ± 9.208µs | 18.021µs ± 0.200µs | 34.010µs | 41.603µs | 42.235µs | 59.713µs | 231.35% | 0.762 | -0.447 | 36.23% | 0.651µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.079µs; 26.631µs] or [-5.033%; +5.033%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 735.700µs | 737.313µs ± 0.638µs | 737.245µs ± 0.351µs | 737.671µs | 738.571µs | 739.141µs | 739.354µs | 0.29% | 0.502 | 0.578 | 0.09% | 0.045µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [737.225µs; 737.402µs] or [-0.012%; +0.012%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.207µs | 3.233µs ± 1.442µs | 3.027µs ± 0.024µs | 3.050µs | 3.701µs | 13.973µs | 14.886µs | 391.84% | 7.380 | 55.484 | 44.49% | 0.102µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.034µs; 3.433µs] or [-6.181%; +6.181%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.710ns | 193.223ns ± 2.013ns | 192.837ns ± 1.192ns | 194.098ns | 197.447ns | 199.053ns | 199.696ns | 3.56% | 1.075 | 0.681 | 1.04% | 0.142ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.944ns; 193.502ns] or [-0.144%; +0.144%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.008µs | 33.839µs ± 1.033µs | 33.252µs ± 0.128µs | 34.862µs | 35.805µs | 35.882µs | 37.012µs | 11.31% | 1.065 | -0.526 | 3.05% | 0.073µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.695µs; 33.982µs] or [-0.423%; +0.423%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 164.601µs | 165.122µs ± 0.284µs | 165.066µs ± 0.143µs | 165.237µs | 165.637µs | 166.159µs | 166.379µs | 0.80% | 1.680 | 4.299 | 0.17% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [165.082µs; 165.161µs] or [-0.024%; +0.024%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 205.990µs | 206.583µs ± 0.436µs | 206.476µs ± 0.242µs | 206.781µs | 207.331µs | 207.841µs | 209.372µs | 1.40% | 1.966 | 7.657 | 0.21% | 0.031µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4776181.056op/s | 4840679.942op/s ± 10165.384op/s | 4843173.779op/s ± 5670.104op/s | 4848122.411op/s | 4851514.260op/s | 4854488.575op/s | 4854608.414op/s | 0.24% | -1.930 | 7.363 | 0.21% | 718.801op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.618µs | 18.706µs ± 0.086µs | 18.677µs ± 0.017µs | 18.700µs | 18.884µs | 19.054µs | 19.085µs | 2.19% | 2.244 | 4.952 | 0.46% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 52396821.556op/s | 53460513.229op/s ± 244415.380op/s | 53542943.467op/s ± 47315.457op/s | 53582221.238op/s | 53675587.081op/s | 53696437.301op/s | 53712684.478op/s | 0.32% | -2.218 | 4.801 | 0.46% | 17282.777op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.754µs | 10.871µs ± 0.055µs | 10.862µs ± 0.037µs | 10.907µs | 10.971µs | 10.997µs | 11.047µs | 1.70% | 0.543 | 0.006 | 0.51% | 0.004µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 90523940.127op/s | 91993276.185op/s ± 464636.667op/s | 92062168.298op/s ± 309734.472op/s | 92321088.230op/s | 92685992.703op/s | 92783435.434op/s | 92985949.184op/s | 1.00% | -0.517 | -0.034 | 0.50% | 32854.774op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [206.523µs; 206.644µs] or [-0.029%; +0.029%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4839271.117op/s; 4842088.766op/s] or [-0.029%; +0.029%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.694µs; 18.718µs] or [-0.064%; +0.064%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [53426639.608op/s; 53494386.850op/s] or [-0.063%; +0.063%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.863µs; 10.878µs] or [-0.070%; +0.070%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [91928882.011op/s; 92057670.358op/s] or [-0.070%; +0.070%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 245.885ns | 255.324ns ± 11.103ns | 249.441ns ± 2.611ns | 257.487ns | 282.360ns | 286.308ns | 288.371ns | 15.61% | 1.552 | 1.252 | 4.34% | 0.785ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [253.785ns; 256.862ns] or [-0.603%; +0.603%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.563ms | 3.600ms ± 0.018ms | 3.596ms ± 0.010ms | 3.607ms | 3.636ms | 3.650ms | 3.663ms | 1.84% | 1.117 | 1.146 | 0.49% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.597ms; 3.602ms] or [-0.068%; +0.068%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 88.455µs | 88.677µs ± 0.146µs | 88.651µs ± 0.052µs | 88.706µs | 88.894µs | 89.110µs | 90.025µs | 1.55% | 4.580 | 35.631 | 0.16% | 0.010µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [88.657µs; 88.697µs] or [-0.023%; +0.023%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.127ms | 4.133ms ± 0.006ms | 4.133ms ± 0.002ms | 4.134ms | 4.137ms | 4.140ms | 4.213ms | 1.94% | 10.770 | 135.328 | 0.15% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.132ms; 4.134ms] or [-0.021%; +0.021%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 13.887ms | 13.961ms ± 0.033ms | 13.955ms ± 0.016ms | 13.974ms | 14.026ms | 14.060ms | 14.127ms | 1.23% | 1.604 | 4.570 | 0.23% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [13.956ms; 13.965ms] or [-0.032%; +0.032%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.945µs | 5.022µs ± 0.040µs | 5.035µs ± 0.033µs | 5.054µs | 5.072µs | 5.075µs | 5.123µs | 1.76% | -0.219 | -1.321 | 0.79% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.017µs; 5.028µs] or [-0.110%; +0.110%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f74acb2 | 1773220916 | gleocadie/fix-semver-check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 493.267µs | 494.061µs ± 0.447µs | 493.973µs ± 0.277µs | 494.306µs | 494.733µs | 495.329µs | 497.144µs | 0.64% | 2.081 | 10.713 | 0.09% | 0.032µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 2011489.404op/s | 2024043.956op/s ± 1826.157op/s | 2024402.485op/s ± 1132.861op/s | 2025283.356op/s | 2026254.917op/s | 2026834.524op/s | 2027300.302op/s | 0.14% | -2.059 | 10.523 | 0.09% | 129.129op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.146µs | 370.797µs ± 0.244µs | 370.789µs ± 0.166µs | 370.962µs | 371.193µs | 371.436µs | 371.500µs | 0.19% | 0.236 | 0.172 | 0.07% | 0.017µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2691791.616op/s | 2696891.791op/s ± 1777.016op/s | 2696951.636op/s ± 1207.158op/s | 2698065.423op/s | 2699864.641op/s | 2700580.742op/s | 2701635.382op/s | 0.17% | -0.232 | 0.169 | 0.07% | 125.654op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 167.318µs | 167.633µs ± 0.131µs | 167.628µs ± 0.092µs | 167.719µs | 167.838µs | 167.924µs | 168.048µs | 0.25% | 0.172 | -0.278 | 0.08% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5950687.346op/s | 5965408.483op/s ± 4650.733op/s | 5965587.578op/s ± 3279.761op/s | 5968817.719op/s | 5972476.801op/s | 5974554.539op/s | 5976647.432op/s | 0.19% | -0.168 | -0.282 | 0.08% | 328.856op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.098µs | 37.234µs ± 0.042µs | 37.229µs ± 0.025µs | 37.258µs | 37.311µs | 37.335µs | 37.378µs | 0.40% | 0.304 | 0.915 | 0.11% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26754015.136op/s | 26857121.862op/s ± 30111.456op/s | 26860852.303op/s ± 18137.192op/s | 26876365.184op/s | 26900238.135op/s | 26930929.509op/s | 26955320.846op/s | 0.35% | -0.295 | 0.914 | 0.11% | 2129.201op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 45.381µs | 45.621µs ± 0.118µs | 45.633µs ± 0.100µs | 45.720µs | 45.789µs | 45.838µs | 45.869µs | 0.52% | -0.115 | -1.104 | 0.26% | 0.008µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21801031.673op/s | 21920023.875op/s ± 56922.589op/s | 21914021.851op/s ± 48181.449op/s | 21968566.643op/s | 22006129.907op/s | 22025486.610op/s | 22035691.454op/s | 0.56% | 0.122 | -1.103 | 0.26% | 4025.035op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [493.999µs; 494.123µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2023790.868op/s; 2024297.044op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [370.764µs; 370.831µs] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2696645.514op/s; 2697138.069op/s] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [167.615µs; 167.651µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5964763.936op/s; 5966053.030op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.228µs; 37.240µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26852948.704op/s; 26861295.021op/s] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.604µs; 45.637µs] or [-0.036%; +0.036%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21912134.952op/s; 21927912.799op/s] or [-0.036%; +0.036%] | None | None | None |
Baseline
Omitted due to size.
Clippy Allow Annotation ReportComparing clippy allow annotations between branches:
Summary by Rule
Annotation Counts by File
Annotation Stats by Crate
About This ReportThis report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1704 +/- ##
==========================================
- Coverage 71.18% 71.18% -0.01%
==========================================
Files 429 429
Lines 63503 63503
==========================================
- Hits 45207 45204 -3
- Misses 18296 18299 +3
🚀 New features to boost your workflow:
|
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
c8a4b19
into
main
What does this PR do?
Adds a
git clonefallback tolibdd-libunwind-sys/build.rsfor obtaining the libunwind source when the crate is built outside of a git repository.The source acquisition logic is now structured as three steps:
libunwind/srcalready exists (submodule checked out, or files copied in), do nothing..gitexists), trygit submodule update --init --recursive.git clone --depth 1of the libunwind repository directly.Motivation
The
semver-checkCI job runscargo-semver-checks --baseline-rev origin/main, which extracts the baseline source into a plain directory undertarget/semver-checks/git-origin_main/<commit>/. This directory has no.git— it's a raw file extraction, not a git clone or worktree.When building the baseline version of
libdd-crashtracker, cargo needs to compile its dependencylibdd-libunwind-sys, which triggersbuild.rs. The previous implementation unconditionally rangit submodule update --initassuming it was inside a git repo, which failed with:This is not reproducible locally because a normal
git cloneproperly initializes the submodule, andbuild.rsskips the git commands entirely whenlibunwind/srcis already present.Additional Notes
mainbefore other branches that modifylibdd-crashtrackercan pass thesemver-checkCI job. This is becausecargo-semver-checksuses the baseline (main) version ofbuild.rswhen building the baseline, not the branch's version.LIBUNWIND_REPO,LIBUNWIND_BRANCH) to keep them in sync with.gitmodules.git clonefallback also covers other non-git contexts such ascargo vendoror any tool that extracts crate source without preserving git metadata.How to test the change?