Skip to content

Conversation

@watson
Copy link
Contributor

@watson watson commented Jan 15, 2025

What does this PR do?

Remove env from list of tokens to redact from Dynamic Instrumentation probe snapshots.

Motivation

Feature parity

Additional Notes

Depends on: DataDog/system-tests#3827

@watson watson requested a review from a team as a code owner January 15, 2025 19:48
@pr-commenter
Copy link

pr-commenter bot commented Jan 15, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-01-21 13:52:32

Comparing candidate commit a4110ec in PR branch watson/env-redaction with baseline commit afa69e9 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.274µs 4.288µs ± 0.005µs 4.287µs ± 0.001µs 4.289µs 4.292µs 4.294µs 4.347µs 1.39% 8.361 97.208 0.12% 0.000µs 1 200
credit_card/is_card_number/ throughput 230039012.960op/s 233227325.436op/s ± 270319.361op/s 233240628.598op/s ± 71215.122op/s 233305809.317op/s 233469281.573op/s 233530371.647op/s 233986798.050op/s 0.32% -8.259 95.659 0.12% 19114.465op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 89.177µs 90.771µs ± 0.671µs 90.767µs ± 0.409µs 91.182µs 91.744µs 92.041µs 95.388µs 5.09% 1.472 9.847 0.74% 0.047µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10483553.430op/s 11017316.611op/s ± 80678.630op/s 11017222.118op/s ± 49588.771op/s 11066696.990op/s 11144013.731op/s 11191014.428op/s 11213622.025op/s 1.78% -1.270 8.321 0.73% 5704.841op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 83.065µs 83.663µs ± 0.385µs 83.639µs ± 0.115µs 83.768µs 83.890µs 83.987µs 88.515µs 5.83% 10.013 124.434 0.46% 0.027µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11297523.385op/s 11952988.118op/s ± 52641.047op/s 11956176.432op/s ± 16510.875op/s 11971619.481op/s 11996023.583op/s 12012128.233op/s 12038728.590op/s 0.69% -9.652 118.552 0.44% 3722.284op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.271µs 4.288µs ± 0.004µs 4.288µs ± 0.001µs 4.289µs 4.292µs 4.295µs 4.332µs 1.04% 5.902 57.561 0.10% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 230831899.168op/s 233209826.336op/s ± 235065.495op/s 233234402.824op/s ± 65711.745op/s 233291910.605op/s 233414346.200op/s 233538910.083op/s 234156991.172op/s 0.40% -5.827 56.721 0.10% 16621.641op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 80.572µs 80.970µs ± 0.147µs 80.969µs ± 0.076µs 81.046µs 81.157µs 81.384µs 82.025µs 1.31% 1.872 12.887 0.18% 0.010µs 1 200
credit_card/is_card_number/378282246310005 throughput 12191336.738op/s 12350226.486op/s ± 22310.299op/s 12350464.756op/s ± 11625.657op/s 12361960.394op/s 12383384.285op/s 12399486.344op/s 12411186.202op/s 0.49% -1.811 12.414 0.18% 1577.576op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.574µs 58.667µs ± 0.042µs 58.664µs ± 0.023µs 58.690µs 58.748µs 58.770µs 58.826µs 0.28% 0.464 0.659 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16999159.287op/s 17045238.453op/s ± 12150.012op/s 17046235.322op/s ± 6769.156op/s 17052273.246op/s 17064337.588op/s 17069991.331op/s 17072407.575op/s 0.15% -0.459 0.650 0.07% 859.136op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.432µs 6.442µs ± 0.008µs 6.441µs ± 0.002µs 6.444µs 6.449µs 6.462µs 6.515µs 1.15% 6.041 48.114 0.13% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 153480533.832op/s 155226379.646op/s ± 195272.231op/s 155247079.221op/s ± 46690.653op/s 155287314.612op/s 155415551.854op/s 155466554.014op/s 155475870.145op/s 0.15% -5.990 47.518 0.13% 13807.832op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.272µs 4.288µs ± 0.002µs 4.288µs ± 0.001µs 4.289µs 4.291µs 4.293µs 4.296µs 0.19% -1.489 11.577 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 232788749.349op/s 233220366.171op/s ± 121143.501op/s 233220786.562op/s ± 61863.806op/s 233280177.017op/s 233393825.494op/s 233561690.696op/s 234057221.924op/s 0.36% 1.507 11.688 0.05% 8566.139op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 68.825µs 69.816µs ± 0.409µs 69.776µs ± 0.277µs 70.080µs 70.495µs 70.698µs 71.138µs 1.95% 0.314 0.081 0.58% 0.029µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14057203.973op/s 14323912.935op/s ± 83743.273op/s 14331532.965op/s ± 56607.568op/s 14380121.735op/s 14463395.145op/s 14486511.219op/s 14529661.644op/s 1.38% -0.280 0.034 0.58% 5921.544op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 63.973µs 64.842µs ± 0.393µs 64.837µs ± 0.266µs 65.085µs 65.605µs 65.682µs 66.053µs 1.88% 0.343 -0.077 0.60% 0.028µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15139306.034op/s 15422583.421op/s ± 93297.444op/s 15423204.779op/s ± 63485.959op/s 15486796.732op/s 15558379.708op/s 15619100.398op/s 15631712.812op/s 1.35% -0.311 -0.110 0.60% 6597.126op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.270µs 4.288µs ± 0.003µs 4.287µs ± 0.001µs 4.289µs 4.292µs 4.293µs 4.295µs 0.17% -1.335 9.383 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 232842789.898op/s 233234745.459op/s ± 139638.467op/s 233238681.551op/s ± 60249.126op/s 233288737.990op/s 233447711.758op/s 233554845.949op/s 234165499.101op/s 0.40% 1.352 9.495 0.06% 9873.931op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 61.477µs 61.914µs ± 0.084µs 61.916µs ± 0.046µs 61.965µs 62.037µs 62.080µs 62.172µs 0.41% -0.975 4.174 0.14% 0.006µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16084426.959op/s 16151477.574op/s ± 22030.574op/s 16151016.390op/s ± 11992.045op/s 16162437.284op/s 16180861.709op/s 16225824.995op/s 16266134.851op/s 0.71% 0.996 4.258 0.14% 1557.797op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.483µs 58.679µs ± 0.050µs 58.673µs ± 0.021µs 58.698µs 58.772µs 58.821µs 58.840µs 0.28% 0.315 1.696 0.09% 0.004µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16995384.908op/s 17041745.065op/s ± 14547.587op/s 17043564.497op/s ± 6106.987op/s 17048680.488op/s 17063964.156op/s 17073404.554op/s 17099119.395op/s 0.33% -0.305 1.701 0.09% 1028.670op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.413µs 6.442µs ± 0.004µs 6.441µs ± 0.002µs 6.443µs 6.448µs 6.453µs 6.462µs 0.31% -0.587 10.797 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154757836.870op/s 155238447.216op/s ± 105004.704op/s 155244538.889op/s ± 42587.721op/s 155285399.292op/s 155378998.577op/s 155446553.770op/s 155931193.880op/s 0.44% 0.612 10.906 0.07% 7424.954op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.287µs; 4.288µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ throughput [233189861.772op/s; 233264789.100op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.678µs; 90.864µs] or [-0.103%; +0.103%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11006135.328op/s; 11028497.893op/s] or [-0.101%; +0.101%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.609µs; 83.716µs] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11945692.575op/s; 11960283.661op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/37828224631 execution_time [4.287µs; 4.289µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/37828224631 throughput [233177248.520op/s; 233242404.153op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.950µs; 80.991µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/378282246310005 throughput [12347134.494op/s; 12353318.479op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [58.662µs; 58.673µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [17043554.578op/s; 17046922.328op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.441µs; 6.443µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/x371413321323331 throughput [155199316.793op/s; 155253442.499op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.287µs; 4.288µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ throughput [233203576.847op/s; 233237155.495op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [69.759µs; 69.872µs] or [-0.081%; +0.081%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14312306.923op/s; 14335518.948op/s] or [-0.081%; +0.081%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [64.788µs; 64.897µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15409653.292op/s; 15435513.549op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.287µs; 4.288µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [233215392.910op/s; 233254098.007op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.902µs; 61.926µs] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16148424.348op/s; 16154530.799op/s] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [58.673µs; 58.686µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [17039728.909op/s; 17043761.221op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.441µs; 6.442µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155223894.574op/s; 155252999.858op/s] or [-0.009%; +0.009%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 182.230µs 188.852µs ± 2.371µs 189.054µs ± 1.594µs 190.507µs 192.665µs 193.926µs 194.081µs 2.66% -0.170 -0.410 1.25% 0.168µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5152490.534op/s 5295974.629op/s ± 66660.761op/s 5289490.547op/s ± 44599.211op/s 5340282.695op/s 5411533.558op/s 5440315.420op/s 5487578.934op/s 3.74% 0.229 -0.378 1.26% 4713.628op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 20.920µs 21.065µs ± 0.088µs 21.052µs ± 0.044µs 21.099µs 21.202µs 21.256µs 21.712µs 3.14% 2.363 13.654 0.42% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 46057055.480op/s 47473032.727op/s ± 196193.057op/s 47502376.704op/s ± 99578.914op/s 47591832.943op/s 47721967.099op/s 47793344.505op/s 47801326.050op/s 0.63% -2.242 12.536 0.41% 13872.944op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 14.187µs 14.279µs ± 0.049µs 14.272µs ± 0.032µs 14.309µs 14.365µs 14.410µs 14.434µs 1.13% 0.637 0.211 0.34% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 69279928.084op/s 70034662.680op/s ± 238804.697op/s 70065887.793op/s ± 155062.713op/s 70213755.217op/s 70376141.609op/s 70449728.540op/s 70486257.759op/s 0.60% -0.619 0.177 0.34% 16886.042op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [188.524µs; 189.181µs] or [-0.174%; +0.174%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5286736.088op/s; 5305213.169op/s] or [-0.174%; +0.174%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [21.053µs; 21.077µs] or [-0.058%; +0.058%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [47445842.256op/s; 47500223.198op/s] or [-0.057%; +0.057%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.272µs; 14.286µs] or [-0.047%; +0.047%] None None None
normalization/normalize_name/normalize_name/good throughput [70001566.645op/s; 70067758.714op/s] or [-0.047%; +0.047%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.428µs 3.309µs ± 1.468µs 3.112µs ± 0.029µs 3.141µs 3.727µs 14.349µs 15.413µs 395.25% 7.470 56.425 44.26% 0.104µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.105µs; 3.512µs] or [-6.150%; +6.150%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.225µs 139.150µs ± 0.309µs 139.105µs ± 0.126µs 139.243µs 139.603µs 140.227µs 141.310µs 1.58% 2.461 13.531 0.22% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.107µs; 139.192µs] or [-0.031%; +0.031%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.567µs 39.474µs ± 1.573µs 38.754µs ± 0.105µs 38.926µs 42.897µs 42.909µs 42.919µs 10.75% 1.691 0.897 3.98% 0.111µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.256µs; 39.692µs] or [-0.552%; +0.552%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 58.937ms 59.125ms ± 0.183ms 59.072ms ± 0.049ms 59.135ms 59.502ms 59.830ms 60.362ms 2.18% 3.361 14.628 0.31% 0.013ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [59.100ms; 59.151ms] or [-0.043%; +0.043%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 701.024µs 702.135µs ± 0.779µs 702.053µs ± 0.406µs 702.438µs 703.151µs 703.856µs 709.713µs 1.09% 4.823 43.125 0.11% 0.055µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1409019.961op/s 1424230.135op/s ± 1572.325op/s 1424393.026op/s ± 824.208op/s 1425237.313op/s 1425867.741op/s 1426358.800op/s 1426484.685op/s 0.15% -4.751 42.186 0.11% 111.180op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 473.001µs 473.835µs ± 0.334µs 473.842µs ± 0.211µs 474.030µs 474.372µs 474.622µs 474.905µs 0.22% 0.096 0.161 0.07% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2105683.828op/s 2110439.408op/s ± 1488.664op/s 2110407.525op/s ± 941.397op/s 2111384.184op/s 2112855.426op/s 2113964.950op/s 2114160.435op/s 0.18% -0.091 0.158 0.07% 105.264op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.479µs 191.041µs ± 0.247µs 191.023µs ± 0.145µs 191.167µs 191.508µs 191.715µs 192.025µs 0.52% 0.710 1.170 0.13% 0.017µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5207654.558op/s 5234500.509op/s ± 6750.431op/s 5234972.760op/s ± 3963.184op/s 5238948.086op/s 5243378.188op/s 5248190.793op/s 5249930.337op/s 0.29% -0.700 1.146 0.13% 477.328op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.254µs 46.359µs ± 0.050µs 46.357µs ± 0.030µs 46.389µs 46.442µs 46.492µs 46.514µs 0.34% 0.437 0.271 0.11% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21498962.145op/s 21570726.799op/s ± 23339.470op/s 21571718.445op/s ± 14166.742op/s 21585550.663op/s 21607573.828op/s 21618320.858op/s 21619876.889op/s 0.22% -0.431 0.262 0.11% 1650.350op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.879µs 49.067µs ± 0.169µs 49.045µs ± 0.045µs 49.093µs 49.164µs 49.748µs 50.568µs 3.11% 6.787 54.768 0.34% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19775257.607op/s 20380603.453op/s ± 68594.272op/s 20389557.735op/s ± 18878.409op/s 20406698.465op/s 20430338.307op/s 20451978.186op/s 20458582.658op/s 0.34% -6.678 53.461 0.34% 4850.347op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [702.027µs; 702.243µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1424012.225op/s; 1424448.044op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [473.789µs; 473.882µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2110233.094op/s; 2110645.723op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [191.006µs; 191.075µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5233564.964op/s; 5235436.054op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.352µs; 46.366µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21567492.173op/s; 21573961.426op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.043µs; 49.090µs] or [-0.048%; +0.048%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20371096.946op/s; 20390109.959op/s] or [-0.047%; +0.047%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.665µs 2.735µs ± 0.023µs 2.735µs ± 0.010µs 2.745µs 2.780µs 2.787µs 2.788µs 1.95% -0.489 1.867 0.83% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.732µs; 2.738µs] or [-0.115%; +0.115%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.603µs 28.297µs ± 14.287µs 18.973µs ± 0.209µs 37.074µs 47.348µs 55.981µs 152.814µs 705.41% 3.909 28.576 50.36% 1.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [26.317µs; 30.277µs] or [-6.997%; +6.997%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 261.743ns 275.245ns ± 14.703ns 268.988ns ± 5.852ns 281.718ns 308.931ns 312.845ns 313.219ns 16.44% 1.254 0.444 5.33% 1.040ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [273.208ns; 277.283ns] or [-0.740%; +0.740%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 69.304µs 69.589µs ± 0.271µs 69.570µs ± 0.070µs 69.640µs 69.741µs 69.976µs 73.102µs 5.08% 10.944 139.226 0.39% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [69.551µs; 69.626µs] or [-0.054%; +0.054%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.352ms 6.365ms ± 0.008ms 6.364ms ± 0.005ms 6.370ms 6.375ms 6.381ms 6.419ms 0.86% 2.931 17.447 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.364ms; 6.366ms] or [-0.018%; +0.018%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a4110ec 1737466887 watson/env-redaction
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.395µs 5.463µs ± 0.043µs 5.446µs ± 0.026µs 5.490µs 5.543µs 5.546µs 5.547µs 1.86% 0.578 -0.866 0.78% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.457µs; 5.469µs] or [-0.109%; +0.109%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Jan 15, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.74%. Comparing base (afa69e9) to head (a4110ec).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #825      +/-   ##
==========================================
+ Coverage   70.72%   70.74%   +0.01%     
==========================================
  Files         321      321              
  Lines       47300    47300              
==========================================
+ Hits        33453    33461       +8     
+ Misses      13847    13839       -8     
Components Coverage Δ
crashtracker 39.73% <ø> (-0.03%) ⬇️
crashtracker-ffi 5.74% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.48% <ø> (ø)
data-pipeline-ffi 90.08% <ø> (ø)
ddcommon 80.24% <ø> (ø)
ddcommon-ffi 62.11% <ø> (ø)
ddtelemetry 59.51% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.29% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.79% <ø> (+0.10%) ⬆️
profiling 78.96% <ø> (ø)
profiling-ffi 67.66% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 41.79% <ø> (ø)
sidecar-ffi 10.78% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 93.60% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 94.13% <ø> (ø)

@watson watson enabled auto-merge (squash) January 21, 2025 13:41
@watson watson merged commit 86905b2 into main Jan 21, 2025
31 checks passed
@watson watson deleted the watson/env-redaction branch January 21, 2025 14:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants