Skip to content

Conversation

@paullegranddc
Copy link
Contributor

What does this PR do?

Add a method on the test agent client that sets the remote config response for a snapshot.

Motivation

We'd like to have integration tests in dd-trace-rs for our dynamic sample rates. Thus we'd like to set be able to configure the test agent to answer with a certain rc config

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

We'd like to have integration tests in dd-trace-rs for our dynamic sample rates.
Thus we'd like to set be able to configure the test agent to answer with a certain rc config
@paullegranddc paullegranddc requested review from a team as code owners August 29, 2025 15:02
@pr-commenter
Copy link

pr-commenter bot commented Aug 29, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-08-29 16:53:57

Comparing candidate commit 03ba50b in PR branch paullgdc/test_agent/add_remote_config_setter with baseline commit e96eb6c in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 494.545µs 495.455µs ± 0.671µs 495.342µs ± 0.260µs 495.637µs 496.206µs 499.090µs 499.463µs 0.83% 3.430 16.253 0.14% 0.047µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2002152.314op/s 2018349.313op/s ± 2721.748op/s 2018807.208op/s ± 1059.653op/s 2019788.882op/s 2021090.608op/s 2021421.098op/s 2022059.319op/s 0.16% -3.404 16.063 0.13% 192.457op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.173µs 370.948µs ± 0.294µs 370.944µs ± 0.193µs 371.143µs 371.406µs 371.538µs 371.679µs 0.20% -0.087 -0.401 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2690493.679op/s 2695800.743op/s ± 2138.163op/s 2695822.812op/s ± 1406.091op/s 2697189.549op/s 2699374.431op/s 2700239.980op/s 2701437.059op/s 0.21% 0.091 -0.400 0.08% 151.191op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 166.596µs 167.588µs ± 0.166µs 167.590µs ± 0.089µs 167.691µs 167.803µs 167.972µs 168.029µs 0.26% -1.223 6.547 0.10% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5951345.399op/s 5967016.584op/s ± 5932.856op/s 5966940.651op/s ± 3164.633op/s 5969875.522op/s 5975493.349op/s 5984375.647op/s 6002545.079op/s 0.60% 1.244 6.662 0.10% 419.516op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.433µs 36.703µs ± 0.109µs 36.697µs ± 0.069µs 36.762µs 36.871µs 36.956µs 37.251µs 1.51% 1.109 4.315 0.30% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26845266.830op/s 27245937.988op/s ± 80809.898op/s 27250108.863op/s ± 51075.877op/s 27302125.486op/s 27357552.073op/s 27417100.856op/s 27447782.973op/s 0.73% -1.064 4.105 0.30% 5714.123op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.416µs 45.611µs ± 0.116µs 45.617µs ± 0.060µs 45.660µs 45.716µs 45.749µs 46.881µs 2.77% 6.418 68.814 0.25% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21330805.238op/s 21924702.924op/s ± 55075.689op/s 21921833.566op/s ± 28786.319op/s 21956063.234op/s 21983397.061op/s 21999513.451op/s 22018494.067op/s 0.44% -6.195 65.682 0.25% 3894.439op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [495.362µs; 495.548µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2017972.105op/s; 2018726.521op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [370.907µs; 370.988µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2695504.414op/s; 2696097.072op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.565µs; 167.611µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5966194.347op/s; 5967838.821op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.688µs; 36.718µs] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27234738.513op/s; 27257137.463op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.595µs; 45.627µs] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21917069.963op/s; 21932335.885op/s] or [-0.035%; +0.035%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 90.846µs 91.110µs ± 0.154µs 91.090µs ± 0.063µs 91.158µs 91.287µs 91.548µs 92.677µs 1.74% 5.625 52.071 0.17% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [91.089µs; 91.132µs] or [-0.023%; +0.023%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.481µs 25.335µs ± 9.861µs 17.781µs ± 0.240µs 34.547µs 44.647µs 45.576µs 70.083µs 294.14% 0.964 0.590 38.83% 0.697µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.968µs; 26.702µs] or [-5.394%; +5.394%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 153.968µs 154.762µs ± 0.342µs 154.743µs ± 0.145µs 154.888µs 155.220µs 155.536µs 157.820µs 1.99% 3.656 30.984 0.22% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [154.714µs; 154.809µs] or [-0.031%; +0.031%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.143µs 3.206µs ± 1.418µs 2.995µs ± 0.028µs 3.019µs 3.679µs 13.851µs 14.867µs 396.44% 7.293 54.603 44.12% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.009µs; 3.402µs] or [-6.130%; +6.130%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.962ms 14.018ms ± 0.032ms 14.013ms ± 0.015ms 14.027ms 14.070ms 14.160ms 14.230ms 1.55% 2.841 12.586 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.014ms; 14.023ms] or [-0.032%; +0.032%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.166ms 8.185ms ± 0.010ms 8.184ms ± 0.006ms 8.190ms 8.202ms 8.213ms 8.223ms 0.48% 0.938 1.226 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.184ms; 8.186ms] or [-0.016%; +0.016%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.345ms 61.016ms ± 2.130ms 60.820ms ± 0.135ms 60.905ms 61.090ms 75.735ms 80.748ms 32.77% 7.982 63.666 3.48% 0.151ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.721ms; 61.312ms] or [-0.484%; +0.484%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.550µs 185.938µs ± 0.206µs 185.910µs ± 0.143µs 186.076µs 186.288µs 186.389µs 186.698µs 0.42% 0.500 -0.038 0.11% 0.015µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5356237.318op/s 5378150.427op/s ± 5956.312op/s 5378942.824op/s ± 4138.576op/s 5382642.465op/s 5386478.376op/s 5388784.668op/s 5389383.642op/s 0.19% -0.494 -0.050 0.11% 421.175op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.781µs 17.864µs ± 0.037µs 17.859µs ± 0.020µs 17.883µs 17.921µs 17.971µs 18.068µs 1.17% 1.215 4.480 0.20% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55345387.776op/s 55977660.748op/s ± 114470.033op/s 55993517.973op/s ± 64280.923op/s 56052768.738op/s 56121022.020op/s 56218248.820op/s 56239647.061op/s 0.44% -1.184 4.321 0.20% 8094.254op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.399µs 10.536µs ± 0.048µs 10.534µs ± 0.033µs 10.569µs 10.620µs 10.639µs 10.670µs 1.29% -0.034 0.091 0.46% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 93721910.053op/s 94913607.722op/s ± 434167.950op/s 94929608.265op/s ± 297546.492op/s 95182005.868op/s 95609579.162op/s 96002113.768op/s 96167156.002op/s 1.30% 0.062 0.096 0.46% 30700.310op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.909µs; 185.966µs] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5377324.939op/s; 5378975.914op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.859µs; 17.869µs] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55961796.302op/s; 55993525.194op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.529µs; 10.543µs] or [-0.063%; +0.063%] None None None
normalization/normalize_name/normalize_name/good throughput [94853436.220op/s; 94973779.224op/s] or [-0.063%; +0.063%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.017µs 5.089µs ± 0.036µs 5.091µs ± 0.026µs 5.106µs 5.161µs 5.163µs 5.165µs 1.45% 0.359 -0.535 0.71% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.084µs; 5.094µs] or [-0.098%; +0.098%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.302µs 2.384µs ± 0.019µs 2.386µs ± 0.005µs 2.393µs 2.405µs 2.416µs 2.420µs 1.40% -2.174 5.774 0.78% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.382µs; 2.387µs] or [-0.109%; +0.109%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.898µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.915µs 3.920µs 3.924µs 3.925µs 0.30% 0.351 4.801 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254764139.260op/s 255493057.570op/s ± 203322.343op/s 255523035.402op/s ± 98870.693op/s 255618779.656op/s 255728458.858op/s 255801718.129op/s 256566907.830op/s 0.41% -0.335 4.843 0.08% 14377.061op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.949µs 79.611µs ± 0.706µs 79.566µs ± 0.511µs 80.156µs 80.662µs 81.601µs 81.878µs 2.91% 0.162 0.099 0.88% 0.050µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12213318.586op/s 12561986.143op/s ± 111279.896op/s 12568140.495op/s ± 80275.907op/s 12634765.298op/s 12751272.797op/s 12815508.229op/s 12828879.090op/s 2.07% -0.107 0.043 0.88% 7868.677op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.739µs 72.180µs ± 0.247µs 72.157µs ± 0.184µs 72.356µs 72.604µs 72.730µs 72.883µs 1.01% 0.370 -0.587 0.34% 0.017µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13720599.051op/s 13854506.266op/s ± 47303.552op/s 13858722.508op/s ± 35354.719op/s 13891928.448op/s 13922643.579op/s 13928989.004op/s 13939511.545op/s 0.58% -0.357 -0.603 0.34% 3344.866op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.922µs 3.926µs 0.27% -0.752 5.853 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254736452.956op/s 255422790.102op/s ± 206520.247op/s 255432016.787op/s ± 131733.599op/s 255554618.419op/s 255715316.142op/s 255768758.785op/s 256671113.289op/s 0.49% 0.769 5.948 0.08% 14603.187op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.228µs 68.836µs ± 0.332µs 68.846µs ± 0.248µs 69.081µs 69.418µs 69.687µs 69.881µs 1.50% 0.416 -0.116 0.48% 0.024µs 1 200
credit_card/is_card_number/378282246310005 throughput 14310010.499op/s 14527535.833op/s ± 70034.543op/s 14525227.759op/s ± 52414.515op/s 14578633.956op/s 14634653.617op/s 14645446.162op/s 14656783.310op/s 0.91% -0.391 -0.156 0.48% 4952.190op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.345µs 45.706µs ± 0.158µs 45.737µs ± 0.122µs 45.826µs 45.915µs 45.955µs 45.984µs 0.54% -0.502 -0.755 0.35% 0.011µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21746510.951op/s 21879201.819op/s ± 75866.655op/s 21863970.368op/s ± 57967.323op/s 21936360.636op/s 22017827.905op/s 22047648.028op/s 22053054.816op/s 0.86% 0.512 -0.744 0.35% 5364.583op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.562µs 6.627µs ± 0.014µs 6.632µs ± 0.008µs 6.636µs 6.642µs 6.644µs 6.650µs 0.28% -1.440 2.794 0.22% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150364933.703op/s 150909848.660op/s ± 329228.273op/s 150789437.634op/s ± 186415.956op/s 151071230.108op/s 151550203.032op/s 151797923.603op/s 152400838.023op/s 1.07% 1.458 2.881 0.22% 23279.954op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.916µs ± 0.003µs 3.916µs ± 0.002µs 3.918µs 3.920µs 3.922µs 3.923µs 0.18% -1.696 12.195 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254924838.579op/s 255393278.675op/s ± 192871.031op/s 255394471.017op/s ± 122499.970op/s 255514717.648op/s 255646444.524op/s 255712251.686op/s 256793133.181op/s 0.55% 1.722 12.411 0.08% 13638.041op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.591µs 65.744µs ± 0.053µs 65.745µs ± 0.034µs 65.779µs 65.829µs 65.866µs 65.921µs 0.27% 0.019 0.310 0.08% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15169741.977op/s 15210468.424op/s ± 12202.058op/s 15210341.879op/s ± 7828.237op/s 15217969.060op/s 15232249.998op/s 15238022.043op/s 15246056.403op/s 0.23% -0.014 0.307 0.08% 862.816op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.357µs 53.432µs ± 0.037µs 53.431µs ± 0.021µs 53.450µs 53.501µs 53.544µs 53.585µs 0.29% 0.894 1.557 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18661866.729op/s 18715384.868op/s ± 12894.790op/s 18715779.926op/s ± 7393.957op/s 18725203.580op/s 18733081.872op/s 18738479.473op/s 18741642.274op/s 0.14% -0.888 1.539 0.07% 911.799op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.918µs 3.920µs 3.939µs 0.64% 1.518 23.569 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 253865058.252op/s 255464556.379op/s ± 204135.086op/s 255484313.265op/s ± 98239.899op/s 255577133.180op/s 255686635.903op/s 255742458.226op/s 256691923.277op/s 0.47% -1.463 23.340 0.08% 14434.530op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.143µs 50.210µs ± 0.036µs 50.209µs ± 0.028µs 50.234µs 50.271µs 50.294µs 50.301µs 0.18% 0.255 -0.651 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19880328.375op/s 19916424.910op/s ± 14355.881op/s 19916693.466op/s ± 10986.920op/s 19928133.173op/s 19938365.031op/s 19942043.078op/s 19943108.295op/s 0.13% -0.252 -0.654 0.07% 1015.114op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.359µs 45.704µs ± 0.152µs 45.725µs ± 0.126µs 45.831µs 45.905µs 45.944µs 46.012µs 0.63% -0.365 -0.808 0.33% 0.011µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21733557.894op/s 21880285.268op/s ± 72966.811op/s 21869796.717op/s ± 60371.758op/s 21940460.956op/s 22015201.158op/s 22040127.628op/s 22046323.655op/s 0.81% 0.376 -0.797 0.33% 5159.533op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.574µs 6.630µs ± 0.013µs 6.633µs ± 0.006µs 6.638µs 6.645µs 6.648µs 6.652µs 0.29% -1.460 2.812 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150320931.707op/s 150830828.715op/s ± 289403.127op/s 150753147.162op/s ± 131718.466op/s 150949578.745op/s 151372852.541op/s 151842911.423op/s 152117590.622op/s 0.91% 1.475 2.881 0.19% 20463.891op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255464879.049op/s; 255521236.091op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.514µs; 79.709µs] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12546563.819op/s; 12577408.466op/s] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.145µs; 72.214µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13847950.449op/s; 13861062.084op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255394168.382op/s; 255451411.822op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.790µs; 68.882µs] or [-0.067%; +0.067%] None None None
credit_card/is_card_number/378282246310005 throughput [14517829.719op/s; 14537241.947op/s] or [-0.067%; +0.067%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.684µs; 45.728µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21868687.430op/s; 21889716.207op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.625µs; 6.629µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/x371413321323331 throughput [150864220.788op/s; 150955476.532op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255366548.605op/s; 255420008.745op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.737µs; 65.752µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15208777.336op/s; 15212159.512op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.427µs; 53.437µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18713597.774op/s; 18717171.962op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255436265.219op/s; 255492847.539op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.205µs; 50.215µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19914435.323op/s; 19918414.497op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.683µs; 45.725µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21870172.770op/s; 21890397.767op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.628µs; 6.632µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150790720.225op/s; 150870937.205op/s] or [-0.027%; +0.027%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.633ns 254.761ns ± 16.051ns 247.024ns ± 4.089ns 259.297ns 287.940ns 301.679ns 303.688ns 22.94% 1.376 0.592 6.28% 1.135ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.536ns; 256.985ns] or [-0.873%; +0.873%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 03ba50b 1756485729 paullgdc/test_agent/add_remote_config_setter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.643µs 34.234µs ± 0.668µs 33.868µs ± 0.158µs 35.088µs 35.200µs 36.185µs 37.155µs 9.71% 1.184 0.730 1.95% 0.047µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.141µs; 34.327µs] or [-0.270%; +0.270%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Aug 29, 2025

Codecov Report

❌ Patch coverage is 86.20690% with 4 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.76%. Comparing base (e96eb6c) to head (38ec383).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1194      +/-   ##
==========================================
+ Coverage   71.71%   71.76%   +0.05%     
==========================================
  Files         349      349              
  Lines       55114    55141      +27     
==========================================
+ Hits        39525    39572      +47     
+ Misses      15589    15569      -20     
Components Coverage Δ
datadog-crashtracker 47.08% <ø> (+0.02%) ⬆️
datadog-crashtracker-ffi 5.93% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.44% <ø> (ø)
data-pipeline-ffi 88.56% <ø> (ø)
ddcommon 83.98% <ø> (ø)
ddcommon-ffi 70.64% <ø> (ø)
ddtelemetry 60.07% <ø> (ø)
ddtelemetry-ffi 21.32% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (ø)
datadog-profiling 77.14% <ø> (ø)
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 36.64% <ø> (ø)
datdog-sidecar-ffi 8.76% <ø> (ø)
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 77.10% <ø> (ø)
datadog-trace-utils 89.93% <86.20%> (+0.01%) ⬆️
datadog-tracer-flare 56.08% <ø> (ø)
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@paullegranddc
Copy link
Contributor Author

/merge

@dd-devflow-routing-codex
Copy link

dd-devflow-routing-codex bot commented Aug 29, 2025

View all feedbacks in Devflow UI.

2025-08-29 17:21:18 UTC ℹ️ Start processing command /merge


2025-08-29 17:21:28 UTC ℹ️ MergeQueue: waiting for PR to be ready

This merge request is not mergeable yet, because of pending checks/missing approvals. It will be added to the queue as soon as checks pass and/or get approvals.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.


2025-08-29 17:54:18 UTC ℹ️ MergeQueue: merge request added to the queue

The expected merge time in main is approximately 42m (p90).


2025-08-29 18:30:25 UTC ℹ️ MergeQueue: This merge request was merged

@dd-mergequeue dd-mergequeue bot merged commit 0f88ff8 into main Aug 29, 2025
37 checks passed
@dd-mergequeue dd-mergequeue bot deleted the paullgdc/test_agent/add_remote_config_setter branch August 29, 2025 18:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants