Skip to content

Rename Mini Agent Version tag to Serverless Compat Version #830

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jan 17, 2025
Merged

Rename Mini Agent Version tag to Serverless Compat Version #830

merged 3 commits into from
Jan 17, 2025

Conversation

@duncanpharvey
Copy link
Contributor

@duncanpharvey duncanpharvey commented Jan 16, 2025 •
edited
Loading

What does this PR do?

Renames _dd.mini_agent_version tag to _dd.serverless_compat_version.

Motivation

Moving away from calling this solution the "Serverless Mini Agent" to calling it the "Serverless Compatibility Layer" instead.

https://datadoghq.atlassian.net/browse/SVLS-6117

Additional Notes

How to test the change?

https://datadoghq.atlassian.net/wiki/spaces/SLS/pages/2977497119/Serverless+Mini+Agent#Testing

@duncanpharvey duncanpharvey requested review from a team as code owners January 16, 2025 21:04
@duncanpharvey duncanpharvey changed the title Duncan harvey/serverless compat version Rename Mini Agent Versin tag to Serverless Compat Version Jan 16, 2025
@duncanpharvey duncanpharvey changed the title Rename Mini Agent Versin tag to Serverless Compat Version Rename Mini Agent Version tag to Serverless Compat Version Jan 16, 2025
@codecov-commenter
Copy link

codecov-commenter commented Jan 16, 2025 •
edited
Loading

Codecov Report

Attention: Patch coverage is 75.00000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 71.17%. Comparing base (0ef4986) to head (cf35add).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #830      +/-   ##
==========================================
+ Coverage   71.12%   71.17%   +0.04%     
==========================================
  Files         319      319              
  Lines       46863    46863              
==========================================
+ Hits        33333    33354      +21     
+ Misses      13530    13509      -21
Components Coverage Δ
crashtracker 38.00% <ø> (ø)
crashtracker-ffi 5.63% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.48% <ø> (ø)
data-pipeline-ffi 90.08% <ø> (ø)
ddcommon 80.24% <ø> (ø)
ddcommon-ffi 62.11% <ø> (ø)
ddtelemetry 59.51% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.29% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.69% <ø> (ø)
profiling 84.29% <ø> (ø)
profiling-ffi 77.55% <ø> (ø)
serverless 0.00% <0.00%> (ø)
sidecar 41.79% <ø> (ø)
sidecar-ffi 10.78% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 93.60% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 94.13% <100.00%> (ø)

@duncanpharvey duncanpharvey enabled auto-merge (squash) January 17, 2025 16:25
@pr-commenter
Copy link

pr-commenter bot commented Jan 17, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-01-17 16:29:17

Comparing candidate commit cf35add in PR branch duncan-harvey/serverless-compat-version with baseline commit 0ef4986 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 137.952µs 138.756µs ± 0.298µs 138.713µs ± 0.127µs 138.863µs 139.237µs 139.997µs 140.654µs 1.40% 2.266 10.645 0.21% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [138.715µs; 138.797µs] or [-0.030%; +0.030%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.153µs 38.838µs ± 1.146µs 38.312µs ± 0.059µs 38.396µs 41.287µs 41.334µs 42.482µs 10.89% 1.702 1.020 2.94% 0.081µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.679µs; 38.997µs] or [-0.409%; +0.409%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.676µs 2.726µs ± 0.015µs 2.723µs ± 0.006µs 2.730µs 2.767µs 2.775µs 2.777µs 1.99% 1.350 3.571 0.56% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.724µs; 2.728µs] or [-0.078%; +0.078%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.380µs 5.438µs ± 0.040µs 5.441µs ± 0.036µs 5.466µs 5.505µs 5.508µs 5.588µs 2.70% 0.551 -0.465 0.73% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.433µs; 5.444µs] or [-0.101%; +0.101%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.359ms 6.379ms ± 0.009ms 6.378ms ± 0.004ms 6.382ms 6.389ms 6.414ms 6.447ms 1.09% 3.473 21.750 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.378ms; 6.380ms] or [-0.019%; +0.019%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.260µs 27.847µs ± 14.245µs 18.697µs ± 0.165µs 36.609µs 46.217µs 55.556µs 149.007µs 696.97% 3.958 27.746 51.02% 1.007µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.873µs; 29.822µs] or [-7.089%; +7.089%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 179.096µs 182.050µs ± 1.542µs 181.713µs ± 0.988µs 183.012µs 185.069µs 186.194µs 187.129µs 2.98% 0.786 0.327 0.85% 0.109µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5343912.856op/s 5493400.127op/s ± 46239.629op/s 5503180.827op/s ± 30095.223op/s 5526676.370op/s 5556112.749op/s 5567549.593op/s 5583610.874op/s 1.46% -0.743 0.240 0.84% 3269.636op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 20.834µs 21.046µs ± 0.101µs 21.028µs ± 0.055µs 21.089µs 21.218µs 21.383µs 21.678µs 3.09% 2.008 8.219 0.48% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 46130660.483op/s 47515364.751op/s ± 225599.563op/s 47556761.102op/s ± 125421.325op/s 47667341.658op/s 47774737.937op/s 47844655.043op/s 47997782.920op/s 0.93% -1.922 7.613 0.47% 15952.298op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 14.226µs 14.330µs ± 0.089µs 14.320µs ± 0.038µs 14.359µs 14.422µs 14.487µs 15.338µs 7.11% 7.453 81.334 0.62% 0.006µs 1 200
normalization/normalize_name/normalize_name/good throughput 65197686.807op/s 69784439.812op/s ± 413755.672op/s 69831966.136op/s ± 183834.922op/s 70009277.666op/s 70200058.184op/s 70260296.574op/s 70295555.664op/s 0.66% -6.952 73.746 0.59% 29256.944op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [181.836µs; 182.263µs] or [-0.117%; +0.117%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5486991.759op/s; 5499808.495op/s] or [-0.117%; +0.117%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [21.032µs; 21.060µs] or [-0.066%; +0.066%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [47484098.821op/s; 47546630.681op/s] or [-0.066%; +0.066%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.318µs; 14.343µs] or [-0.086%; +0.086%] None None None
normalization/normalize_name/normalize_name/good throughput [69727097.255op/s; 69841782.369op/s] or [-0.082%; +0.082%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.392µs 3.314µs ± 1.491µs 3.108µs ± 0.026µs 3.136µs 3.757µs 14.650µs 15.403µs 395.55% 7.426 55.820 44.86% 0.105µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.108µs; 3.521µs] or [-6.233%; +6.233%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 69.508µs 69.913µs ± 0.135µs 69.908µs ± 0.036µs 69.943µs 70.015µs 70.118µs 71.502µs 2.28% 8.019 95.473 0.19% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [69.894µs; 69.931µs] or [-0.027%; +0.027%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.269µs 4.287µs ± 0.007µs 4.287µs ± 0.001µs 4.288µs 4.290µs 4.292µs 4.374µs 2.04% 11.510 151.501 0.15% 0.000µs 1 200
credit_card/is_card_number/ throughput 228602224.291op/s 233237748.191op/s ± 351589.384op/s 233256695.895op/s ± 47738.752op/s 233299060.972op/s 233457053.602op/s 233527577.095op/s 234223261.251op/s 0.41% -11.413 149.949 0.15% 24861.124op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 89.111µs 90.889µs ± 0.706µs 90.847µs ± 0.455µs 91.302µs 91.948µs 92.244µs 95.935µs 5.60% 1.797 11.586 0.77% 0.050µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10423690.137op/s 11003101.218op/s ± 84345.153op/s 11007555.292op/s ± 55250.111op/s 11062863.353op/s 11121853.048op/s 11155036.085op/s 11221908.076op/s 1.95% -1.571 9.716 0.76% 5964.103op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 83.231µs 83.864µs ± 0.404µs 83.846µs ± 0.154µs 83.981µs 84.195µs 84.509µs 88.597µs 5.67% 8.104 92.441 0.48% 0.029µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11287105.301op/s 11924301.926op/s ± 55342.391op/s 11926561.011op/s ± 21906.271op/s 11949692.690op/s 11974612.274op/s 11992725.383op/s 12014782.989op/s 0.74% -7.695 86.153 0.46% 3913.298op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.269µs 4.288µs ± 0.005µs 4.287µs ± 0.001µs 4.288µs 4.292µs 4.296µs 4.344µs 1.31% 7.338 85.773 0.11% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 230222250.818op/s 233230783.311op/s ± 263626.152op/s 233246190.120op/s ± 57391.091op/s 233299002.647op/s 233484865.144op/s 233539378.873op/s 234269383.281op/s 0.44% -7.222 84.237 0.11% 18641.184op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 80.550µs 80.925µs ± 0.136µs 80.931µs ± 0.078µs 81.000µs 81.095µs 81.345µs 81.576µs 0.80% 0.574 3.309 0.17% 0.010µs 1 200
credit_card/is_card_number/378282246310005 throughput 12258535.277op/s 12357190.724op/s ± 20709.484op/s 12356229.293op/s ± 11831.547op/s 12369546.487op/s 12391857.690op/s 12407620.078op/s 12414723.863op/s 0.47% -0.549 3.229 0.17% 1464.382op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.398µs 58.691µs ± 0.075µs 58.679µs ± 0.039µs 58.735µs 58.822µs 58.921µs 58.949µs 0.46% 0.207 2.493 0.13% 0.005µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16963790.937op/s 17038559.948op/s ± 21848.506op/s 17041860.840op/s ± 11212.513op/s 17051029.021op/s 17064699.878op/s 17097690.384op/s 17123839.810op/s 0.48% -0.190 2.508 0.13% 1544.923op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.281µs 6.441µs ± 0.012µs 6.442µs ± 0.002µs 6.444µs 6.450µs 6.455µs 6.457µs 0.24% -11.058 141.279 0.19% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154860388.975op/s 155243969.920op/s ± 303809.192op/s 155230860.455op/s ± 52023.161op/s 155282074.910op/s 155370188.388op/s 155453897.272op/s 159206255.392op/s 2.56% 11.178 143.342 0.20% 21482.554op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.269µs 4.288µs ± 0.003µs 4.287µs ± 0.001µs 4.289µs 4.292µs 4.297µs 4.299µs 0.26% -0.705 10.647 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 232623484.383op/s 233215207.119op/s ± 155687.861op/s 233237527.328op/s ± 59199.780op/s 233279273.138op/s 233411647.793op/s 233525337.747op/s 234254493.359op/s 0.44% 0.729 10.772 0.07% 11008.794op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 68.845µs 69.707µs ± 0.388µs 69.678µs ± 0.269µs 69.984µs 70.350µs 70.570µs 70.915µs 1.78% 0.158 -0.201 0.55% 0.027µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14101442.842op/s 14346156.644op/s ± 79728.240op/s 14351760.879op/s ± 55352.987op/s 14396545.328op/s 14481301.360op/s 14515619.837op/s 14525459.297op/s 1.21% -0.129 -0.221 0.55% 5637.638op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 63.876µs 64.699µs ± 0.402µs 64.642µs ± 0.271µs 64.946µs 65.411µs 65.600µs 65.829µs 1.84% 0.519 -0.381 0.62% 0.028µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15190880.767op/s 15456768.267op/s ± 95682.599op/s 15469782.137op/s ± 64789.567op/s 15531276.912op/s 15582898.129op/s 15622767.263op/s 15655384.387op/s 1.20% -0.495 -0.414 0.62% 6765.781op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.271µs 4.288µs ± 0.002µs 4.287µs ± 0.001µs 4.289µs 4.291µs 4.293µs 4.294µs 0.15% -1.374 10.342 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 232888811.514op/s 233232451.993op/s ± 132986.159op/s 233244860.919op/s ± 63229.370op/s 233298670.198op/s 233398427.686op/s 233522466.884op/s 234149282.864op/s 0.39% 1.392 10.473 0.06% 9403.541op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 61.523µs 61.922µs ± 0.075µs 61.932µs ± 0.040µs 61.963µs 62.017µs 62.082µs 62.122µs 0.31% -1.331 5.321 0.12% 0.005µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16097385.606op/s 16149342.786op/s ± 19695.908op/s 16146686.065op/s ± 10311.941op/s 16159258.470op/s 16180425.407op/s 16223952.873op/s 16254147.441op/s 0.67% 1.352 5.409 0.12% 1392.711op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.529µs 58.684µs ± 0.049µs 58.673µs ± 0.021µs 58.703µs 58.774µs 58.844µs 58.911µs 0.40% 1.257 3.819 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16974871.433op/s 17040481.793op/s ± 14252.516op/s 17043563.648op/s ± 6194.976op/s 17048895.510op/s 17057449.765op/s 17067478.535op/s 17085543.921op/s 0.25% -1.247 3.784 0.08% 1007.805op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.369µs 6.441µs ± 0.006µs 6.442µs ± 0.002µs 6.444µs 6.447µs 6.450µs 6.459µs 0.27% -8.022 88.587 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154822727.976op/s 155243534.941op/s ± 153126.425op/s 155237687.608op/s ± 39051.936op/s 155268814.259op/s 155361492.874op/s 155413251.328op/s 157014218.431op/s 1.14% 8.099 89.745 0.10% 10827.673op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.287µs; 4.288µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/ throughput [233189021.283op/s; 233286475.098op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.791µs; 90.987µs] or [-0.108%; +0.108%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10991411.791op/s; 11014790.645op/s] or [-0.106%; +0.106%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.808µs; 83.920µs] or [-0.067%; +0.067%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11916632.003op/s; 11931971.849op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/37828224631 execution_time [4.287µs; 4.288µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/37828224631 throughput [233194247.262op/s; 233267319.361op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.906µs; 80.944µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number/378282246310005 throughput [12354320.588op/s; 12360060.859op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [58.680µs; 58.701µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [17035531.955op/s; 17041587.940op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.440µs; 6.443µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/x371413321323331 throughput [155201864.888op/s; 155286074.952op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.287µs; 4.288µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [233193630.278op/s; 233236783.959op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [69.653µs; 69.761µs] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14335107.076op/s; 14357206.211op/s] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [64.643µs; 64.755µs] or [-0.086%; +0.086%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15443507.579op/s; 15470028.955op/s] or [-0.086%; +0.086%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.287µs; 4.288µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [233214021.391op/s; 233250882.596op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.912µs; 61.933µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16146613.122op/s; 16152072.449op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [58.677µs; 58.691µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [17038506.531op/s; 17042457.054op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.441µs; 6.442µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155222313.091op/s; 155264756.791op/s] or [-0.014%; +0.014%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 700.394µs 701.739µs ± 0.724µs 701.736µs ± 0.422µs 702.109µs 702.666µs 703.060µs 707.982µs 0.89% 3.213 26.012 0.10% 0.051µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1412464.675op/s 1425032.086op/s ± 1464.938op/s 1425038.195op/s ± 856.689op/s 1425921.174op/s 1427007.006op/s 1427583.332op/s 1427767.486op/s 0.19% -3.159 25.420 0.10% 103.587op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 472.894µs 473.848µs ± 0.407µs 473.849µs ± 0.246µs 474.085µs 474.490µs 474.822µs 475.243µs 0.29% 0.289 0.109 0.09% 0.029µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2104184.836op/s 2110381.717op/s ± 1811.444op/s 2110378.107op/s ± 1095.626op/s 2111515.877op/s 2113301.031op/s 2113909.280op/s 2114640.917op/s 0.20% -0.283 0.102 0.09% 128.088op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.300µs 190.781µs ± 0.191µs 190.781µs ± 0.144µs 190.913µs 191.113µs 191.221µs 191.428µs 0.34% 0.419 0.020 0.10% 0.014µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5223902.488op/s 5241611.110op/s ± 5244.799op/s 5241604.361op/s ± 3971.298op/s 5245852.422op/s 5249158.086op/s 5250662.023op/s 5254867.827op/s 0.25% -0.413 0.011 0.10% 370.863op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.185µs 46.415µs ± 0.096µs 46.403µs ± 0.071µs 46.481µs 46.581µs 46.630µs 46.672µs 0.58% 0.281 -0.563 0.21% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21426219.718op/s 21544789.507op/s ± 44624.496op/s 21550237.588op/s ± 32790.878op/s 21578758.177op/s 21604655.840op/s 21635525.772op/s 21652196.798op/s 0.47% -0.272 -0.566 0.21% 3155.428op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.823µs 49.114µs ± 0.100µs 49.129µs ± 0.069µs 49.189µs 49.243µs 49.304µs 49.385µs 0.52% -0.462 -0.187 0.20% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20249241.160op/s 20360753.605op/s ± 41638.776op/s 20354620.461op/s ± 28588.947op/s 20389211.933op/s 20434724.285op/s 20456524.850op/s 20482275.663op/s 0.63% 0.471 -0.179 0.20% 2944.306op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [701.639µs; 701.840µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1424829.059op/s; 1425235.112op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [473.792µs; 473.905µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2110130.668op/s; 2110632.765op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.755µs; 190.808µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5240884.231op/s; 5242337.989op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.402µs; 46.428µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21538604.981op/s; 21550974.033op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.100µs; 49.128µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20354982.871op/s; 20366524.339op/s] or [-0.028%; +0.028%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 57.799ms 57.991ms ± 0.151ms 57.971ms ± 0.068ms 58.031ms 58.208ms 58.558ms 58.881ms 1.57% 2.754 11.245 0.26% 0.011ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [57.970ms; 58.012ms] or [-0.036%; +0.036%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cf35add 1737130706 duncan-harvey/serverless-compat-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 261.254ns 274.269ns ± 14.657ns 267.413ns ± 3.091ns 276.662ns 310.103ns 321.515ns 326.209ns 21.99% 1.843 2.638 5.33% 1.036ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [272.237ns; 276.300ns] or [-0.741%; +0.741%] None None None

Baseline

Omitted due to size.

@duncanpharvey duncanpharvey merged commit 8a8d5c7 into main Jan 17, 2025
31 checks passed
@duncanpharvey duncanpharvey deleted the duncan-harvey/serverless-compat-version branch January 17, 2025 16:49
duncanpharvey added a commit that referenced this pull request Apr 16, 2025
@duncanpharvey
Rename Mini Agent Version tag to Serverless Compat Version (#830)
1f00b03 
* add _dd.serverless_compat_version span tag

* remove _dd.mini_agent_version tag from spans
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jcstorms1 jcstorms1 jcstorms1 approved these changes

Assignees

No one assigned

Labels

mini-agent

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@duncanpharvey @codecov-commenter @jcstorms1