fix(test-agent): undo commenting arg in docker cmd #1439

paullegranddc · 2026-01-12T17:02:37Z

Changes

The --rm option passed when spawning docker containers was wrongly commented out and merged in a previous commit, leading to containers not being removed after running tests...

# Changes The --rm option passed when spawning docker containers was wrongly commented out and merged in a previous commit, leading to containers not being removed after running tests... This PR fixes it

codecov-commenter · 2026-01-12T17:30:28Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.30%. Comparing base (9ea31cc) to head (12a106f).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1439      +/-   ##
==========================================
- Coverage   71.31%   71.30%   -0.02%     
==========================================
  Files         413      413              
  Lines       66148    66148              
==========================================
- Hits        47174    47164      -10     
- Misses      18974    18984      +10

Components	Coverage Δ
libdd-crashtracker	`58.65% <ø> (+0.06%)`	⬆️
libdd-crashtracker-ffi	`14.37% <ø> (ø)`
libdd-alloc	`98.73% <ø> (ø)`
libdd-data-pipeline	`86.17% <ø> (ø)`
libdd-data-pipeline-ffi	`77.01% <ø> (ø)`
libdd-common	`81.11% <ø> (ø)`
libdd-common-ffi	`74.19% <ø> (ø)`
libdd-telemetry	`59.92% <ø> (-0.04%)`	⬇️
libdd-telemetry-ffi	`21.17% <ø> (ø)`
libdd-dogstatsd-client	`83.75% <ø> (ø)`
datadog-ipc	`82.71% <ø> (+0.10%)`	⬆️
libdd-profiling	`81.07% <ø> (+0.02%)`	⬆️
libdd-profiling-ffi	`62.43% <ø> (ø)`
datadog-sidecar	`35.99% <ø> (ø)`
datdog-sidecar-ffi	`11.46% <ø> (ø)`
spawn-worker	`55.18% <ø> (ø)`
libdd-tinybytes	`92.44% <ø> (ø)`
libdd-trace-normalization	`82.33% <ø> (ø)`
libdd-trace-obfuscation	`94.17% <ø> (ø)`
libdd-trace-protobuf	`61.18% <ø> (ø)`
libdd-trace-utils	`89.74% <100.00%> (ø)`
datadog-tracer-flare	`61.06% <ø> (ø)`
libdd-log	`75.57% <ø> (ø)`

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

pr-commenter · 2026-01-12T17:32:23Z

Benchmarks

Comparison

Benchmark execution time: 2026-01-12 17:31:47

Comparing candidate commit 12a106f in PR branch paullgdc/test-agent/uncomment_rm_arg with baseline commit 9ea31cc in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

scenario:single_flag_killswitch/rules-based

🟩 execution_time [-14.925ns; -10.499ns] or [-7.348%; -5.169%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	495.409µs	496.147µs ± 0.645µs	496.069µs ± 0.256µs	496.358µs	496.694µs	497.006µs	503.609µs	1.52%	7.841	88.096	0.13%	0.046µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1985667.890op/s	2015533.493op/s ± 2592.059op/s	2015848.941op/s ± 1042.115op/s	2016710.915op/s	2018127.335op/s	2018409.709op/s	2018534.407op/s	0.13%	-7.730	86.391	0.13%	183.286op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	371.181µs	371.985µs ± 0.339µs	371.936µs ± 0.235µs	372.206µs	372.547µs	372.674µs	373.730µs	0.48%	0.818	2.384	0.09%	0.024µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2675728.156op/s	2688284.246op/s ± 2445.900op/s	2688633.818op/s ± 1700.027op/s	2689992.803op/s	2691692.384op/s	2692726.749op/s	2694106.887op/s	0.20%	-0.808	2.334	0.09%	172.951op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	169.321µs	169.985µs ± 0.210µs	169.958µs ± 0.124µs	170.112µs	170.378µs	170.471µs	170.661µs	0.41%	0.364	0.443	0.12%	0.015µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5859560.773op/s	5882874.546op/s ± 7262.951op/s	5883821.885op/s ± 4299.160op/s	5887637.116op/s	5894007.272op/s	5897566.944op/s	5905946.024op/s	0.38%	-0.355	0.441	0.12%	513.568op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	37.266µs	37.389µs ± 0.056µs	37.387µs ± 0.040µs	37.424µs	37.483µs	37.546µs	37.610µs	0.60%	0.565	0.634	0.15%	0.004µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26588716.071op/s	26746052.466op/s ± 39938.139op/s	26747297.612op/s ± 28842.901op/s	26776490.309op/s	26804692.966op/s	26813185.460op/s	26834006.786op/s	0.32%	-0.555	0.606	0.15%	2824.053op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	46.187µs	46.300µs ± 0.061µs	46.294µs ± 0.042µs	46.339µs	46.403µs	46.450µs	46.544µs	0.54%	0.665	0.547	0.13%	0.004µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	21485244.950op/s	21598521.890op/s ± 28393.774op/s	21600885.776op/s ± 19401.346op/s	21617868.547op/s	21639809.879op/s	21645576.220op/s	21651270.208op/s	0.23%	-0.657	0.523	0.13%	2007.743op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[496.058µs; 496.237µs] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[2015174.258op/s; 2015892.727op/s] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[371.938µs; 372.032µs] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2687945.267op/s; 2688623.224op/s] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[169.956µs; 170.014µs] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5881867.970op/s; 5883881.121op/s] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[37.381µs; 37.397µs] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26740517.424op/s; 26751587.508op/s] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[46.291µs; 46.308µs] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[21594586.786op/s; 21602456.994op/s] or [-0.018%; +0.018%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	161.023µs	161.457µs ± 0.299µs	161.403µs ± 0.126µs	161.546µs	161.837µs	162.111µs	164.255µs	1.77%	4.393	36.955	0.18%	0.021µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[161.416µs; 161.498µs] or [-0.026%; +0.026%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	10.539ms	10.571ms ± 0.015ms	10.569ms ± 0.008ms	10.577ms	10.593ms	10.615ms	10.666ms	0.92%	2.203	9.967	0.14%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[10.569ms; 10.573ms] or [-0.020%; +0.020%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.895µs	3.913µs ± 0.003µs	3.913µs ± 0.002µs	3.915µs	3.918µs	3.919µs	3.920µs	0.18%	-0.859	5.068	0.08%	0.000µs	1	200
credit_card/is_card_number/	throughput	255114232.211op/s	255576626.895op/s ± 194974.828op/s	255573107.952op/s ± 147635.300op/s	255722727.380op/s	255855808.518op/s	255907926.828op/s	256744513.705op/s	0.46%	0.873	5.158	0.08%	13786.802op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	78.746µs	80.001µs ± 0.547µs	79.912µs ± 0.351µs	80.361µs	80.930µs	81.406µs	81.536µs	2.03%	0.390	-0.142	0.68%	0.039µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	12264452.603op/s	12500413.371op/s ± 85176.867op/s	12513785.812op/s ± 54923.617op/s	12562688.473op/s	12634138.673op/s	12668991.186op/s	12698985.483op/s	1.48%	-0.356	-0.172	0.68%	6022.914op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	74.560µs	74.974µs ± 0.141µs	74.963µs ± 0.083µs	75.060µs	75.220µs	75.374µs	75.427µs	0.62%	0.348	0.843	0.19%	0.010µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	13257904.432op/s	13338087.818op/s ± 25140.082op/s	13339915.022op/s ± 14704.647op/s	13353536.038op/s	13373994.002op/s	13393465.882op/s	13412015.825op/s	0.54%	-0.333	0.830	0.19%	1777.672op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.892µs	3.912µs ± 0.003µs	3.912µs ± 0.001µs	3.913µs	3.916µs	3.918µs	3.920µs	0.21%	-1.837	17.480	0.07%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	255125466.632op/s	255635166.848op/s ± 168664.240op/s	255651603.277op/s ± 85606.331op/s	255725586.836op/s	255831320.143op/s	255895508.134op/s	256954070.867op/s	0.51%	1.869	17.751	0.07%	11926.363op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	71.462µs	72.051µs ± 0.175µs	72.039µs ± 0.088µs	72.142µs	72.359µs	72.501µs	72.741µs	0.98%	0.316	1.664	0.24%	0.012µs	1	200
credit_card/is_card_number/378282246310005	throughput	13747343.993op/s	13879158.843op/s ± 33597.875op/s	13881464.781op/s ± 16896.617op/s	13896510.239op/s	13932411.322op/s	13958587.355op/s	13993489.101op/s	0.81%	-0.290	1.638	0.24%	2375.729op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	52.144µs	52.214µs ± 0.035µs	52.211µs ± 0.027µs	52.239µs	52.270µs	52.292µs	52.316µs	0.20%	0.246	-0.528	0.07%	0.002µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	19114432.332op/s	19152032.191op/s ± 12846.483op/s	19153176.230op/s ± 10037.598op/s	19162463.608op/s	19171684.859op/s	19175070.934op/s	19177702.086op/s	0.13%	-0.243	-0.532	0.07%	908.384op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	5.734µs	5.901µs ± 0.056µs	5.900µs ± 0.035µs	5.937µs	5.987µs	6.023µs	6.046µs	2.47%	-0.250	0.045	0.94%	0.004µs	1	200
credit_card/is_card_number/x371413321323331	throughput	165396036.896op/s	169489077.420op/s ± 1601928.604op/s	169485474.541op/s ± 1001848.565op/s	170411019.106op/s	172203053.511op/s	173495181.033op/s	174390677.425op/s	2.89%	0.307	0.089	0.94%	113273.458op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.896µs	3.912µs ± 0.003µs	3.912µs ± 0.002µs	3.914µs	3.916µs	3.918µs	3.920µs	0.20%	-0.747	5.919	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	255101506.356op/s	255619698.766op/s ± 170218.408op/s	255624373.530op/s ± 101795.631op/s	255721512.578op/s	255856051.727op/s	255925662.749op/s	256649706.574op/s	0.40%	0.761	5.999	0.07%	12036.259op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	64.111µs	64.299µs ± 0.118µs	64.273µs ± 0.060µs	64.348µs	64.552µs	64.687µs	64.858µs	0.91%	1.632	3.728	0.18%	0.008µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15418382.250op/s	15552320.042op/s ± 28419.840op/s	15558624.173op/s ± 14524.604op/s	15570731.699op/s	15586900.457op/s	15592512.323op/s	15597874.010op/s	0.25%	-1.615	3.652	0.18%	2009.586op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	57.339µs	57.524µs ± 0.119µs	57.493µs ± 0.060µs	57.570µs	57.715µs	57.946µs	58.120µs	1.09%	2.039	6.262	0.21%	0.008µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	17205701.178op/s	17384230.314op/s ± 35753.308op/s	17393307.063op/s ± 18271.637op/s	17407853.997op/s	17422034.954op/s	17429716.172op/s	17440005.629op/s	0.27%	-2.014	6.116	0.21%	2528.141op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.898µs	3.912µs ± 0.003µs	3.912µs ± 0.002µs	3.914µs	3.917µs	3.919µs	3.920µs	0.19%	-0.402	2.849	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	255115352.147op/s	255592965.549op/s ± 178956.539op/s	255609603.681op/s ± 120675.859op/s	255716052.581op/s	255846391.511op/s	255903543.128op/s	256529462.364op/s	0.36%	0.412	2.890	0.07%	12654.138op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	54.571µs	54.794µs ± 0.166µs	54.760µs ± 0.076µs	54.827µs	55.093µs	55.304µs	55.822µs	1.94%	2.196	7.919	0.30%	0.012µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	17914154.198op/s	18250451.976op/s ± 54999.916op/s	18261469.213op/s ± 25320.410op/s	18286875.510op/s	18307830.259op/s	18315995.855op/s	18324808.125op/s	0.35%	-2.151	7.572	0.30%	3889.081op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	52.141µs	52.203µs ± 0.029µs	52.200µs ± 0.018µs	52.220µs	52.258µs	52.294µs	52.298µs	0.19%	0.599	0.606	0.06%	0.002µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	19121131.071op/s	19156080.735op/s ± 10795.062op/s	19156980.128op/s ± 6493.044op/s	19163273.108op/s	19171896.111op/s	19177933.850op/s	19178935.775op/s	0.11%	-0.595	0.599	0.06%	763.326op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	5.793µs	5.909µs ± 0.051µs	5.908µs ± 0.036µs	5.947µs	5.992µs	6.004µs	6.034µs	2.13%	-0.118	-0.482	0.86%	0.004µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	165734687.239op/s	169248639.212op/s ± 1467777.281op/s	169272201.776op/s ± 1020052.310op/s	170217432.807op/s	171772145.958op/s	172500995.926op/s	172620011.813op/s	1.98%	0.157	-0.473	0.87%	103787.527op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.912µs; 3.913µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/	throughput	[255549605.259op/s; 255603648.531op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[79.925µs; 80.077µs] or [-0.095%; +0.095%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12488608.677op/s; 12512218.066op/s] or [-0.094%; +0.094%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[74.954µs; 74.993µs] or [-0.026%; +0.026%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[13334603.644op/s; 13341571.991op/s] or [-0.026%; +0.026%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.911µs; 3.912µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255611791.607op/s; 255658542.090op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[72.027µs; 72.075µs] or [-0.034%; +0.034%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[13874502.500op/s; 13883815.185op/s] or [-0.034%; +0.034%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[52.209µs; 52.219µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[19150251.792op/s; 19153812.590op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[5.893µs; 5.908µs] or [-0.131%; +0.131%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[169267065.522op/s; 169711089.318op/s] or [-0.131%; +0.131%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.912µs; 3.912µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255596108.132op/s; 255643289.401op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[64.283µs; 64.316µs] or [-0.025%; +0.025%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15548381.325op/s; 15556258.758op/s] or [-0.025%; +0.025%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[57.507µs; 57.540µs] or [-0.029%; +0.029%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[17379275.249op/s; 17389185.378op/s] or [-0.029%; +0.029%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.912µs; 3.913µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255568163.894op/s; 255617767.204op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[54.771µs; 54.817µs] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[18242829.516op/s; 18258074.435op/s] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[52.199µs; 52.207µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[19154584.643op/s; 19157576.827op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[5.902µs; 5.916µs] or [-0.120%; +0.120%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[169045219.398op/s; 169452059.027op/s] or [-0.120%; +0.120%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	14.762ms	14.834ms ± 0.031ms	14.831ms ± 0.017ms	14.847ms	14.896ms	14.946ms	14.957ms	0.85%	1.086	2.603	0.21%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.830ms; 14.838ms] or [-0.029%; +0.029%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	33.721µs	34.308µs ± 1.028µs	33.828µs ± 0.042µs	33.971µs	36.475µs	36.552µs	38.151µs	12.78%	1.764	1.366	2.99%	0.073µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[34.166µs; 34.451µs] or [-0.415%; +0.415%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2597	execution_time	9.746ms	9.995ms ± 0.068ms	9.997ms ± 0.037ms	10.034ms	10.097ms	10.164ms	10.243ms	2.47%	-0.393	2.002	0.68%	0.005ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2597	execution_time	[9.985ms; 10.004ms] or [-0.095%; +0.095%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	186.498µs	187.824µs ± 1.109µs	187.548µs ± 0.706µs	188.326µs	190.063µs	191.005µs	192.113µs	2.43%	1.195	1.256	0.59%	0.078µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5205279.298op/s	5324308.303op/s ± 31233.340op/s	5331979.050op/s ± 20101.551op/s	5350611.349op/s	5355259.449op/s	5357497.913op/s	5361997.140op/s	0.56%	-1.163	1.129	0.59%	2208.531op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	17.608µs	17.809µs ± 0.114µs	17.819µs ± 0.104µs	17.915µs	17.959µs	17.985µs	18.011µs	1.08%	-0.105	-1.518	0.64%	0.008µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	55521702.740op/s	56152633.339op/s ± 358147.461op/s	56121135.056op/s ± 327098.741op/s	56475498.330op/s	56688202.909op/s	56750917.009op/s	56793576.646op/s	1.20%	0.114	-1.515	0.64%	25324.850op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	9.859µs	9.993µs ± 0.111µs	9.969µs ± 0.098µs	10.112µs	10.157µs	10.175µs	10.189µs	2.21%	0.270	-1.518	1.11%	0.008µs	1	200
normalization/normalize_name/normalize_name/good	throughput	98142796.282op/s	100078951.231op/s ± 1108235.205op/s	100311192.684op/s ± 999397.957op/s	101244948.557op/s	101360748.865op/s	101399959.335op/s	101432035.925op/s	1.12%	-0.257	-1.525	1.10%	78364.063op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[187.671µs; 187.978µs] or [-0.082%; +0.082%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5319979.662op/s; 5328636.943op/s] or [-0.081%; +0.081%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[17.794µs; 17.825µs] or [-0.088%; +0.088%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[56102997.545op/s; 56202269.133op/s] or [-0.088%; +0.088%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[9.978µs; 10.009µs] or [-0.154%; +0.154%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[99925360.490op/s; 100232541.971op/s] or [-0.153%; +0.153%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample_frames_x1000	execution_time	3.999ms	4.003ms ± 0.006ms	4.002ms ± 0.001ms	4.004ms	4.007ms	4.011ms	4.088ms	2.14%	11.439	146.829	0.16%	0.000ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample_frames_x1000	execution_time	[4.002ms; 4.004ms] or [-0.022%; +0.022%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	241.037ns	253.654ns ± 14.600ns	247.177ns ± 3.593ns	254.249ns	287.364ns	291.715ns	293.430ns	18.71%	1.522	0.877	5.74%	1.032ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[251.631ns; 255.678ns] or [-0.798%; +0.798%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sdk_test_data/rules-based	execution_time	144.062µs	146.088µs ± 1.592µs	145.790µs ± 0.514µs	146.398µs	148.014µs	151.773µs	161.665µs	10.89%	5.839	48.579	1.09%	0.113µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sdk_test_data/rules-based	execution_time	[145.867µs; 146.308µs] or [-0.151%; +0.151%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.912µs	25.742µs ± 9.221µs	18.358µs ± 0.274µs	33.865µs	43.093µs	44.274µs	66.582µs	262.70%	0.941	0.571	35.73%	0.652µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[24.464µs; 27.020µs] or [-4.965%; +4.965%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	90.843µs	91.125µs ± 0.256µs	91.106µs ± 0.043µs	91.152µs	91.232µs	91.431µs	94.569µs	3.80%	12.332	163.611	0.28%	0.018µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[91.090µs; 91.161µs] or [-0.039%; +0.039%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.248µs	3.254µs ± 1.454µs	3.023µs ± 0.029µs	3.058µs	3.683µs	13.856µs	15.507µs	412.92%	7.357	55.546	44.56%	0.103µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.053µs; 3.456µs] or [-6.192%; +6.192%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample2_frames_x1000	execution_time	524.737µs	525.368µs ± 0.448µs	525.294µs ± 0.191µs	525.507µs	525.945µs	526.551µs	529.730µs	0.84%	5.054	43.827	0.09%	0.032µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample2_frames_x1000	execution_time	[525.306µs; 525.430µs] or [-0.012%; +0.012%]	None	None	None

Group 16

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	59.950ms	60.428ms ± 2.095ms	60.142ms ± 0.070ms	60.248ms	60.381ms	71.117ms	80.042ms	33.09%	8.440	71.952	3.46%	0.148ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[60.137ms; 60.718ms] or [-0.480%; +0.480%]	None	None	None

Group 17

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	4.924µs	5.007µs ± 0.046µs	5.003µs ± 0.035µs	5.034µs	5.086µs	5.090µs	5.093µs	1.81%	0.489	-1.091	0.92%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.001µs; 5.013µs] or [-0.128%; +0.128%]	None	None	None

Group 18

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
single_flag_killswitch/rules-based	execution_time	187.560ns	190.411ns ± 1.950ns	190.219ns ± 1.389ns	191.503ns	194.342ns	195.528ns	196.712ns	3.41%	0.709	0.074	1.02%	0.138ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
single_flag_killswitch/rules-based	execution_time	[190.140ns; 190.681ns] or [-0.142%; +0.142%]	None	None	None

Group 19

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`12a106f`	1768238069	paullgdc/test-agent/uncomment_rm_arg

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.344µs	2.426µs ± 0.022µs	2.427µs ± 0.006µs	2.435µs	2.459µs	2.464µs	2.466µs	1.62%	-1.584	3.665	0.90%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.423µs; 2.429µs] or [-0.125%; +0.125%]	None	None	None

Baseline

Omitted due to size.

fix(test-agent): undo commenting arg in docker cmd

73966b2

# Changes The --rm option passed when spawning docker containers was wrongly commented out and merged in a previous commit, leading to containers not being removed after running tests... This PR fixes it

paullegranddc requested review from a team as code owners January 12, 2026 17:02

github-actions bot added the mini-agent label Jan 12, 2026

Merge branch 'main' into paullgdc/test-agent/uncomment_rm_arg

12a106f

ekump approved these changes Jan 13, 2026

View reviewed changes

paullegranddc merged commit 033991d into main Jan 13, 2026
45 of 47 checks passed

paullegranddc deleted the paullgdc/test-agent/uncomment_rm_arg branch January 13, 2026 13:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix(test-agent): undo commenting arg in docker cmd #1439

fix(test-agent): undo commenting arg in docker cmd #1439

Uh oh!

paullegranddc commented Jan 12, 2026

Uh oh!

codecov-commenter commented Jan 12, 2026

Uh oh!

pr-commenter bot commented Jan 12, 2026 •

edited

Loading

Group 1

Group 2

Group 3

Group 4

Group 5

Group 6

Group 7

Group 8

Group 9

Group 10

Group 11

Group 12

Group 13

Group 14

Group 15

Group 16

Group 17

Group 18

Group 19

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

fix(test-agent): undo commenting arg in docker cmd #1439

fix(test-agent): undo commenting arg in docker cmd #1439

Uh oh!

Conversation

paullegranddc commented Jan 12, 2026

Changes

Uh oh!

codecov-commenter commented Jan 12, 2026

Codecov Report

Uh oh!

pr-commenter bot commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Comparison

scenario:single_flag_killswitch/rules-based

Candidate

Group 1

Group 2

Group 3

Group 4

Group 5

Group 6

Group 7

Group 8

Group 9

Group 10

Group 11

Group 12

Group 13

Group 14

Group 15

Group 16

Group 17

Group 18

Group 19

Baseline

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

pr-commenter bot commented Jan 12, 2026 •

edited

Loading