Skip to content

Add document describing the new build process.#579

Merged
hoolioh merged 5 commits into
mainfrom
julio/build-process-proposal
Aug 22, 2024
Merged

Add document describing the new build process.#579
hoolioh merged 5 commits into
mainfrom
julio/build-process-proposal

Conversation

@hoolioh
Copy link
Copy Markdown
Contributor

@hoolioh hoolioh commented Aug 6, 2024

What does this PR do?

Describe a new build system to be implemented in libdatadog.

Motivation

Improve current the current one so it's less error prone, more maintainable and cand handle features as well as versioning.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Aug 6, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.69%. Comparing base (df81898) to head (c4e05fe).
Report is 72 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #579      +/-   ##
==========================================
- Coverage   71.77%   71.69%   -0.08%     
==========================================
  Files         238      238              
  Lines       32924    32941      +17     
==========================================
- Hits        23631    23617      -14     
- Misses       9293     9324      +31     
Components Coverage Δ
crashtracker 20.66% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.11% <ø> (ø)
ddcommon-ffi 68.11% <ø> (ø)
ddtelemetry 59.02% <ø> (ø)
ipc 84.29% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.23% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.87% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 92.97% <ø> (-0.43%) ⬇️

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 6, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-22 12:33:17

Comparing candidate commit c4e05fe in PR branch julio/build-process-proposal with baseline commit df81898 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

  • 🟩 execution_time [-68.099ns; -59.746ns] or [-2.490%; -2.184%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.473µs 2.937µs ± 1.405µs 2.778µs ± 0.022µs 2.793µs 2.998µs 12.845µs 15.802µs 468.83% 7.920 62.720 47.74% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.742µs; 3.131µs] or [-6.633%; +6.633%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 618.391µs 619.936µs ± 1.036µs 619.832µs ± 0.858µs 620.740µs 621.661µs 622.138µs 624.145µs 0.70% 0.589 -0.037 0.17% 0.073µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1602192.654op/s 1613074.638op/s ± 2691.754op/s 1613339.697op/s ± 2235.656op/s 1615505.145op/s 1616399.298op/s 1616933.406op/s 1617101.081op/s 0.23% -0.581 -0.067 0.17% 190.336op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 386.628µs 388.480µs ± 0.919µs 388.417µs ± 0.604µs 389.016µs 390.083µs 390.884µs 391.128µs 0.70% 0.380 -0.154 0.24% 0.065µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2556706.887op/s 2574148.721op/s ± 6086.258op/s 2574554.264op/s ± 4008.773op/s 2578563.028op/s 2583335.012op/s 2586189.256op/s 2586463.415op/s 0.46% -0.368 -0.168 0.24% 430.363op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.836µs 191.389µs ± 0.243µs 191.349µs ± 0.166µs 191.569µs 191.849µs 192.003µs 192.050µs 0.37% 0.513 -0.134 0.13% 0.017µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5206964.141op/s 5224965.538op/s ± 6627.367op/s 5226058.873op/s ± 4531.646op/s 5229854.803op/s 5234369.604op/s 5236824.393op/s 5240108.489op/s 0.27% -0.506 -0.141 0.13% 468.626op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.977µs 45.135µs ± 0.083µs 45.125µs ± 0.053µs 45.182µs 45.262µs 45.320µs 45.642µs 1.15% 1.527 6.395 0.18% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21909637.768op/s 22155668.987op/s ± 40719.232op/s 22160799.914op/s ± 26000.127op/s 22184058.600op/s 22208506.018op/s 22218487.913op/s 22233515.436op/s 0.33% -1.494 6.168 0.18% 2879.284op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.987µs 49.343µs ± 0.199µs 49.302µs ± 0.119µs 49.472µs 49.666µs 49.768µs 50.640µs 2.71% 1.636 7.764 0.40% 0.014µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19747212.715op/s 20266744.157op/s ± 81062.378op/s 20283081.066op/s ± 48720.095op/s 20321032.163op/s 20378571.539op/s 20398314.907op/s 20413724.479op/s 0.64% -1.554 7.117 0.40% 5731.976op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [619.792µs; 620.079µs] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1612701.587op/s; 1613447.690op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [388.353µs; 388.608µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2573305.224op/s; 2574992.218op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [191.355µs; 191.423µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5224047.048op/s; 5225884.027op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.124µs; 45.147µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22150025.693op/s; 22161312.281op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.315µs; 49.370µs] or [-0.056%; +0.056%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20255509.691op/s; 20277978.623op/s] or [-0.055%; +0.055%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 309.959µs 312.705µs ± 1.033µs 312.650µs ± 0.681µs 313.412µs 314.530µs 315.004µs 315.349µs 0.86% 0.049 0.041 0.33% 0.073µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3171090.195op/s 3197935.335op/s ± 10565.396op/s 3198461.794op/s ± 6970.793op/s 3204816.792op/s 3213390.406op/s 3223113.902op/s 3226230.745op/s 0.87% -0.029 0.048 0.33% 747.086op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 27.935µs 28.004µs ± 0.053µs 27.987µs ± 0.031µs 28.035µs 28.101µs 28.116µs 28.309µs 1.15% 1.477 4.208 0.19% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 35324791.074op/s 35708829.894op/s ± 67069.833op/s 35730678.637op/s ± 39670.221op/s 35761203.873op/s 35779297.878op/s 35788695.242op/s 35797399.112op/s 0.19% -1.455 4.043 0.19% 4742.553op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.733µs 16.762µs ± 0.019µs 16.755µs ± 0.014µs 16.777µs 16.792µs 16.804µs 16.833µs 0.47% 0.671 0.074 0.12% 0.001µs 1 200
normalization/normalize_name/normalize_name/good throughput 59405830.934op/s 59659374.311op/s ± 68793.875op/s 59685336.884op/s ± 49831.116op/s 59720286.374op/s 59739095.072op/s 59750644.068op/s 59760451.748op/s 0.13% -0.665 0.052 0.12% 4864.462op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [312.562µs; 312.848µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3196471.072op/s; 3199399.597op/s] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [27.997µs; 28.012µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35699534.660op/s; 35718125.128op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.759µs; 16.765µs] or [-0.016%; +0.016%] None None None
normalization/normalize_name/normalize_name/good throughput [59649840.142op/s; 59668908.480op/s] or [-0.016%; +0.016%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.613µs 1.613µs ± 0.000µs 1.613µs ± 0.000µs 1.614µs 1.614µs 1.614µs 1.615µs 0.10% 0.574 0.102 0.03% 0.000µs 1 200
credit_card/is_card_number/ throughput 619240516.194op/s 619836743.870op/s ± 161335.180op/s 619870541.284op/s ± 123423.828op/s 619972197.280op/s 620050258.485op/s 620109020.175op/s 620145545.098op/s 0.04% -0.573 0.098 0.03% 11408.120op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 104.024µs 105.162µs ± 0.719µs 104.951µs ± 0.229µs 105.260µs 106.971µs 107.339µs 108.807µs 3.67% 2.057 4.616 0.68% 0.051µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 9190543.811op/s 9509580.787op/s ± 64095.698op/s 9528287.252op/s ± 20873.019op/s 9546113.383op/s 9567750.417op/s 9593367.702op/s 9613134.426op/s 0.89% -2.009 4.354 0.67% 4532.250op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 96.386µs 97.170µs ± 0.635µs 96.991µs ± 0.237µs 97.320µs 98.635µs 99.293µs 101.074µs 4.21% 2.508 8.705 0.65% 0.045µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9893742.161op/s 10291689.564op/s ± 66226.607op/s 10310267.168op/s ± 25200.830op/s 10330661.889op/s 10354052.598op/s 10371363.911op/s 10374954.859op/s 0.63% -2.425 8.064 0.64% 4682.928op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.613µs 1.614µs ± 0.003µs 1.613µs ± 0.000µs 1.614µs 1.614µs 1.615µs 1.658µs 2.77% 13.566 186.233 0.20% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 603153385.924op/s 619737888.402op/s ± 1192762.642op/s 619872446.670op/s ± 119350.924op/s 619960849.158op/s 620031031.160op/s 620064064.000op/s 620137388.592op/s 0.04% -13.541 185.766 0.19% 84341.055op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 93.969µs 95.238µs ± 0.704µs 95.170µs ± 0.442µs 95.609µs 96.503µs 96.971µs 98.729µs 3.74% 1.035 2.318 0.74% 0.050µs 1 200
credit_card/is_card_number/378282246310005 throughput 10128760.664op/s 10500578.780op/s ± 77031.796op/s 10507548.100op/s ± 48622.360op/s 10556622.095op/s 10608096.622op/s 10618416.892op/s 10641753.477op/s 1.28% -0.966 1.995 0.73% 5446.971op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 94.090µs 94.646µs ± 0.415µs 94.562µs ± 0.232µs 94.843µs 95.281µs 96.004µs 97.426µs 3.03% 2.229 9.971 0.44% 0.029µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 10264157.784op/s 10565920.190op/s ± 45898.267op/s 10575077.191op/s ± 26021.613op/s 10598920.766op/s 10620827.041op/s 10627442.139op/s 10628117.748op/s 0.50% -2.140 9.234 0.43% 3245.498op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 22.436µs 22.799µs ± 0.212µs 22.763µs ± 0.149µs 22.940µs 23.157µs 23.377µs 23.387µs 2.74% 0.639 -0.011 0.93% 0.015µs 1 200
credit_card/is_card_number/x371413321323331 throughput 42758743.481op/s 43865883.807op/s ± 405342.964op/s 43931319.848op/s ± 288385.125op/s 44156814.117op/s 44428433.118op/s 44565477.107op/s 44571948.872op/s 1.46% -0.596 -0.087 0.92% 28662.076op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.613µs 1.613µs ± 0.000µs 1.613µs ± 0.000µs 1.614µs 1.614µs 1.614µs 1.615µs 0.08% 0.485 -0.538 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 619366849.016op/s 619817634.682op/s ± 166276.520op/s 619835908.967op/s ± 119523.300op/s 619948696.971op/s 620044054.840op/s 620084690.989op/s 620103952.190op/s 0.04% -0.484 -0.539 0.03% 11757.526op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 85.899µs 86.681µs ± 0.390µs 86.621µs ± 0.259µs 86.936µs 87.302µs 87.723µs 88.548µs 2.22% 0.779 1.771 0.45% 0.028µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 11293284.555op/s 11536795.941op/s ± 51782.139op/s 11544519.351op/s ± 34468.636op/s 11573586.774op/s 11611275.419op/s 11631326.427op/s 11641540.509op/s 0.84% -0.737 1.598 0.45% 3661.550op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 79.185µs 80.305µs ± 0.607µs 80.273µs ± 0.355µs 80.602µs 81.307µs 81.734µs 83.414µs 3.91% 1.037 2.913 0.75% 0.043µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11988435.476op/s 12453193.180op/s ± 93362.282op/s 12457483.276op/s ± 54902.446op/s 12516194.079op/s 12587247.883op/s 12618266.696op/s 12628718.210op/s 1.37% -0.954 2.514 0.75% 6601.710op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.613µs 1.613µs ± 0.000µs 1.613µs ± 0.000µs 1.614µs 1.614µs 1.615µs 1.615µs 0.09% 0.633 -0.002 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 619274991.573op/s 619812008.126op/s ± 169101.730op/s 619825359.679op/s ± 122354.119op/s 619947188.446op/s 620040696.862op/s 620082942.764op/s 620096427.646op/s 0.04% -0.631 -0.005 0.03% 11957.298op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 77.076µs 78.577µs ± 0.591µs 78.565µs ± 0.428µs 78.984µs 79.627µs 79.951µs 80.083µs 1.93% 0.123 -0.241 0.75% 0.042µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12487066.618op/s 12727105.350op/s ± 95615.265op/s 12728274.606op/s ± 69404.484op/s 12798711.170op/s 12867620.855op/s 12951354.694op/s 12974242.783op/s 1.93% -0.084 -0.246 0.75% 6761.020op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 94.100µs 94.651µs ± 0.338µs 94.570µs ± 0.215µs 94.864µs 95.297µs 95.427µs 95.679µs 1.17% 0.586 -0.279 0.36% 0.024µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 10451658.565op/s 10565284.794op/s ± 37668.298op/s 10574137.246op/s ± 24063.180op/s 10593565.204op/s 10621732.383op/s 10626326.213op/s 10626936.095op/s 0.50% -0.572 -0.301 0.36% 2663.551op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 22.432µs 22.791µs ± 0.204µs 22.764µs ± 0.134µs 22.917µs 23.168µs 23.344µs 23.382µs 2.71% 0.642 -0.065 0.89% 0.014µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 42768731.003op/s 43880426.867op/s ± 390055.341op/s 43929512.907op/s ± 257999.086op/s 44182938.357op/s 44409324.886op/s 44564844.387op/s 44579818.493op/s 1.48% -0.602 -0.132 0.89% 27581.078op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.613µs; 1.613µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ throughput [619814384.366op/s; 619859103.375op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [105.062µs; 105.262µs] or [-0.095%; +0.095%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [9500697.739op/s; 9518463.834op/s] or [-0.093%; +0.093%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [97.082µs; 97.258µs] or [-0.091%; +0.091%] None None None
credit_card/is_card_number/ 378282246310005 throughput [10282511.193op/s; 10300867.934op/s] or [-0.089%; +0.089%] None None None
credit_card/is_card_number/37828224631 execution_time [1.613µs; 1.614µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631 throughput [619572582.972op/s; 619903193.833op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/378282246310005 execution_time [95.140µs; 95.336µs] or [-0.102%; +0.102%] None None None
credit_card/is_card_number/378282246310005 throughput [10489902.914op/s; 10511254.646op/s] or [-0.102%; +0.102%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [94.588µs; 94.703µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [10559559.132op/s; 10572281.248op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.769µs; 22.828µs] or [-0.129%; +0.129%] None None None
credit_card/is_card_number/x371413321323331 throughput [43809707.171op/s; 43922060.444op/s] or [-0.128%; +0.128%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.613µs; 1.613µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [619794590.355op/s; 619840679.009op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [86.627µs; 86.735µs] or [-0.062%; +0.062%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11529619.434op/s; 11543972.447op/s] or [-0.062%; +0.062%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [80.221µs; 80.389µs] or [-0.105%; +0.105%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [12440254.065op/s; 12466132.294op/s] or [-0.104%; +0.104%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.613µs; 1.613µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [619788572.252op/s; 619835443.999op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [78.495µs; 78.659µs] or [-0.104%; +0.104%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12713853.994op/s; 12740356.706op/s] or [-0.104%; +0.104%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [94.604µs; 94.698µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [10560064.330op/s; 10570505.257op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.763µs; 22.819µs] or [-0.124%; +0.124%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [43826368.948op/s; 43934484.786op/s] or [-0.123%; +0.123%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 308.731ns 316.785ns ± 11.818ns 311.343ns ± 1.723ns 316.424ns 344.625ns 353.667ns 355.202ns 14.09% 1.987 2.627 3.72% 0.836ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [315.147ns; 318.423ns] or [-0.517%; +0.517%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.615µs 2.671µs ± 0.018µs 2.674µs ± 0.004µs 2.677µs 2.707µs 2.713µs 2.715µs 1.52% -0.853 3.055 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.669µs; 2.674µs] or [-0.094%; +0.094%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 74.024µs 74.295µs ± 0.188µs 74.259µs ± 0.106µs 74.408µs 74.459µs 74.698µs 76.048µs 2.41% 4.576 38.079 0.25% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [74.269µs; 74.321µs] or [-0.035%; +0.035%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.407µs 23.950µs ± 15.706µs 17.547µs ± 0.063µs 17.634µs 55.799µs 62.596µs 138.601µs 689.89% 3.526 17.294 65.42% 1.111µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [21.773µs; 26.127µs] or [-9.089%; +9.089%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 139.057µs 139.712µs ± 0.202µs 139.707µs ± 0.113µs 139.818µs 139.987µs 140.356µs 140.854µs 0.82% 1.499 7.361 0.14% 0.014µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.685µs; 139.740µs] or [-0.020%; +0.020%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.153µs 1.352µs ± 0.062µs 1.354µs ± 0.047µs 1.399µs 1.441µs 1.450µs 1.451µs 7.18% -0.636 0.503 4.57% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.344µs; 1.361µs] or [-0.636%; +0.636%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c4e05fe 1724329447 julio/build-process-proposal
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.803µs 39.407µs ± 1.064µs 38.934µs ± 0.065µs 39.004µs 41.645µs 41.664µs 43.701µs 12.25% 1.792 1.608 2.69% 0.075µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.260µs; 39.555µs] or [-0.374%; +0.374%] None None None

Baseline

Omitted due to size.

@hoolioh hoolioh force-pushed the julio/build-process-proposal branch 2 times, most recently from ef9eade to 72ac5bc Compare August 6, 2024 15:37
Comment thread docs/RFCs/build-process.md
@hoolioh hoolioh marked this pull request as ready for review August 6, 2024 18:11
@hoolioh hoolioh requested a review from a team as a code owner August 6, 2024 18:11
Comment thread docs/RFCs/0002-build-process.md Outdated
Comment thread docs/RFCs/0002-build-process.md Outdated
@hoolioh hoolioh force-pushed the julio/build-process-proposal branch from e2db271 to 81f3db5 Compare August 21, 2024 15:30
@pawelchcki pawelchcki self-requested a review August 22, 2024 11:30
@pawelchcki
Copy link
Copy Markdown
Contributor

LGTM!

Comment on lines +4 to +10
As described in the [RFC](https://github.com/DataDog/libdatadog/blob/main/docs/RFCs/0001-delivering-different-features.md)
about delivering different features the current build process depends heavily on shell scripts which makes it too
difficult in terms of managning the process itself like handling errors, dependendencies and features. Also shell
scripts by themselves poses some disadvantages like portability and maintanibilty.

This solution aims to get rid of those problems so the whole procedure depends as much as possible of built-in features
of cargo making it less error prone and also improving its maintanibilty.
Copy link
Copy Markdown
Contributor

@gleocadie gleocadie Aug 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree🤔
I would say that shell script allows to have the same command everywhere instead of searching for the command in the yaml file.

Do not get me wrong, I'm not against just saying that they are useful (in some case).

Now, I see that we can build, generate bindings in one-line command thanks for that🙇‍♂️

Copy link
Copy Markdown
Contributor

@gleocadie gleocadie Aug 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now, I see that we can build, generate bindings

^-------------------------- am I correct ?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep, in this case the cons were clearly outbalancing the pros.

Comment thread docs/RFCs/0002-build-process.md
@hoolioh hoolioh merged commit a063681 into main Aug 22, 2024
@hoolioh hoolioh deleted the julio/build-process-proposal branch August 22, 2024 12:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants