Skip to content

Test PR benchmark comment#270

Draft
samuelburnham wants to merge 1 commit into
mainfrom
ci-bench-test
Draft

Test PR benchmark comment#270
samuelburnham wants to merge 1 commit into
mainfrom
ci-bench-test

Conversation

@samuelburnham

Copy link
Copy Markdown
Member

No description provided.

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark bench-aiur bench-blake3

@argument-ci-bot

Copy link
Copy Markdown

Benchmark for bench-aiur at aba3021

nat_fib

Function New Benchmark Base Benchmark % change
prove fib 10 155.19ms 163.37ms 5.01% faster

Workflow logs

@argument-ci-bot

Copy link
Copy Markdown

Benchmark for bench-blake3 at aba3021

prove blake3

Function New Benchmark Base Benchmark % change
dataSize=64 numHashes=1 170.93ms 171.12ms 0.11% faster
dataSize=64 numHashes=2 160.59ms 132.08ms 21.58% slower
dataSize=64 numHashes=4 182.67ms 178.79ms 2.17% slower
dataSize=64 numHashes=8 209.44ms 228.91ms 8.51% faster
dataSize=64 numHashes=16 252.29ms 233.75ms 7.93% slower
dataSize=64 numHashes=32 360.69ms 575.20ms 37.29% faster
dataSize=128 numHashes=1 125.22ms 153.43ms 18.38% faster
dataSize=128 numHashes=2 131.94ms 140.13ms 5.84% faster
dataSize=128 numHashes=4 175.37ms 193.91ms 9.56% faster
dataSize=128 numHashes=8 257.29ms 273.97ms 6.09% faster
dataSize=128 numHashes=16 396.27ms 443.13ms 10.58% faster
dataSize=128 numHashes=32 522.20ms 537.31ms 2.81% faster
dataSize=256 numHashes=1 180.95ms 204.85ms 11.67% faster
dataSize=256 numHashes=2 175.78ms 177.19ms 0.80% faster
dataSize=256 numHashes=4 252.98ms 235.02ms 7.64% slower
dataSize=256 numHashes=8 352.37ms 352.20ms 0.05% slower
dataSize=256 numHashes=16 548.91ms 527.35ms 4.09% slower
dataSize=256 numHashes=32 945.69ms 942.98ms 0.29% slower
dataSize=512 numHashes=1 219.74ms 216.59ms 1.46% slower
dataSize=512 numHashes=2 210.37ms 253.38ms 16.97% faster
dataSize=512 numHashes=4 327.57ms 288.85ms 13.40% slower
dataSize=512 numHashes=8 624.11ms 549.58ms 13.56% slower
dataSize=512 numHashes=16 758.03ms 782.77ms 3.16% faster
dataSize=512 numHashes=32 1.52s 1.52s 0.19% faster
dataSize=1024 numHashes=1 226.31ms 232.70ms 2.75% faster
dataSize=1024 numHashes=2 274.44ms 282.21ms 2.75% faster
dataSize=1024 numHashes=4 429.42ms 429.66ms 0.06% faster
dataSize=1024 numHashes=8 674.41ms 690.51ms 2.33% faster
dataSize=1024 numHashes=16 1.35s 1.35s 0.05% faster
dataSize=1024 numHashes=32 2.47s 2.60s 4.76% faster
dataSize=2048 numHashes=1 265.78ms 346.45ms 23.29% faster
dataSize=2048 numHashes=2 427.99ms 442.42ms 3.26% faster
dataSize=2048 numHashes=4 668.78ms 670.31ms 0.23% faster
dataSize=2048 numHashes=8 1.23s 1.26s 1.65% faster
dataSize=2048 numHashes=16 2.35s 2.46s 4.52% faster
dataSize=2048 numHashes=32 4.76s 5.05s 5.69% faster

Workflow logs

@samuelburnham
samuelburnham marked this pull request as draft November 26, 2025 03:57
@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark all

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark all

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark

@argument-ci-bot

Copy link
Copy Markdown

!benchmark — main vs 20bcb96

backends: aiur=prove · envs: InitStd · set: primary · shard: 0

aiur · InitStd · prove — main from: bencher @ 4954563 + base run (1 new)

constant prove-time (main) prove-time (PR) Δ% peak-ram (main) peak-ram (PR) Δ% execute-time (main) execute-time (PR) Δ% verify-time (main) verify-time (PR) Δ% proof-size (main) proof-size (PR) Δ% fft-cost (main) fft-cost (PR) Δ%
ByteArray.utf8DecodeChar?_utf8EncodeChar_append n/a 54.387 s n/a n/a 100.90 GiB n/a n/a 11.716 s n/a 216.7 ms 215.2 ms -0.7% 33.27 MiB 33.27 MiB +0.0% n/a 42.43B n/a
Array.extract_append n/a 52.880 s n/a n/a 92.85 GiB n/a n/a 12.524 s n/a 216.3 ms 222.6 ms +2.9% 33.27 MiB 33.27 MiB +0.0% n/a 40.03B n/a
Char.ofOrdinal_le_of_le n/a 42.722 s n/a n/a 76.06 GiB n/a n/a 8.884 s n/a 221.9 ms 205.0 ms -7.6% (1.08× faster) 🟢 33.27 MiB 33.27 MiB +0.0% n/a 32.73B n/a
Vector.extract_append._proof_2 n/a 31.679 s n/a n/a 53.48 GiB n/a n/a 7.086 s n/a 227.1 ms 203.7 ms -10.3% (1.12× faster) 🟢 33.19 MiB 33.19 MiB +0.0% n/a 23.34B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq n/a 25.790 s n/a n/a 48.57 GiB n/a n/a 4.324 s n/a 205.1 ms 209.7 ms +2.2% 33.19 MiB 33.19 MiB +0.0% n/a 17.43B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq n/a 25.747 s n/a n/a 48.60 GiB n/a n/a 4.268 s n/a 206.3 ms 225.4 ms +9.3% (1.09× slower) ⚠️ 33.19 MiB 33.19 MiB +0.0% n/a 17.43B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq n/a 25.622 s n/a n/a 48.58 GiB n/a n/a 4.359 s n/a 206.7 ms 239.5 ms +15.9% (1.16× slower) ⚠️ 33.19 MiB 33.19 MiB +0.0% n/a 17.43B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq n/a 25.454 s n/a n/a 48.96 GiB n/a n/a 4.366 s n/a 206.5 ms 225.2 ms +9.1% (1.09× slower) ⚠️ 33.19 MiB 33.19 MiB +0.0% n/a 17.42B n/a
String.split n/a 24.911 s n/a n/a 47.08 GiB n/a n/a 4.031 s n/a 218.4 ms 206.2 ms -5.6% (1.06× faster) 🟢 33.19 MiB 33.19 MiB +0.0% n/a 15.99B n/a
List.mergeSort n/a 16.946 s n/a n/a 29.87 GiB n/a n/a 2.745 s n/a 220.0 ms 214.0 ms -2.7% 33.19 MiB 33.19 MiB +0.0% n/a 11.63B n/a
Vector.append n/a 5.375 s n/a n/a 8.95 GiB n/a n/a 548.5 ms n/a 214.0 ms 202.2 ms -5.5% (1.06× faster) 🟢 32.96 MiB 32.96 MiB +0.0% n/a 2.60B n/a
Nat.gcd_comm n/a 4.295 s n/a n/a 7.14 GiB n/a n/a 358.8 ms n/a 219.6 ms 204.6 ms -6.8% (1.07× faster) 🟢 32.96 MiB 32.96 MiB +0.0% n/a 1.75B n/a
String.append n/a 3.064 s n/a n/a 4.56 GiB n/a n/a 190.7 ms n/a 220.4 ms 199.9 ms -9.3% (1.10× faster) 🟢 32.89 MiB 32.89 MiB +0.0% n/a 967.65M n/a
Int.gcd n/a 2.451 s n/a n/a 3.26 GiB n/a n/a 128.3 ms n/a 196.3 ms 196.1 ms -0.1% 32.89 MiB 32.89 MiB +0.0% n/a 605.84M n/a
Nat.sub_le_of_le_add n/a 2.237 s n/a n/a 3.03 GiB n/a n/a 98.4 ms n/a 221.5 ms 198.2 ms -10.5% (1.12× faster) 🟢 32.89 MiB 32.89 MiB +0.0% n/a 510.60M n/a
Nat.add_comm n/a 1.185 s n/a n/a 1.44 GiB n/a n/a 16.7 ms n/a 200.3 ms 191.0 ms -4.7% 🟢 32.76 MiB 32.76 MiB +0.0% n/a 53.90M n/a
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual OOM OOM n/a OOM OOM n/a 1m 19.5s 1m 19.6s +0.2% OOM OOM n/a OOM OOM n/a 261.03B 261.03B +0.0%

17 constants · 3 regressed · 8 improved (|Δ| > 3.0% on any metric).

per-phase drill-down

ByteArray.utf8DecodeChar?_utf8EncodeChar_append
phase main PR Δ%
aiur/execute_ixvm 11.668 s 11.571 s -0.8%
aiur/prove_ixvm 55.700 s 54.317 s -2.5%
aiur/witness 1.971 s 1.887 s -4.2%
stark/batch_inverse 241.3 ms 251.0 ms +4.0%
stark/fri_open 3.400 s 2.950 s -13.2%
stark/lookup_construction 6.587 s 6.526 s -0.9%
stark/lookup_messages 2.430 s 2.365 s -2.7%
stark/lookup_traces 3.890 s 3.884 s -0.2%
stark/prove 35.087 s 33.888 s -3.4%
stark/quotient 13.646 s 12.852 s -5.8%
stark/stage1_commit 6.461 s 6.558 s +1.5%
stark/stage2_commit 4.972 s 4.981 s +0.2%
Array.extract_append
phase main PR Δ%
aiur/execute_ixvm 12.264 s 12.721 s +3.7%
aiur/prove_ixvm 53.199 s 52.828 s -0.7%
aiur/witness 1.529 s 1.578 s +3.2%
stark/batch_inverse 235.5 ms 222.9 ms -5.4%
stark/fri_open 3.259 s 3.014 s -7.5%
stark/lookup_construction 5.492 s 5.329 s -3.0%
stark/lookup_messages 1.542 s 1.257 s -18.5%
stark/lookup_traces 3.690 s 3.823 s +3.6%
stark/prove 33.173 s 32.239 s -2.8%
stark/quotient 13.475 s 13.258 s -1.6%
stark/stage1_commit 6.136 s 5.923 s -3.5%
stark/stage2_commit 4.791 s 4.695 s -2.0%
Char.ofOrdinal_le_of_le
phase main PR Δ%
aiur/execute_ixvm 8.734 s 8.835 s +1.2%
aiur/prove_ixvm 42.900 s 42.658 s -0.6%
aiur/witness 1.275 s 1.356 s +6.4%
stark/batch_inverse 184.0 ms 181.8 ms -1.2%
stark/fri_open 2.895 s 2.824 s -2.5%
stark/lookup_construction 4.387 s 4.216 s -3.9%
stark/lookup_messages 1.254 s 1.122 s -10.5%
stark/lookup_traces 2.930 s 2.893 s -1.3%
stark/prove 27.474 s 26.969 s -1.8%
stark/quotient 11.129 s 11.004 s -1.1%
stark/stage1_commit 5.243 s 5.197 s -0.9%
stark/stage2_commit 3.810 s 3.720 s -2.4%
Vector.extract_append._proof_2
phase main PR Δ%
aiur/execute_ixvm 6.816 s 6.836 s +0.3%
aiur/prove_ixvm 30.783 s 31.627 s +2.7%
aiur/witness 907.4 ms 903.7 ms -0.4%
stark/batch_inverse 119.8 ms 132.0 ms +10.2%
stark/fri_open 2.312 s 2.110 s -8.8%
stark/lookup_construction 3.026 s 3.165 s +4.6%
stark/lookup_messages 889.8 ms 966.4 ms +8.6%
stark/lookup_traces 2.003 s 2.053 s +2.5%
stark/prove 19.328 s 20.136 s +4.2%
stark/quotient 7.883 s 8.639 s +9.6%
stark/stage1_commit 3.451 s 3.512 s +1.8%
stark/stage2_commit 2.651 s 2.706 s +2.1%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.275 s 4.247 s -0.6%
aiur/prove_ixvm 25.898 s 25.732 s -0.6%
aiur/witness 963.7 ms 972.2 ms +0.9%
stark/batch_inverse 114.3 ms 113.3 ms -0.9%
stark/fri_open 2.147 s 1.978 s -7.8%
stark/lookup_construction 2.990 s 3.073 s +2.8%
stark/lookup_messages 999.7 ms 1.067 s +6.7%
stark/lookup_traces 1.862 s 1.880 s +0.9%
stark/prove 17.565 s 17.411 s -0.9%
stark/quotient 6.630 s 6.623 s -0.1%
stark/stage1_commit 3.237 s 3.190 s -1.4%
stark/stage2_commit 2.552 s 2.536 s -0.6%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.289 s 4.237 s -1.2%
aiur/prove_ixvm 26.542 s 25.683 s -3.2%
aiur/witness 969.9 ms 1.031 s +6.3%
stark/batch_inverse 118.2 ms 110.2 ms -6.7%
stark/fri_open 2.194 s 2.061 s -6.1%
stark/lookup_construction 3.189 s 2.828 s -11.3%
stark/lookup_messages 1.142 s 854.7 ms -25.2%
stark/lookup_traces 1.915 s 1.851 s -3.3%
stark/prove 18.197 s 17.309 s -4.9%
stark/quotient 6.997 s 6.750 s -3.5%
stark/stage1_commit 3.258 s 3.146 s -3.4%
stark/stage2_commit 2.548 s 2.513 s -1.4%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.292 s 4.307 s +0.3%
aiur/prove_ixvm 25.525 s 25.583 s +0.2%
aiur/witness 959.0 ms 922.0 ms -3.9%
stark/batch_inverse 116.2 ms 118.6 ms +2.0%
stark/fri_open 2.027 s 2.079 s +2.6%
stark/lookup_construction 2.852 s 2.827 s -0.9%
stark/lookup_messages 862.5 ms 831.3 ms -3.6%
stark/lookup_traces 1.860 s 1.864 s +0.2%
stark/prove 17.204 s 17.223 s +0.1%
stark/quotient 6.557 s 6.580 s +0.4%
stark/stage1_commit 3.224 s 3.202 s -0.7%
stark/stage2_commit 2.533 s 2.525 s -0.3%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.305 s 4.244 s -1.4%
aiur/prove_ixvm 26.174 s 25.392 s -3.0%
aiur/witness 979.1 ms 1.003 s +2.4%
stark/batch_inverse 114.3 ms 113.5 ms -0.7%
stark/fri_open 2.248 s 1.904 s -15.3%
stark/lookup_construction 2.904 s 2.988 s +2.9%
stark/lookup_messages 896.4 ms 997.9 ms +11.3%
stark/lookup_traces 1.881 s 1.862 s -1.0%
stark/prove 17.811 s 17.095 s -4.0%
stark/quotient 6.834 s 6.508 s -4.8%
stark/stage1_commit 3.272 s 3.210 s -1.9%
stark/stage2_commit 2.542 s 2.476 s -2.6%
String.split
phase main PR Δ%
aiur/execute_ixvm 3.997 s 3.966 s -0.8%
aiur/prove_ixvm 24.997 s 24.866 s -0.5%
aiur/witness 1.008 s 1.047 s +3.8%
stark/batch_inverse 113.6 ms 115.2 ms +1.3%
stark/fri_open 2.162 s 1.944 s -10.1%
stark/lookup_construction 2.834 s 2.980 s +5.2%
stark/lookup_messages 880.9 ms 991.7 ms +12.6%
stark/lookup_traces 1.827 s 1.861 s +1.9%
stark/prove 17.165 s 16.969 s -1.1%
stark/quotient 6.535 s 6.404 s -2.0%
stark/stage1_commit 3.184 s 3.139 s -1.4%
stark/stage2_commit 2.441 s 2.492 s +2.1%
List.mergeSort
phase main PR Δ%
aiur/execute_ixvm 2.712 s 2.738 s +1.0%
aiur/prove_ixvm 16.603 s 16.894 s +1.8%
aiur/witness 608.9 ms 616.0 ms +1.2%
stark/batch_inverse 62.8 ms 66.2 ms +5.3%
stark/fri_open 1.776 s 1.822 s +2.6%
stark/lookup_construction 1.522 s 1.527 s +0.3%
stark/lookup_messages 472.4 ms 473.9 ms +0.3%
stark/lookup_traces 980.3 ms 980.0 ms -0.0%
stark/prove 11.184 s 11.446 s +2.3%
stark/quotient 4.338 s 4.465 s +2.9%
stark/stage1_commit 2.015 s 2.095 s +4.0%
stark/stage2_commit 1.529 s 1.534 s +0.3%
Vector.append
phase main PR Δ%
aiur/execute_ixvm 492.8 ms 503.3 ms +2.1%
aiur/prove_ixvm 5.138 s 5.369 s +4.5%
aiur/witness 136.2 ms 138.5 ms +1.6%
stark/batch_inverse 18.1 ms 17.9 ms -0.8%
stark/fri_open 935.8 ms 1.007 s +7.6%
stark/lookup_construction 382.2 ms 398.9 ms +4.4%
stark/lookup_messages 114.9 ms 132.5 ms +15.3%
stark/lookup_traces 248.9 ms 248.2 ms -0.3%
stark/prove 3.987 s 4.196 s +5.2%
stark/quotient 1.501 s 1.589 s +5.8%
stark/stage1_commit 648.3 ms 677.0 ms +4.4%
stark/stage2_commit 518.3 ms 523.0 ms +0.9%
Nat.gcd_comm
phase main PR Δ%
aiur/execute_ixvm 344.3 ms 336.4 ms -2.3%
aiur/prove_ixvm 4.256 s 4.290 s +0.8%
aiur/witness 126.1 ms 123.4 ms -2.2%
stark/batch_inverse 14.7 ms 14.4 ms -2.5%
stark/fri_open 947.6 ms 933.8 ms -1.5%
stark/lookup_construction 294.5 ms 296.2 ms +0.6%
stark/lookup_messages 83.3 ms 88.3 ms +6.0%
stark/lookup_traces 196.1 ms 193.2 ms -1.5%
stark/prove 3.406 s 3.449 s +1.3%
stark/quotient 1.192 s 1.238 s +3.8%
stark/stage1_commit 541.9 ms 548.9 ms +1.3%
stark/stage2_commit 429.0 ms 431.1 ms +0.5%
String.append
phase main PR Δ%
aiur/execute_ixvm 185.0 ms 181.6 ms -1.8%
aiur/prove_ixvm 3.078 s 3.061 s -0.6%
aiur/witness 69.7 ms 63.3 ms -9.2%
stark/batch_inverse 8.2 ms 7.7 ms -5.8%
stark/fri_open 844.8 ms 832.9 ms -1.4%
stark/lookup_construction 203.9 ms 204.3 ms +0.2%
stark/lookup_messages 56.3 ms 59.9 ms +6.3%
stark/lookup_traces 139.1 ms 136.4 ms -1.9%
stark/prove 2.604 s 2.595 s -0.3%
stark/quotient 874.4 ms 875.4 ms +0.1%
stark/stage1_commit 375.7 ms 376.6 ms +0.3%
stark/stage2_commit 304.1 ms 305.4 ms +0.4%
Int.gcd
phase main PR Δ%
aiur/execute_ixvm 120.9 ms 116.8 ms -3.3%
aiur/prove_ixvm 2.370 s 2.449 s +3.4%
aiur/witness 40.1 ms 41.2 ms +2.7%
stark/batch_inverse 5.4 ms 5.3 ms -1.3%
stark/fri_open 715.4 ms 707.3 ms -1.1%
stark/lookup_construction 118.5 ms 187.9 ms +58.6%
stark/lookup_messages 32.6 ms 33.9 ms +4.2%
stark/lookup_traces 80.3 ms 148.4 ms +84.9%
stark/prove 2.062 s 2.145 s +4.0%
stark/quotient 685.4 ms 701.1 ms +2.3%
stark/stage1_commit 292.8 ms 300.9 ms +2.8%
stark/stage2_commit 249.7 ms 247.3 ms -1.0%
Nat.sub_le_of_le_add
phase main PR Δ%
aiur/execute_ixvm 94.6 ms 95.3 ms +0.8%
aiur/prove_ixvm 2.240 s 2.235 s -0.2%
aiur/witness 37.2 ms 36.3 ms -2.4%
stark/batch_inverse 4.6 ms 4.6 ms +0.5%
stark/fri_open 732.0 ms 756.1 ms +3.3%
stark/lookup_construction 96.0 ms 93.8 ms -2.3%
stark/lookup_messages 30.7 ms 28.9 ms -5.7%
stark/lookup_traces 60.4 ms 60.0 ms -0.6%
stark/prove 1.982 s 1.975 s -0.3%
stark/quotient 645.5 ms 628.1 ms -2.7%
stark/stage1_commit 275.6 ms 260.2 ms -5.6%
stark/stage2_commit 232.1 ms 236.3 ms +1.8%
Nat.add_comm
phase main PR Δ%
aiur/execute_ixvm 11.0 ms 10.3 ms -7.2%
aiur/prove_ixvm 1.281 s 1.184 s -7.5%
aiur/witness 10.8 ms 10.8 ms +0.7%
stark/batch_inverse 1.2 ms 1.4 ms +18.2%
stark/fri_open 652.2 ms 575.3 ms -11.8%
stark/lookup_construction 19.4 ms 29.9 ms +54.3%
stark/lookup_messages 6.0 ms 5.6 ms -5.7%
stark/lookup_traces 11.8 ms 22.6 ms +91.0%
stark/prove 1.235 s 1.139 s -7.8%
stark/quotient 307.8 ms 302.8 ms -1.6%
stark/stage1_commit 128.4 ms 115.5 ms -10.0%
stark/stage2_commit 126.7 ms 114.8 ms -9.4%
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual
phase main PR Δ%
aiur/execute_ixvm 1m 19.4s 1m 19.0s -0.4%

Workflow logs

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark all

@argument-ci-bot

Copy link
Copy Markdown

❌ benchmark run failed

!benchmark — main vs 20bcb96

backends: aiur=prove zisk ooc compile · envs: InitStd · set: primary · shard: 0 · skipped sp1 (execute run too slow for per-push CI; re-enable here once trimmed)

aiur · InitStd · prove — main from: bencher @ 4954563 + base run (1 new)

constant prove-time (main) prove-time (PR) Δ% peak-ram (main) peak-ram (PR) Δ% execute-time (main) execute-time (PR) Δ% verify-time (main) verify-time (PR) Δ% proof-size (main) proof-size (PR) Δ% fft-cost (main) fft-cost (PR) Δ%
ByteArray.utf8DecodeChar?_utf8EncodeChar_append n/a 56.878 s n/a n/a 100.89 GiB n/a n/a 11.858 s n/a 216.7 ms 222.3 ms +2.6% 33.27 MiB 33.27 MiB +0.0% n/a 42.43B n/a
Array.extract_append n/a 53.147 s n/a n/a 92.83 GiB n/a n/a 12.291 s n/a 216.3 ms 208.6 ms -3.6% 🟢 33.27 MiB 33.27 MiB +0.0% n/a 40.03B n/a
Char.ofOrdinal_le_of_le n/a 42.775 s n/a n/a 76.03 GiB n/a n/a 8.811 s n/a 221.9 ms 224.9 ms +1.4% 33.27 MiB 33.27 MiB +0.0% n/a 32.73B n/a
Vector.extract_append._proof_2 n/a 30.915 s n/a n/a 53.54 GiB n/a n/a 7.034 s n/a 227.1 ms 213.2 ms -6.1% (1.07× faster) 🟢 33.19 MiB 33.19 MiB +0.0% n/a 23.34B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq n/a 26.119 s n/a n/a 48.57 GiB n/a n/a 4.317 s n/a 206.3 ms 205.0 ms -0.6% 33.19 MiB 33.19 MiB +0.0% n/a 17.43B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq n/a 25.798 s n/a n/a 48.94 GiB n/a n/a 4.258 s n/a 205.1 ms 214.9 ms +4.8% ⚠️ 33.19 MiB 33.19 MiB +0.0% n/a 17.43B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq n/a 25.743 s n/a n/a 48.58 GiB n/a n/a 4.334 s n/a 206.7 ms 237.4 ms +14.9% (1.15× slower) ⚠️ 33.19 MiB 33.19 MiB +0.0% n/a 17.43B n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq n/a 25.523 s n/a n/a 49.02 GiB n/a n/a 4.277 s n/a 206.5 ms 213.0 ms +3.2% ⚠️ 33.19 MiB 33.19 MiB +0.0% n/a 17.42B n/a
String.split n/a 24.956 s n/a n/a 47.09 GiB n/a n/a 3.987 s n/a 218.4 ms 205.0 ms -6.1% (1.07× faster) 🟢 33.19 MiB 33.19 MiB +0.0% n/a 15.99B n/a
List.mergeSort n/a 17.666 s n/a n/a 29.82 GiB n/a n/a 2.729 s n/a 220.0 ms 221.2 ms +0.6% 33.19 MiB 33.19 MiB +0.0% n/a 11.63B n/a
Vector.append n/a 5.278 s n/a n/a 8.96 GiB n/a n/a 525.3 ms n/a 214.0 ms 202.3 ms -5.4% (1.06× faster) 🟢 32.96 MiB 32.96 MiB +0.0% n/a 2.60B n/a
Nat.gcd_comm n/a 4.198 s n/a n/a 7.17 GiB n/a n/a 347.9 ms n/a 219.6 ms 216.1 ms -1.6% 32.96 MiB 32.96 MiB +0.0% n/a 1.75B n/a
String.append n/a 2.947 s n/a n/a 4.56 GiB n/a n/a 191.6 ms n/a 220.4 ms 198.5 ms -9.9% (1.11× faster) 🟢 32.89 MiB 32.89 MiB +0.0% n/a 967.65M n/a
Int.gcd n/a 2.395 s n/a n/a 3.36 GiB n/a n/a 126.9 ms n/a 196.3 ms 207.9 ms +5.9% (1.06× slower) ⚠️ 32.89 MiB 32.89 MiB +0.0% n/a 605.84M n/a
Nat.sub_le_of_le_add n/a 2.253 s n/a n/a 3.09 GiB n/a n/a 93.6 ms n/a 221.5 ms 213.6 ms -3.6% 🟢 32.89 MiB 32.89 MiB +0.0% n/a 510.60M n/a
Nat.add_comm n/a 1.235 s n/a n/a 1.45 GiB n/a n/a 15.5 ms n/a 200.3 ms 193.2 ms -3.6% 🟢 32.76 MiB 32.76 MiB +0.0% n/a 53.90M n/a
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual OOM OOM n/a OOM OOM n/a 1m 19.5s 1m 19.2s -0.3% OOM OOM n/a OOM OOM n/a 261.03B 261.03B +0.0%

17 constants · 4 regressed · 7 improved (|Δ| > 3.0% on any metric).

per-phase drill-down

ByteArray.utf8DecodeChar?_utf8EncodeChar_append
phase main PR Δ%
aiur/execute_ixvm 11.668 s 11.736 s +0.6%
aiur/prove_ixvm 55.700 s 56.799 s +2.0%
aiur/witness 1.971 s 1.941 s -1.5%
stark/batch_inverse 241.3 ms 226.0 ms -6.3%
stark/fri_open 3.400 s 3.198 s -6.0%
stark/lookup_construction 6.587 s 6.735 s +2.2%
stark/lookup_messages 2.430 s 2.584 s +6.3%
stark/lookup_traces 3.890 s 3.900 s +0.2%
stark/prove 35.087 s 34.490 s -1.7%
stark/quotient 13.646 s 13.171 s -3.5%
stark/stage1_commit 6.461 s 6.441 s -0.3%
stark/stage2_commit 4.972 s 4.924 s -1.0%
Array.extract_append
phase main PR Δ%
aiur/execute_ixvm 12.264 s 12.301 s +0.3%
aiur/prove_ixvm 53.199 s 53.091 s -0.2%
aiur/witness 1.529 s 1.579 s +3.2%
stark/batch_inverse 235.5 ms 221.7 ms -5.8%
stark/fri_open 3.259 s 3.102 s -4.8%
stark/lookup_construction 5.492 s 5.272 s -4.0%
stark/lookup_messages 1.542 s 1.308 s -15.1%
stark/lookup_traces 3.690 s 3.717 s +0.7%
stark/prove 33.173 s 32.974 s -0.6%
stark/quotient 13.475 s 13.881 s +3.0%
stark/stage1_commit 6.136 s 5.953 s -3.0%
stark/stage2_commit 4.791 s 4.747 s -0.9%
Char.ofOrdinal_le_of_le
phase main PR Δ%
aiur/execute_ixvm 8.734 s 9.006 s +3.1%
aiur/prove_ixvm 42.900 s 42.659 s -0.6%
aiur/witness 1.275 s 1.304 s +2.3%
stark/batch_inverse 184.0 ms 183.3 ms -0.4%
stark/fri_open 2.895 s 2.822 s -2.5%
stark/lookup_construction 4.387 s 4.136 s -5.7%
stark/lookup_messages 1.254 s 1.104 s -12.0%
stark/lookup_traces 2.930 s 2.829 s -3.4%
stark/prove 27.474 s 26.893 s -2.1%
stark/quotient 11.129 s 10.915 s -1.9%
stark/stage1_commit 5.243 s 5.198 s -0.9%
stark/stage2_commit 3.810 s 3.811 s +0.0%
Vector.extract_append._proof_2
phase main PR Δ%
aiur/execute_ixvm 6.816 s 6.818 s +0.0%
aiur/prove_ixvm 30.783 s 30.848 s +0.2%
aiur/witness 907.4 ms 888.8 ms -2.0%
stark/batch_inverse 119.8 ms 129.9 ms +8.5%
stark/fri_open 2.312 s 2.115 s -8.5%
stark/lookup_construction 3.026 s 2.971 s -1.8%
stark/lookup_messages 889.8 ms 856.0 ms -3.8%
stark/lookup_traces 2.003 s 1.972 s -1.6%
stark/prove 19.328 s 19.389 s +0.3%
stark/quotient 7.883 s 8.078 s +2.5%
stark/stage1_commit 3.451 s 3.496 s +1.3%
stark/stage2_commit 2.651 s 2.725 s +2.8%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.289 s 4.262 s -0.6%
aiur/prove_ixvm 26.542 s 26.044 s -1.9%
aiur/witness 969.9 ms 956.0 ms -1.4%
stark/batch_inverse 118.2 ms 118.7 ms +0.4%
stark/fri_open 2.194 s 2.154 s -1.9%
stark/lookup_construction 3.189 s 3.018 s -5.4%
stark/lookup_messages 1.142 s 1.006 s -11.9%
stark/lookup_traces 1.915 s 1.879 s -1.9%
stark/prove 18.197 s 17.736 s -2.5%
stark/quotient 6.997 s 6.722 s -3.9%
stark/stage1_commit 3.258 s 3.286 s +0.8%
stark/stage2_commit 2.548 s 2.547 s -0.1%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.275 s 4.281 s +0.1%
aiur/prove_ixvm 25.898 s 25.737 s -0.6%
aiur/witness 963.7 ms 1.065 s +10.6%
stark/batch_inverse 114.3 ms 116.6 ms +2.1%
stark/fri_open 2.147 s 1.969 s -8.3%
stark/lookup_construction 2.990 s 3.007 s +0.6%
stark/lookup_messages 999.7 ms 1.003 s +0.3%
stark/lookup_traces 1.862 s 1.874 s +0.7%
stark/prove 17.565 s 17.324 s -1.4%
stark/quotient 6.630 s 6.622 s -0.1%
stark/stage1_commit 3.237 s 3.203 s -1.1%
stark/stage2_commit 2.552 s 2.514 s -1.5%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.292 s 4.276 s -0.4%
aiur/prove_ixvm 25.525 s 25.686 s +0.6%
aiur/witness 959.0 ms 980.2 ms +2.2%
stark/batch_inverse 116.2 ms 116.1 ms -0.1%
stark/fri_open 2.027 s 1.955 s -3.6%
stark/lookup_construction 2.852 s 3.184 s +11.6%
stark/lookup_messages 862.5 ms 1.191 s +38.1%
stark/lookup_traces 1.860 s 1.864 s +0.2%
stark/prove 17.204 s 17.363 s +0.9%
stark/quotient 6.557 s 6.594 s +0.6%
stark/stage1_commit 3.224 s 3.158 s -2.1%
stark/stage2_commit 2.533 s 2.463 s -2.8%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq
phase main PR Δ%
aiur/execute_ixvm 4.305 s 4.237 s -1.6%
aiur/prove_ixvm 26.174 s 25.498 s -2.6%
aiur/witness 979.1 ms 956.1 ms -2.3%
stark/batch_inverse 114.3 ms 116.3 ms +1.7%
stark/fri_open 2.248 s 2.000 s -11.0%
stark/lookup_construction 2.904 s 2.988 s +2.9%
stark/lookup_messages 896.4 ms 997.1 ms +11.2%
stark/lookup_traces 1.881 s 1.862 s -1.0%
stark/prove 17.811 s 17.166 s -3.6%
stark/quotient 6.834 s 6.517 s -4.6%
stark/stage1_commit 3.272 s 3.160 s -3.4%
stark/stage2_commit 2.542 s 2.491 s -2.0%
String.split
phase main PR Δ%
aiur/execute_ixvm 3.997 s 3.982 s -0.4%
aiur/prove_ixvm 24.997 s 24.892 s -0.4%
aiur/witness 1.008 s 955.6 ms -5.2%
stark/batch_inverse 113.6 ms 111.8 ms -1.6%
stark/fri_open 2.162 s 2.080 s -3.8%
stark/lookup_construction 2.834 s 2.836 s +0.1%
stark/lookup_messages 880.9 ms 815.8 ms -7.4%
stark/lookup_traces 1.827 s 1.896 s +3.8%
stark/prove 17.165 s 17.066 s -0.6%
stark/quotient 6.535 s 6.357 s -2.7%
stark/stage1_commit 3.184 s 3.307 s +3.9%
stark/stage2_commit 2.441 s 2.476 s +1.4%
List.mergeSort
phase main PR Δ%
aiur/execute_ixvm 2.712 s 2.727 s +0.6%
aiur/prove_ixvm 16.603 s 17.616 s +6.1%
aiur/witness 608.9 ms 527.7 ms -13.3%
stark/batch_inverse 62.8 ms 63.2 ms +0.5%
stark/fri_open 1.776 s 1.690 s -4.9%
stark/lookup_construction 1.522 s 2.531 s +66.3%
stark/lookup_messages 472.4 ms 491.7 ms +4.1%
stark/lookup_traces 980.3 ms 1.969 s +100.9%
stark/prove 11.184 s 12.275 s +9.8%
stark/quotient 4.338 s 4.514 s +4.1%
stark/stage1_commit 2.015 s 2.018 s +0.2%
stark/stage2_commit 1.529 s 1.517 s -0.8%
Vector.append
phase main PR Δ%
aiur/execute_ixvm 492.8 ms 495.7 ms +0.6%
aiur/prove_ixvm 5.138 s 5.273 s +2.6%
aiur/witness 136.2 ms 149.3 ms +9.6%
stark/batch_inverse 18.1 ms 20.5 ms +13.1%
stark/fri_open 935.8 ms 1.018 s +8.8%
stark/lookup_construction 382.2 ms 389.0 ms +1.8%
stark/lookup_messages 114.9 ms 122.3 ms +6.4%
stark/lookup_traces 248.9 ms 245.9 ms -1.2%
stark/prove 3.987 s 4.103 s +2.9%
stark/quotient 1.501 s 1.531 s +2.0%
stark/stage1_commit 648.3 ms 653.0 ms +0.7%
stark/stage2_commit 518.3 ms 510.4 ms -1.5%
Nat.gcd_comm
phase main PR Δ%
aiur/execute_ixvm 344.3 ms 333.9 ms -3.0%
aiur/prove_ixvm 4.256 s 4.191 s -1.5%
aiur/witness 126.1 ms 120.9 ms -4.1%
stark/batch_inverse 14.7 ms 14.7 ms -0.3%
stark/fri_open 947.6 ms 901.7 ms -4.9%
stark/lookup_construction 294.5 ms 288.4 ms -2.1%
stark/lookup_messages 83.3 ms 82.1 ms -1.5%
stark/lookup_traces 196.1 ms 191.4 ms -2.4%
stark/prove 3.406 s 3.358 s -1.4%
stark/quotient 1.192 s 1.190 s -0.2%
stark/stage1_commit 541.9 ms 540.2 ms -0.3%
stark/stage2_commit 429.0 ms 437.1 ms +1.9%
String.append
phase main PR Δ%
aiur/execute_ixvm 185.0 ms 179.2 ms -3.2%
aiur/prove_ixvm 3.078 s 2.943 s -4.4%
aiur/witness 69.7 ms 66.7 ms -4.3%
stark/batch_inverse 8.2 ms 8.1 ms -0.8%
stark/fri_open 844.8 ms 732.0 ms -13.3%
stark/lookup_construction 203.9 ms 198.4 ms -2.7%
stark/lookup_messages 56.3 ms 55.1 ms -2.2%
stark/lookup_traces 139.1 ms 134.9 ms -3.0%
stark/prove 2.604 s 2.474 s -5.0%
stark/quotient 874.4 ms 873.6 ms -0.1%
stark/stage1_commit 375.7 ms 367.7 ms -2.1%
stark/stage2_commit 304.1 ms 301.3 ms -0.9%
Int.gcd
phase main PR Δ%
aiur/execute_ixvm 120.9 ms 115.4 ms -4.5%
aiur/prove_ixvm 2.370 s 2.393 s +1.0%
aiur/witness 40.1 ms 35.4 ms -11.8%
stark/batch_inverse 5.4 ms 5.2 ms -4.0%
stark/fri_open 715.4 ms 799.1 ms +11.7%
stark/lookup_construction 118.5 ms 101.3 ms -14.5%
stark/lookup_messages 32.6 ms 30.2 ms -7.2%
stark/lookup_traces 80.3 ms 65.6 ms -18.3%
stark/prove 2.062 s 2.095 s +1.6%
stark/quotient 685.4 ms 673.8 ms -1.7%
stark/stage1_commit 292.8 ms 286.7 ms -2.1%
stark/stage2_commit 249.7 ms 233.3 ms -6.5%
Nat.sub_le_of_le_add
phase main PR Δ%
aiur/execute_ixvm 94.6 ms 92.2 ms -2.5%
aiur/prove_ixvm 2.240 s 2.251 s +0.5%
aiur/witness 37.2 ms 37.3 ms +0.4%
stark/batch_inverse 4.6 ms 4.8 ms +4.7%
stark/fri_open 732.0 ms 749.3 ms +2.4%
stark/lookup_construction 96.0 ms 95.3 ms -0.7%
stark/lookup_messages 30.7 ms 29.1 ms -5.1%
stark/lookup_traces 60.4 ms 61.1 ms +1.3%
stark/prove 1.982 s 1.993 s +0.6%
stark/quotient 645.5 ms 637.4 ms -1.3%
stark/stage1_commit 275.6 ms 277.7 ms +0.8%
stark/stage2_commit 232.1 ms 232.7 ms +0.3%
Nat.add_comm
phase main PR Δ%
aiur/execute_ixvm 11.0 ms 10.4 ms -5.5%
aiur/prove_ixvm 1.281 s 1.234 s -3.6%
aiur/witness 10.8 ms 11.1 ms +2.9%
stark/batch_inverse 1.2 ms 1.2 ms +2.5%
stark/fri_open 652.2 ms 587.2 ms -10.0%
stark/lookup_construction 19.4 ms 18.9 ms -2.5%
stark/lookup_messages 6.0 ms 5.5 ms -8.3%
stark/lookup_traces 11.8 ms 11.9 ms +0.8%
stark/prove 1.235 s 1.188 s -3.8%
stark/quotient 307.8 ms 312.6 ms +1.6%
stark/stage1_commit 128.4 ms 140.6 ms +9.6%
stark/stage2_commit 126.7 ms 128.4 ms +1.3%
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual
phase main PR Δ%
aiur/execute_ixvm 1m 18.7s 1m 18.6s -0.1%

compile · InitStd — main from: bencher @ 4954563

constant compile-time (main) compile-time (PR) Δ% throughput (main) throughput (PR) Δ% peak-ram (main) peak-ram (PR) Δ% env-size (main) env-size (PR) Δ% constants (main) constants (PR) Δ%
InitStd n/a 3.988 s n/a n/a 26.45K n/a n/a 11.03 GiB n/a n/a 306.43 MiB n/a n/a 105,492 n/a

1 constants · 0 regressed · 0 improved (|Δ| > 3.0% on any metric).

ooc · InitStd — main from: bencher @ 4954563

constant check-time (main) check-time (PR) Δ% throughput (main) throughput (PR) Δ% peak-ram (main) peak-ram (PR) Δ%
InitStd 10.666 s 10.932 s +2.5% n/a 8.14K n/a n/a 2.11 GiB n/a
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual 6.404 s 6.397 s -0.1% n/a 885.730 n/a n/a 1.88 GiB n/a
Array.extract_append 1.018 s 1.018 s -0.0% n/a 1.52K n/a n/a 1.04 GiB n/a
Vector.extract_append._proof_2 1.013 s 1.013 s +0.0% n/a 1.29K n/a n/a 1.32 GiB n/a
Char.ofOrdinal_le_of_le 775.1 ms 776.0 ms +0.1% n/a 3.43K n/a n/a 1.03 GiB n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq 765.7 ms 765.5 ms -0.0% n/a 2.37K n/a n/a 1.17 GiB n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq 765.7 ms 765.4 ms -0.0% n/a 2.38K n/a n/a 921.61 MiB n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq 1.016 s 765.3 ms -24.7% (1.33× faster) 🟢 n/a 2.38K n/a n/a 1.01 GiB n/a
ByteArray.utf8DecodeChar?_utf8EncodeChar_append 531.0 ms 530.2 ms -0.1% n/a 5.09K n/a n/a 1.11 GiB n/a
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq 266.9 ms 266.3 ms -0.2% n/a 6.82K n/a n/a 1.44 GiB n/a
String.split 265.1 ms 264.8 ms -0.1% n/a 6.69K n/a n/a 1.23 GiB n/a
List.mergeSort 262.0 ms 261.8 ms -0.1% n/a 5.55K n/a n/a 961.74 MiB n/a
Nat.gcd_comm 254.5 ms 255.2 ms +0.3% n/a 1.53K n/a n/a 767.75 MiB n/a
Vector.append 254.6 ms 254.6 ms -0.0% n/a 1.96K n/a n/a 663.37 MiB n/a
String.append 253.0 ms 253.1 ms +0.0% n/a 1.21K n/a n/a 1.14 GiB n/a
Nat.sub_le_of_le_add 252.7 ms 252.7 ms +0.0% n/a 672.730 n/a n/a 598.36 MiB n/a
Int.gcd 252.5 ms 252.6 ms +0.0% n/a 823.500 n/a n/a 654.52 MiB n/a
Nat.add_comm 252.6 ms 252.2 ms -0.2% n/a 166.540 n/a n/a 481.57 MiB n/a

18 constants · 0 regressed · 1 improved (|Δ| > 3.0% on any metric).

zisk · InitStd — main from: bencher @ 4954563

constant execute-time (main) execute-time (PR) Δ% throughput (main) throughput (PR) Δ% peak-ram (main) peak-ram (PR) Δ% cycles (main) cycles (PR) Δ%
ByteArray.utf8DecodeChar?_utf8EncodeChar_append n/a 1m 15.3s n/a n/a 452.00M n/a n/a n/a n/a 34.10B 34.04B -0.2%
Char.ofOrdinal_le_of_le n/a 59.138 s n/a n/a 458.14M n/a n/a n/a n/a 26.87B 27.09B +0.8%
Array.extract_append n/a 47.896 s n/a n/a 504.70M n/a n/a n/a n/a 24.17B 24.17B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq n/a 39.737 s n/a n/a 457.71M n/a n/a n/a n/a 18.19B 18.19B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq n/a 39.219 s n/a n/a 457.92M n/a n/a n/a n/a 17.96B 17.96B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq n/a 38.952 s n/a n/a 462.12M n/a n/a n/a n/a 18.00B 18.00B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq n/a 29.562 s n/a n/a 453.59M n/a n/a n/a n/a 13.41B 13.41B +0.0%
Vector.extract_append._proof_2 n/a 28.195 s n/a n/a 488.88M n/a n/a n/a n/a 13.78B 13.78B +0.0%
String.split n/a 23.153 s n/a n/a 453.95M n/a n/a n/a n/a 10.51B 10.51B +0.0%
List.mergeSort n/a 18.382 s n/a n/a 451.68M n/a n/a n/a n/a 8.30B 8.30B +0.0%
Vector.append n/a 3.986 s n/a n/a 445.78M n/a n/a n/a n/a 1.78B 1.78B +0.0%
Nat.gcd_comm n/a 2.669 s n/a n/a 459.32M n/a n/a n/a n/a 1.23B 1.23B +0.0%
String.append n/a 1.139 s n/a n/a 521.43M n/a n/a n/a n/a 593.96M 593.96M +0.0%
Int.gcd n/a 811.0 ms n/a n/a 504.11M n/a n/a n/a n/a 408.83M 408.83M +0.0%
Nat.sub_le_of_le_add n/a 766.1 ms n/a n/a 486.94M n/a n/a n/a n/a 373.04M 373.04M +0.0%
Nat.add_comm n/a 152.3 ms n/a n/a 349.56M n/a n/a n/a n/a 53.24M 53.24M +0.0%

16 constants · 0 regressed · 0 improved (|Δ| > 3.0% on any metric).

per-phase drill-down

ByteArray.utf8DecodeChar?_utf8EncodeChar_append
phase main PR Δ%
zisk/execute 1m 52.7s 1m 15.3s -33.2%
Char.ofOrdinal_le_of_le
phase main PR Δ%
zisk/execute 1m 26.3s 59.138 s -31.5%
Array.extract_append
phase main PR Δ%
zisk/execute 1m 11.0s 47.896 s -32.6%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq
phase main PR Δ%
zisk/execute 59.765 s 39.737 s -33.5%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq
phase main PR Δ%
zisk/execute 58.497 s 39.219 s -33.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq
phase main PR Δ%
zisk/execute 58.491 s 38.952 s -33.4%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq
phase main PR Δ%
zisk/execute 43.906 s 29.562 s -32.7%
Vector.extract_append._proof_2
phase main PR Δ%
zisk/execute 41.350 s 28.195 s -31.8%
String.split
phase main PR Δ%
zisk/execute 33.644 s 23.153 s -31.2%
List.mergeSort
phase main PR Δ%
zisk/execute 27.158 s 18.382 s -32.3%
Vector.append
phase main PR Δ%
zisk/execute 5.851 s 3.986 s -31.9%
Nat.gcd_comm
phase main PR Δ%
zisk/execute 3.816 s 2.669 s -30.1%
String.append
phase main PR Δ%
zisk/execute 1.608 s 1.139 s -29.2%
Int.gcd
phase main PR Δ%
zisk/execute 1.201 s 811.0 ms -32.5%
Nat.sub_le_of_le_add
phase main PR Δ%
zisk/execute 1.061 s 766.1 ms -27.8%
Nat.add_comm
phase main PR Δ%
zisk/execute 331.4 ms 152.3 ms -54.0%

Workflow logs

Workflow logs

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark zisc

@argument-ci-bot

Copy link
Copy Markdown

❌ benchmark run failed

unknown token zisc in the benchmark command (expected a backend — aiur, zisk, sp1, ooc, compile — or all / execute)

Workflow logs

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark

@argument-ci-bot

Copy link
Copy Markdown

!benchmark — main vs dd5b97a

backends: aiur=prove · envs: InitStd · set: primary · shard: 0

aiur · InitStd · prove — main from: bencher @ 5b3d110 + base run (1 new)

constant prove-time (main) prove-time (PR) Δ% peak-ram (main) peak-ram (PR) Δ% execute-time (main) execute-time (PR) Δ% verify-time (main) verify-time (PR) Δ% proof-size (main) proof-size (PR) Δ% fft-cost (main) fft-cost (PR) Δ%
ByteArray.utf8DecodeChar?_utf8EncodeChar_append 56.033 s 55.092 s -1.7% 100.89 GiB 100.87 GiB -0.0% 12.058 s 11.894 s -1.4% 219.7 ms 204.3 ms -7.0% (1.08× faster) 🟢 33.27 MiB 33.27 MiB +0.0% 42.43B 42.43B +0.0%
Array.extract_append 53.042 s 53.180 s +0.3% 92.84 GiB 92.83 GiB -0.0% 12.584 s 12.502 s -0.6% 230.1 ms 204.6 ms -11.1% (1.12× faster) 🟢 33.27 MiB 33.27 MiB +0.0% 40.03B 40.03B +0.0%
Char.ofOrdinal_le_of_le 42.984 s 42.229 s -1.8% 76.02 GiB 75.92 GiB -0.1% 8.962 s 8.972 s +0.1% 211.1 ms 218.2 ms +3.3% ⚠️ 33.27 MiB 33.27 MiB +0.0% 32.73B 32.73B +0.0%
Vector.extract_append._proof_2 31.427 s 31.182 s -0.8% 53.47 GiB 53.52 GiB +0.1% 6.783 s 6.879 s +1.4% 222.1 ms 218.4 ms -1.7% 33.19 MiB 33.19 MiB +0.0% 23.34B 23.34B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq 25.817 s 26.296 s +1.9% 48.92 GiB 48.58 GiB -0.7% 4.251 s 4.358 s +2.5% 220.3 ms 216.3 ms -1.8% 33.19 MiB 33.19 MiB +0.0% 17.43B 17.43B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq 26.363 s 26.179 s -0.7% 48.93 GiB 48.84 GiB -0.2% 4.393 s 4.441 s +1.1% 218.2 ms 216.9 ms -0.6% 33.19 MiB 33.19 MiB +0.0% 17.43B 17.43B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq 25.973 s 25.997 s +0.1% 48.61 GiB 48.54 GiB -0.2% 4.334 s 4.338 s +0.1% 205.5 ms 212.5 ms +3.4% ⚠️ 33.19 MiB 33.19 MiB +0.0% 17.43B 17.43B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq 25.856 s 25.931 s +0.3% 48.61 GiB 48.87 GiB +0.5% 4.342 s 4.392 s +1.1% 212.8 ms 205.6 ms -3.4% 🟢 33.19 MiB 33.19 MiB +0.0% 17.42B 17.42B +0.0%
String.split 25.136 s 24.728 s -1.6% 46.99 GiB 47.03 GiB +0.1% 4.041 s 4.094 s +1.3% 212.0 ms 214.8 ms +1.3% 33.19 MiB 33.19 MiB +0.0% 15.99B 15.99B +0.0%
List.mergeSort 16.945 s 17.331 s +2.3% 29.84 GiB 29.84 GiB -0.0% 2.776 s 2.759 s -0.6% 227.1 ms 203.2 ms -10.5% (1.12× faster) 🟢 33.19 MiB 33.19 MiB +0.0% 11.63B 11.63B +0.0%
Vector.append 5.269 s 5.251 s -0.4% 8.99 GiB 8.92 GiB -0.8% 514.0 ms 533.1 ms +3.7% ⚠️ 201.5 ms 218.8 ms +8.6% (1.09× slower) ⚠️ 32.96 MiB 32.96 MiB +0.0% 2.60B 2.60B +0.0%
Nat.gcd_comm 4.265 s 4.271 s +0.1% 7.11 GiB 7.10 GiB -0.3% 354.1 ms 356.4 ms +0.7% 214.1 ms 206.9 ms -3.3% 🟢 32.96 MiB 32.96 MiB +0.0% 1.75B 1.75B +0.0%
String.append 3.058 s 3.085 s +0.9% 4.48 GiB 4.45 GiB -0.6% 187.6 ms 187.3 ms -0.1% 215.5 ms 216.3 ms +0.4% 32.89 MiB 32.89 MiB +0.0% 967.65M 967.65M +0.0%
Int.gcd 2.460 s 2.317 s -5.8% (1.06× faster) 🟢 3.27 GiB 3.27 GiB +0.2% 127.4 ms 124.5 ms -2.3% 201.3 ms 195.5 ms -2.9% 32.89 MiB 32.89 MiB +0.0% 605.84M 605.84M +0.0%
Nat.sub_le_of_le_add 2.220 s 2.175 s -2.0% 3.07 GiB 3.04 GiB -0.9% 99.9 ms 99.4 ms -0.5% 203.1 ms 212.7 ms +4.8% ⚠️ 32.89 MiB 32.89 MiB +0.0% 510.60M 510.60M +0.0%
Nat.add_comm 1.206 s 1.326 s +9.9% (1.10× slower) ⚠️ 1.44 GiB 1.44 GiB -0.1% 16.3 ms 15.6 ms -4.1% 🟢 212.2 ms 194.1 ms -8.6% (1.09× faster) 🟢 32.76 MiB 32.76 MiB +0.0% 53.90M 53.90M +0.0%
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual OOM OOM n/a OOM OOM n/a 1m 19.7s 1m 19.5s -0.3% OOM OOM n/a OOM OOM n/a 261.03B 261.03B +0.0%

17 constants · 5 regressed · 6 improved (|Δ| > 3.0% on any metric).

per-phase drill-down

ByteArray.utf8DecodeChar?_utf8EncodeChar_append
phase main PR Δ%
aiur-execute-ixvm 11.646 s 11.787 s +1.2%
aiur-prove-ixvm 55.981 s 55.009 s -1.7%
aiur-witness 1.982 s 2.206 s +11.3%
stark-batch-inverse 245.6 ms 253.2 ms +3.1%
stark-fri-open 3.297 s 3.180 s -3.5%
stark-lookup-construction 6.870 s 6.344 s -7.7%
stark-lookup-messages 2.696 s 2.165 s -19.7%
stark-lookup-traces 3.902 s 3.901 s -0.0%
stark-prove 35.285 s 34.010 s -3.6%
stark-quotient 13.604 s 12.925 s -5.0%
stark-stage1-commit 6.481 s 6.618 s +2.1%
stark-stage2-commit 5.009 s 4.922 s -1.7%
Array.extract_append
phase main PR Δ%
aiur-execute-ixvm 12.357 s 12.525 s +1.4%
aiur-prove-ixvm 52.989 s 53.137 s +0.3%
aiur-witness 1.544 s 1.543 s -0.1%
stark-batch-inverse 221.1 ms 231.2 ms +4.5%
stark-fri-open 3.243 s 3.101 s -4.4%
stark-lookup-construction 5.311 s 5.527 s +4.1%
stark-lookup-messages 1.344 s 1.553 s +15.6%
stark-lookup-traces 3.721 s 3.717 s -0.1%
stark-prove 32.799 s 32.836 s +0.1%
stark-quotient 13.371 s 13.475 s +0.8%
stark-stage1-commit 6.093 s 5.976 s -1.9%
stark-stage2-commit 4.761 s 4.738 s -0.5%
Char.ofOrdinal_le_of_le
phase main PR Δ%
aiur-execute-ixvm 8.790 s 8.814 s +0.3%
aiur-prove-ixvm 42.889 s 42.136 s -1.8%
aiur-witness 1.229 s 1.356 s +10.3%
stark-batch-inverse 175.9 ms 163.5 ms -7.0%
stark-fri-open 3.016 s 2.827 s -6.3%
stark-lookup-construction 4.305 s 4.154 s -3.5%
stark-lookup-messages 1.168 s 1.157 s -0.9%
stark-lookup-traces 2.942 s 2.815 s -4.3%
stark-prove 27.422 s 26.569 s -3.1%
stark-quotient 10.879 s 10.757 s -1.1%
stark-stage1-commit 5.356 s 5.124 s -4.3%
stark-stage2-commit 3.856 s 3.697 s -4.1%
Vector.extract_append._proof_2
phase main PR Δ%
aiur-execute-ixvm 6.967 s 6.850 s -1.7%
aiur-prove-ixvm 31.374 s 31.164 s -0.7%
aiur-witness 872.3 ms 896.5 ms +2.8%
stark-batch-inverse 131.1 ms 120.2 ms -8.3%
stark-fri-open 2.291 s 2.209 s -3.6%
stark-lookup-construction 3.015 s 3.015 s +0.0%
stark-lookup-messages 899.6 ms 874.4 ms -2.8%
stark-lookup-traces 1.971 s 2.006 s +1.8%
stark-prove 19.719 s 19.580 s -0.7%
stark-quotient 8.160 s 8.110 s -0.6%
stark-stage1-commit 3.516 s 3.515 s -0.0%
stark-stage2-commit 2.734 s 2.728 s -0.2%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq
phase main PR Δ%
aiur-execute-ixvm 4.203 s 4.308 s +2.5%
aiur-prove-ixvm 25.788 s 26.261 s +1.8%
aiur-witness 1.051 s 956.7 ms -9.0%
stark-batch-inverse 110.2 ms 114.7 ms +4.0%
stark-fri-open 2.141 s 2.023 s -5.5%
stark-lookup-construction 3.020 s 2.968 s -1.7%
stark-lookup-messages 1.028 s 911.6 ms -11.3%
stark-lookup-traces 1.869 s 1.929 s +3.2%
stark-prove 17.433 s 17.882 s +2.6%
stark-quotient 6.536 s 7.055 s +7.9%
stark-stage1-commit 3.201 s 3.279 s +2.4%
stark-stage2-commit 2.526 s 2.548 s +0.9%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq
phase main PR Δ%
aiur-execute-ixvm 4.459 s 4.347 s -2.5%
aiur-prove-ixvm 26.299 s 26.114 s -0.7%
aiur-witness 1.064 s 965.9 ms -9.2%
stark-batch-inverse 121.7 ms 115.4 ms -5.2%
stark-fri-open 2.135 s 2.059 s -3.5%
stark-lookup-construction 3.059 s 2.887 s -5.6%
stark-lookup-messages 1.046 s 882.4 ms -15.7%
stark-lookup-traces 1.876 s 1.876 s -0.0%
stark-prove 17.704 s 17.694 s -0.1%
stark-quotient 6.601 s 6.911 s +4.7%
stark-stage1-commit 3.318 s 3.270 s -1.5%
stark-stage2-commit 2.581 s 2.556 s -1.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq
phase main PR Δ%
aiur-execute-ixvm 4.322 s 4.292 s -0.7%
aiur-prove-ixvm 25.896 s 25.929 s +0.1%
aiur-witness 993.6 ms 980.6 ms -1.3%
stark-batch-inverse 120.6 ms 117.0 ms -3.0%
stark-fri-open 2.224 s 1.996 s -10.2%
stark-lookup-construction 3.032 s 3.090 s +1.9%
stark-lookup-messages 1.042 s 1.080 s +3.7%
stark-lookup-traces 1.857 s 1.879 s +1.2%
stark-prove 17.498 s 17.597 s +0.6%
stark-quotient 6.487 s 6.704 s +3.3%
stark-stage1-commit 3.248 s 3.249 s +0.0%
stark-stage2-commit 2.497 s 2.549 s +2.1%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq
phase main PR Δ%
aiur-execute-ixvm 4.235 s 4.317 s +1.9%
aiur-prove-ixvm 25.793 s 25.874 s +0.3%
aiur-witness 1.059 s 1.119 s +5.7%
stark-batch-inverse 113.5 ms 114.9 ms +1.2%
stark-fri-open 2.090 s 2.027 s -3.0%
stark-lookup-construction 2.901 s 3.054 s +5.3%
stark-lookup-messages 877.1 ms 1.013 s +15.5%
stark-lookup-traces 1.897 s 1.912 s +0.8%
stark-prove 17.400 s 17.380 s -0.1%
stark-quotient 6.594 s 6.583 s -0.2%
stark-stage1-commit 3.271 s 3.197 s -2.3%
stark-stage2-commit 2.534 s 2.509 s -1.0%
String.split
phase main PR Δ%
aiur-execute-ixvm 4.033 s 4.086 s +1.3%
aiur-prove-ixvm 25.081 s 24.699 s -1.5%
aiur-witness 942.5 ms 926.8 ms -1.7%
stark-batch-inverse 119.7 ms 110.4 ms -7.7%
stark-fri-open 2.192 s 2.063 s -5.9%
stark-lookup-construction 2.867 s 2.768 s -3.5%
stark-lookup-messages 853.2 ms 807.8 ms -5.3%
stark-lookup-traces 1.882 s 1.838 s -2.4%
stark-prove 17.243 s 16.804 s -2.5%
stark-quotient 6.424 s 6.351 s -1.1%
stark-stage1-commit 3.224 s 3.159 s -2.0%
stark-stage2-commit 2.526 s 2.452 s -2.9%
List.mergeSort
phase main PR Δ%
aiur-execute-ixvm 2.718 s 2.722 s +0.1%
aiur-prove-ixvm 16.896 s 17.279 s +2.3%
aiur-witness 602.4 ms 572.6 ms -4.9%
stark-batch-inverse 70.2 ms 68.6 ms -2.3%
stark-fri-open 1.843 s 1.944 s +5.5%
stark-lookup-construction 1.577 s 1.613 s +2.3%
stark-lookup-messages 501.0 ms 519.7 ms +3.7%
stark-lookup-traces 999.0 ms 1.018 s +1.9%
stark-prove 11.477 s 11.907 s +3.7%
stark-quotient 4.438 s 4.727 s +6.5%
stark-stage1-commit 2.072 s 2.072 s -0.0%
stark-stage2-commit 1.542 s 1.547 s +0.3%
Vector.append
phase main PR Δ%
aiur-execute-ixvm 491.1 ms 509.9 ms +3.8%
aiur-prove-ixvm 5.264 s 5.245 s -0.4%
aiur-witness 138.6 ms 141.3 ms +1.9%
stark-batch-inverse 17.1 ms 17.4 ms +1.8%
stark-fri-open 975.9 ms 973.2 ms -0.3%
stark-lookup-construction 399.4 ms 382.5 ms -4.2%
stark-lookup-messages 138.5 ms 118.8 ms -14.2%
stark-lookup-traces 243.5 ms 246.0 ms +1.0%
stark-prove 4.116 s 4.072 s -1.1%
stark-quotient 1.590 s 1.542 s -3.0%
stark-stage1-commit 641.3 ms 661.7 ms +3.2%
stark-stage2-commit 509.0 ms 511.4 ms +0.5%
Nat.gcd_comm
phase main PR Δ%
aiur-execute-ixvm 337.2 ms 333.1 ms -1.2%
aiur-prove-ixvm 4.261 s 4.266 s +0.1%
aiur-witness 126.3 ms 115.1 ms -8.9%
stark-batch-inverse 15.1 ms 14.8 ms -2.2%
stark-fri-open 911.8 ms 956.2 ms +4.9%
stark-lookup-construction 296.4 ms 292.8 ms -1.2%
stark-lookup-messages 87.2 ms 84.6 ms -3.0%
stark-lookup-traces 193.8 ms 193.2 ms -0.3%
stark-prove 3.417 s 3.437 s +0.6%
stark-quotient 1.226 s 1.217 s -0.7%
stark-stage1-commit 543.0 ms 541.1 ms -0.4%
stark-stage2-commit 439.6 ms 428.7 ms -2.5%
String.append
phase main PR Δ%
aiur-execute-ixvm 175.4 ms 186.2 ms +6.1%
aiur-prove-ixvm 3.053 s 3.081 s +0.9%
aiur-witness 64.1 ms 62.0 ms -3.4%
stark-batch-inverse 22.1 ms 23.4 ms +5.9%
stark-fri-open 804.7 ms 843.0 ms +4.8%
stark-lookup-construction 222.3 ms 222.6 ms +0.1%
stark-lookup-messages 60.7 ms 63.1 ms +3.8%
stark-lookup-traces 139.2 ms 135.9 ms -2.4%
stark-prove 2.590 s 2.612 s +0.8%
stark-quotient 888.6 ms 864.5 ms -2.7%
stark-stage1-commit 377.5 ms 375.7 ms -0.5%
stark-stage2-commit 296.5 ms 305.5 ms +3.0%
Int.gcd
phase main PR Δ%
aiur-execute-ixvm 120.4 ms 119.6 ms -0.7%
aiur-prove-ixvm 2.458 s 2.313 s -5.9%
aiur-witness 37.4 ms 38.3 ms +2.4%
stark-batch-inverse 5.5 ms 5.7 ms +3.7%
stark-fri-open 773.4 ms 690.8 ms -10.7%
stark-lookup-construction 121.0 ms 117.6 ms -2.8%
stark-lookup-messages 33.0 ms 31.6 ms -4.4%
stark-lookup-traces 82.2 ms 80.1 ms -2.5%
stark-prove 2.153 s 2.009 s -6.7%
stark-quotient 701.4 ms 669.0 ms -4.6%
stark-stage1-commit 298.0 ms 284.3 ms -4.6%
stark-stage2-commit 258.3 ms 246.8 ms -4.5%
Nat.sub_le_of_le_add
phase main PR Δ%
aiur-execute-ixvm 98.5 ms 95.7 ms -2.9%
aiur-prove-ixvm 2.217 s 2.171 s -2.1%
aiur-witness 34.5 ms 34.9 ms +1.1%
stark-batch-inverse 4.9 ms 4.8 ms -1.8%
stark-fri-open 695.2 ms 669.7 ms -3.7%
stark-lookup-construction 99.7 ms 97.2 ms -2.5%
stark-lookup-messages 33.2 ms 28.9 ms -13.0%
stark-lookup-traces 61.2 ms 63.2 ms +3.2%
stark-prove 1.957 s 1.914 s -2.2%
stark-quotient 650.2 ms 634.6 ms -2.4%
stark-stage1-commit 276.3 ms 284.8 ms +3.1%
stark-stage2-commit 234.6 ms 226.6 ms -3.4%
Nat.add_comm
phase main PR Δ%
aiur-execute-ixvm 10.7 ms 13.5 ms +25.7%
aiur-prove-ixvm 1.206 s 1.325 s +9.9%
aiur-witness 10.8 ms 11.9 ms +10.2%
stark-batch-inverse 1.3 ms 2.0 ms +55.4%
stark-fri-open 553.8 ms 687.6 ms +24.2%
stark-lookup-construction 18.7 ms 19.5 ms +4.0%
stark-lookup-messages 5.4 ms 5.4 ms -0.5%
stark-lookup-traces 11.8 ms 11.9 ms +0.6%
stark-prove 1.159 s 1.275 s +10.0%
stark-quotient 323.7 ms 312.0 ms -3.6%
stark-stage1-commit 130.1 ms 138.2 ms +6.2%
stark-stage2-commit 132.4 ms 117.5 ms -11.2%
Std.Tactic.BVDecide.BVExpr.bitblast.goCache_Inv_of_Inv._mutual
phase main PR Δ%
aiur-execute-ixvm 1m 18.9s 1m 19.5s +0.8%

Workflow logs

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark ix-compile

@argument-ci-bot

Copy link
Copy Markdown

❌ benchmark run failed

unknown token ix-compile in the benchmark command (expected a backend — aiur, zisk, sp1, ooc, compile — or all / execute)

Workflow logs

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark compile

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark zisk

@argument-ci-bot

Copy link
Copy Markdown

!benchmark — main vs dd5b97a

backends: compile · envs: InitStd · set: primary · shard: 0

compile · InitStd — main from: bencher @ ff01e2f

constant compile-time (main) compile-time (PR) Δ% throughput (main) throughput (PR) Δ% peak-ram (main) peak-ram (PR) Δ% env-size (main) env-size (PR) Δ% constants (main) constants (PR) Δ%
InitStd 4.266 s 4.021 s -5.7% (1.06× faster) 🟢 24.73K 26.24K +6.1% (1.06× faster) 🟢 11.27 GiB 11.17 GiB -0.9% 306.43 MiB 306.43 MiB +0.0% 105,492 105,492 +0.0%

1 constants · 0 regressed · 1 improved (|Δ| > 3.0% on any metric).

Workflow logs

@samuelburnham

Copy link
Copy Markdown
Member Author

!benchmark compile
BENCH_ENVS=InitStd,Mathlib

@argument-ci-bot

Copy link
Copy Markdown

⚠️ Some benchmark jobs failed — results may be partial.

!benchmark — main vs dd5b97a

backends: compile · envs: InitStd,Mathlib · set: primary · shard: 0

No result tables were produced — see the run logs.

Workflow logs

@argument-ci-bot

Copy link
Copy Markdown

⚠️ Some benchmark jobs failed — results may be partial.

!benchmark — main vs dd5b97a

backends: zisk · envs: InitStd · set: primary · shard: 0

zisk · InitStd — main from: bencher @ ff01e2f

constant execute-time (main) execute-time (PR) Δ% throughput (main) throughput (PR) Δ% peak-ram (main) peak-ram (PR) Δ% cycles (main) cycles (PR) Δ%
ByteArray.utf8DecodeChar?_utf8EncodeChar_append 1m 13.8s 1m 50.3s +49.5% (1.49× slower) ⚠️ 461.97M 309.09M -33.1% (1.49× slower) ⚠️ n/a n/a n/a 34.11B 34.11B +0.0%
Char.ofOrdinal_le_of_le 57.652 s 1m 26.4s +49.8% (1.50× slower) ⚠️ 469.79M 315.46M -32.9% (1.49× slower) ⚠️ n/a n/a n/a 27.08B 27.25B +0.6%
Array.extract_append 46.922 s 1m 9.6s +48.3% (1.48× slower) ⚠️ 515.17M 347.29M -32.6% (1.48× slower) ⚠️ n/a n/a n/a 24.17B 24.17B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq 38.925 s 58.588 s +50.5% (1.51× slower) ⚠️ 467.26M 310.44M -33.6% (1.51× slower) ⚠️ n/a n/a n/a 18.19B 18.19B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq 38.265 s 57.192 s +49.5% (1.49× slower) ⚠️ 470.42M 314.74M -33.1% (1.49× slower) ⚠️ n/a n/a n/a 18.00B 18.00B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq 37.943 s 57.185 s +50.7% (1.51× slower) ⚠️ 473.32M 314.06M -33.6% (1.51× slower) ⚠️ n/a n/a n/a 17.96B 17.96B +0.0%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq 29.003 s 43.156 s +48.8% (1.49× slower) ⚠️ 462.33M 310.71M -32.8% (1.49× slower) ⚠️ n/a n/a n/a 13.41B 13.41B +0.0%
Vector.extract_append._proof_2 27.979 s 40.406 s +44.4% (1.44× slower) ⚠️ 492.65M 341.14M -30.8% (1.44× slower) ⚠️ n/a n/a n/a 13.78B 13.78B +0.0%
String.split 22.654 s 33.526 s +48.0% (1.48× slower) ⚠️ 463.96M 313.49M -32.4% (1.48× slower) ⚠️ n/a n/a n/a 10.51B 10.51B +0.0%
List.mergeSort 17.963 s 26.552 s +47.8% (1.48× slower) ⚠️ 462.22M 312.70M -32.3% (1.48× slower) ⚠️ n/a n/a n/a 8.30B 8.30B +0.0%
Vector.append 3.863 s 5.813 s +50.5% (1.50× slower) ⚠️ 459.98M 305.69M -33.5% (1.50× slower) ⚠️ n/a n/a n/a 1.78B 1.78B +0.0%
Nat.gcd_comm 2.570 s 3.839 s +49.4% (1.49× slower) ⚠️ 476.86M 319.24M -33.1% (1.49× slower) ⚠️ n/a n/a n/a 1.23B 1.23B +0.0%
String.append 1.107 s 1.683 s +52.0% (1.52× slower) ⚠️ 536.61M 353.02M -34.2% (1.52× slower) ⚠️ n/a n/a n/a 593.96M 593.96M +0.0%
Int.gcd 791.6 ms 1.157 s +46.2% (1.46× slower) ⚠️ 516.50M 353.24M -31.6% (1.46× slower) ⚠️ n/a n/a n/a 408.83M 408.83M +0.0%
Nat.sub_le_of_le_add 711.9 ms 1.045 s +46.7% (1.47× slower) ⚠️ 524.04M 357.13M -31.9% (1.47× slower) ⚠️ n/a n/a n/a 373.04M 373.04M +0.0%
Nat.add_comm 149.4 ms 329.5 ms +120.5% (2.20× slower) ⚠️ 356.29M 161.59M -54.6% (2.20× slower) ⚠️ n/a n/a n/a 53.24M 53.24M +0.0%

16 constants · 16 regressed · 0 improved (|Δ| > 3.0% on any metric).

per-phase drill-down

ByteArray.utf8DecodeChar?_utf8EncodeChar_append
phase main PR Δ%
zisk-execute 1m 13.8s 1m 50.3s +49.5%
Char.ofOrdinal_le_of_le
phase main PR Δ%
zisk-execute 57.652 s 1m 26.4s +49.8%
Array.extract_append
phase main PR Δ%
zisk-execute 46.922 s 1m 9.6s +48.3%
_private.Init.Data.Range.Polymorphic.SInt.0.Int32.instRxcHasSize_eq
phase main PR Δ%
zisk-execute 38.925 s 58.588 s +50.5%
_private.Init.Data.Range.Polymorphic.SInt.0.Int16.instRxcHasSize_eq
phase main PR Δ%
zisk-execute 38.265 s 57.192 s +49.5%
_private.Init.Data.Range.Polymorphic.SInt.0.Int64.instRxcHasSize_eq
phase main PR Δ%
zisk-execute 37.943 s 57.185 s +50.7%
_private.Init.Data.Range.Polymorphic.SInt.0.Int8.instRxcHasSize_eq
phase main PR Δ%
zisk-execute 29.003 s 43.156 s +48.8%
Vector.extract_append._proof_2
phase main PR Δ%
zisk-execute 27.979 s 40.406 s +44.4%
String.split
phase main PR Δ%
zisk-execute 22.654 s 33.526 s +48.0%
List.mergeSort
phase main PR Δ%
zisk-execute 17.963 s 26.552 s +47.8%
Vector.append
phase main PR Δ%
zisk-execute 3.863 s 5.813 s +50.5%
Nat.gcd_comm
phase main PR Δ%
zisk-execute 2.570 s 3.839 s +49.4%
String.append
phase main PR Δ%
zisk-execute 1.107 s 1.683 s +52.0%
Int.gcd
phase main PR Δ%
zisk-execute 791.6 ms 1.157 s +46.2%
Nat.sub_le_of_le_add
phase main PR Δ%
zisk-execute 711.9 ms 1.045 s +46.7%
Nat.add_comm
phase main PR Δ%
zisk-execute 149.4 ms 329.5 ms +120.5%

Workflow logs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant