Skip to content

Conversation

@TrueDoctor
Copy link
Member

@TrueDoctor TrueDoctor commented Sep 10, 2025

Optimizations:

  • Improve Message::Batched to not require cloning messages
  • Memoize NodeNetwork hash computation
  • Improve performance for calculation of selected nodes
  • Improve performance of click target bounding box computation

@github-actions
Copy link

github-actions bot commented Sep 10, 2025

Performance Benchmark Results

🔧 Graph Compilation

compile_demo_art_iai::compile_group::compile_to_proto with_setup_0:load_from_name(isometric-fountain)
Instructions: 27,170,377 (master) → 27,262,539 (HEAD) : $$\color{red}+0.34\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.75%
D1mr                     343,144|    347,056          +1.14%
D1mw                     107,381|    107,971          +0.55%
DLmr                      30,415|     30,434          +0.06%
DLmw                      47,565|     47,598          +0.07%
Dr                     6,730,297|  6,749,417          +0.28%
Dw                     4,718,153|  4,727,068          +0.19%
EstimatedCycles       42,990,861| 43,131,006          +0.33%
I1MissRate                     0|          0          -0.21%
I1mr                      51,236|     51,301          +0.13%
ILmr                         853|        857          +0.47%
Ir                    27,170,377| 27,262,539          +0.34%
L1HitRate                     99|         99          -0.01%
L1hits                38,117,066| 38,232,696          +0.30%
LLHitRate                      1|          1          +0.75%
LLMissRate                     0|          0          -0.24%
LLdMissRate                    1|          1          -0.18%
LLhits                   422,928|    427,439          +1.07%
LLiMissRate                    0|          0          +0.13%
RamHitRate                     0|          0          -0.24%
RamHits                   78,833|     78,889          +0.07%
TotalRW               38,618,827| 38,739,024          +0.31%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_1:load_from_name(painted-dreams)
Instructions: 13,765,056 (master) → 13,766,989 (HEAD) : $$\color{red}+0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.19%
D1mr                     162,655|    162,890          +0.14%
D1mw                      47,971|     48,155          +0.38%
DLmr                         610|        616          +0.98%
DLmw                      11,682|     11,640          -0.36%
Dr                     3,414,091|  3,414,990          +0.03%
Dw                     2,378,893|  2,378,516          -0.02%
EstimatedCycles       20,892,828| 20,894,281          +0.01%
I1MissRate                     0|          0          -1.67%
I1mr                      25,526|     25,104          -1.65%
ILmr                         714|        717          +0.42%
Ir                    13,765,056| 13,766,989          +0.01%
L1HitRate                     99|         99          +0.00%
L1hits                19,321,888| 19,324,346          +0.01%
LLHitRate                      1|          1          +0.00%
LLMissRate                     0|          0          -0.27%
LLdMissRate                    0|          0          -0.30%
LLhits                   223,146|    223,176          +0.01%
LLiMissRate                    0|          0          +0.41%
RamHitRate                     0|          0          -0.27%
RamHits                   13,006|     12,973          -0.25%
TotalRW               19,558,040| 19,560,495          +0.01%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_2:load_from_name(procedural-string-lights)
Instructions: 3,074,736 (master) → 3,075,236 (HEAD) : $$\color{red}+0.02\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.02%
D1mr                      36,035|     36,058          +0.06%
D1mw                      10,717|     10,706          -0.10%
DLmr                          15|         14          -6.67%
DLmw                       2,930|      2,905          -0.85%
Dr                       749,776|    749,980          +0.03%
Dw                       524,675|    524,594          -0.02%
EstimatedCycles        4,666,625|  4,666,432          -0.00%
I1MissRate                     0|          0          -0.13%
I1mr                       5,300|      5,294          -0.11%
ILmr                         696|        694          -0.29%
Ir                     3,074,736|  3,075,236          +0.02%
L1HitRate                     99|         99          +0.00%
L1hits                 4,297,135|  4,297,752          +0.01%
LLHitRate                      1|          1          +0.06%
LLMissRate                     0|          0          -0.78%
LLdMissRate                    0|          0          -0.89%
LLhits                    48,411|     48,445          +0.07%
LLiMissRate                    0|          0          -0.30%
RamHitRate                     0|          0          -0.78%
RamHits                    3,641|      3,613          -0.77%
TotalRW                4,349,187|  4,349,810          +0.01%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_3:load_from_name(parametric-dunescape)
Instructions: 13,606,509 (master) → 13,608,010 (HEAD) : $$\color{red}+0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          -0.18%
D1mr                     171,222|    170,978          -0.14%
D1mw                      49,439|     49,294          -0.29%
DLmr                          60|         68         +13.33%
DLmw                      10,911|     10,701          -1.92%
Dr                     3,329,284|  3,329,803          +0.02%
Dw                     2,347,614|  2,347,022          -0.03%
EstimatedCycles       20,596,635| 20,595,741          -0.00%
I1MissRate                     0|          0          +7.16%
I1mr                      19,191|     20,567          +7.17%
ILmr                         823|        816          -0.85%
Ir                    13,606,509| 13,608,010          +0.01%
L1HitRate                     99|         99          -0.01%
L1hits                19,043,555| 19,043,996          +0.00%
LLHitRate                      1|          1          +0.52%
LLMissRate                     0|          0          -1.78%
LLdMissRate                    0|          0          -1.84%
LLhits                   228,058|    229,254          +0.52%
LLiMissRate                    0|          0          -0.86%
RamHitRate                     0|          0          -1.78%
RamHits                   11,794|     11,585          -1.77%
TotalRW               19,283,407| 19,284,835          +0.01%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_4:load_from_name(red-dress)
Instructions: 32,152,743 (master) → 32,154,389 (HEAD) : $$\color{red}+0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.11%
D1mr                     405,458|    406,172          +0.18%
D1mw                     123,624|    123,532          -0.07%
DLmr                      42,211|     42,127          -0.20%
DLmw                      52,057|     52,293          +0.45%
Dr                     7,920,584|  7,922,283          +0.02%
Dw                     5,552,683|  5,551,553          -0.02%
EstimatedCycles       50,823,520| 50,832,933          +0.02%
I1MissRate                     0|          0          -0.01%
I1mr                      56,903|     56,903          +0.00%
ILmr                         851|        856          +0.59%
Ir                    32,152,743| 32,154,389          +0.01%
L1HitRate                     99|         99          -0.00%
L1hits                45,040,025| 45,041,618          +0.00%
LLHitRate                      1|          1          +0.09%
LLMissRate                     0|          0          +0.16%
LLdMissRate                    1|          1          +0.16%
LLhits                   490,866|    491,331          +0.09%
LLiMissRate                    0|          0          +0.58%
RamHitRate                     0|          0          +0.16%
RamHits                   95,119|     95,276          +0.17%
TotalRW               45,626,010| 45,628,225          +0.00%

compile_demo_art_iai::compile_group::compile_to_proto with_setup_5:load_from_name(valley-of-spires)
Instructions: 21,100,703 (master) → 21,103,648 (HEAD) : $$\color{red}+0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.09%
D1mr                     261,837|    262,156          +0.12%
D1mw                      77,411|     77,442          +0.04%
DLmr                      14,962|     15,120          +1.06%
DLmw                      37,322|     37,469          +0.39%
Dr                     5,220,945|  5,221,976          +0.02%
Dw                     3,653,203|  3,653,139          -0.00%
EstimatedCycles       33,078,915| 33,092,241          +0.04%
I1MissRate                     0|          0          -0.67%
I1mr                      38,533|     38,279          -0.66%
ILmr                         814|        810          -0.49%
Ir                    21,100,703| 21,103,648          +0.01%
L1HitRate                     99|         99          -0.00%
L1hits                29,597,070| 29,600,886          +0.01%
LLHitRate                      1|          1          -0.08%
LLMissRate                     0|          0          +0.55%
LLdMissRate                    1|          1          +0.57%
LLhits                   324,683|    324,478          -0.06%
LLiMissRate                    0|          0          -0.51%
RamHitRate                     0|          0          +0.55%
RamHits                   53,098|     53,399          +0.57%
TotalRW               29,974,851| 29,978,763          +0.01%

🔄 Executor Update

update_executor_iai::update_group::update_executor with_setup_0:setup_update_executor(isometric-fountain)
Instructions: 40,779,184 (master) → 40,923,880 (HEAD) : $$\color{red}+0.35\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          -1.57%
D1mr                     452,703|    447,501          -1.15%
D1mw                      98,181|     97,525          -0.67%
DLmr                       9,330|      9,788          +4.91%
DLmw                      23,362|     24,339          +4.18%
Dr                    10,360,396| 10,401,222          +0.39%
Dw                     6,972,600|  7,020,845          +0.69%
EstimatedCycles       61,366,456| 61,658,435          +0.48%
I1MissRate                     0|          0         +60.33%
I1mr                      15,830|     25,471         +60.90%
ILmr                         222|        223          +0.45%
Ir                    40,779,184| 40,923,880          +0.35%
L1HitRate                     99|         99          -0.00%
L1hits                57,545,466| 57,775,450          +0.40%
LLHitRate                      1|          1          +0.04%
LLMissRate                     0|          0          +3.94%
LLdMissRate                    0|          0          +3.86%
LLhits                   533,800|    536,147          +0.44%
LLiMissRate                    0|          0          +0.10%
RamHitRate                     0|          0          +3.94%
RamHits                   32,914|     34,350          +4.36%
TotalRW               58,112,180| 58,345,947          +0.40%

update_executor_iai::update_group::update_executor with_setup_1:setup_update_executor(painted-dreams)
Instructions: 21,447,643 (master) → 21,573,229 (HEAD) : $$\color{red}+0.59\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          -1.06%
D1mr                     231,510|    230,978          -0.23%
D1mw                      50,265|     49,747          -1.03%
DLmr                       1,005|      1,116         +11.04%
DLmw                      11,295|     12,947         +14.63%
Dr                     5,442,281|  5,475,097          +0.60%
Dw                     3,652,985|  3,683,484          +0.83%
EstimatedCycles       32,082,197| 32,341,908          +0.81%
I1MissRate                     0|          0         +58.65%
I1mr                       9,282|     14,812         +59.58%
ILmr                         202|        202          +0.00%
Ir                    21,447,643| 21,573,229          +0.59%
L1HitRate                     99|         99          -0.01%
L1hits                30,251,852| 30,436,273          +0.61%
LLHitRate                      1|          1          +0.35%
LLMissRate                     0|          0         +13.40%
LLdMissRate                    0|          0         +13.54%
LLhits                   278,555|    281,272          +0.98%
LLiMissRate                    0|          0          -0.58%
RamHitRate                     0|          0         +13.40%
RamHits                   12,502|     14,265         +14.10%
TotalRW               30,542,909| 30,731,810          +0.62%

update_executor_iai::update_group::update_executor with_setup_2:setup_update_executor(procedural-string-lights)
Instructions: 4,987,030 (master) → 4,994,379 (HEAD) : $$\color{red}+0.15\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          -3.90%
D1mr                      52,349|     49,996          -4.49%
D1mw                      12,037|     11,961          -0.63%
DLmr                           2|          4        +100.00%
DLmw                         487|        677         +39.01%
Dr                     1,259,506|  1,259,287          -0.02%
Dw                       848,008|    851,053          +0.36%
EstimatedCycles        7,385,202|  7,396,607          +0.15%
I1MissRate                     0|          0         +41.03%
I1mr                       3,126|      4,415         +41.23%
ILmr                         198|        199          +0.51%
Ir                     4,987,030|  4,994,379          +0.15%
L1HitRate                     99|         99          +0.02%
L1hits                 7,027,032|  7,038,347          +0.16%
LLHitRate                      1|          1          -2.14%
LLMissRate                     0|          0         +27.91%
LLdMissRate                    0|          0         +39.08%
LLhits                    66,825|     65,492          -1.99%
LLiMissRate                    0|          0          +0.36%
RamHitRate                     0|          0         +27.91%
RamHits                      687|        880         +28.09%
TotalRW                7,094,544|  7,104,719          +0.14%

update_executor_iai::update_group::update_executor with_setup_3:setup_update_executor(parametric-dunescape)
Instructions: 17,527,553 (master) → 17,674,958 (HEAD) : $$\color{red}+0.84\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          -1.00%
D1mr                     181,715|    181,891          +0.10%
D1mw                      44,571|     44,331          -0.54%
DLmr                         118|        131         +11.02%
DLmw                       5,209|      4,565         -12.36%
Dr                     4,420,071|  4,458,205          +0.86%
Dw                     3,007,280|  3,042,192          +1.16%
EstimatedCycles       26,055,872| 26,270,603          +0.82%
I1MissRate                     0|          0         +42.84%
I1mr                       7,661|     11,035         +44.04%
ILmr                         179|        178          -0.56%
Ir                    17,527,553| 17,674,958          +0.84%
L1HitRate                     99|         99          -0.00%
L1hits                24,720,957| 24,938,098          +0.88%
LLHitRate                      1|          1          +0.83%
LLMissRate                     0|          0         -12.25%
LLdMissRate                    0|          0         -12.70%
LLhits                   228,441|    232,383          +1.73%
LLiMissRate                    0|          0          -1.39%
RamHitRate                     0|          0         -12.25%
RamHits                    5,506|      4,874         -11.48%
TotalRW               24,954,904| 25,175,355          +0.88%

update_executor_iai::update_group::update_executor with_setup_4:setup_update_executor(red-dress)
Instructions: 49,274,420 (master) → 49,399,738 (HEAD) : $$\color{red}+0.25\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          +0.14%
D1mr                     544,702|    546,497          +0.33%
D1mw                     125,579|    127,064          +1.18%
DLmr                      19,433|     18,406          -5.28%
DLmw                      42,399|     37,771         -10.92%
Dr                    12,656,924| 12,692,728          +0.28%
Dw                     8,628,802|  8,667,608          +0.45%
EstimatedCycles       75,173,878| 75,255,568          +0.11%
I1MissRate                     0|          0         +55.99%
I1mr                      17,057|     26,675         +56.39%
ILmr                         314|        308          -1.91%
Ir                    49,274,420| 49,399,738          +0.25%
L1HitRate                     99|         99          -0.02%
L1hits                69,872,808| 70,059,838          +0.27%
LLHitRate                      1|          1          +2.68%
LLMissRate                     0|          0          -9.37%
LLdMissRate                    0|          0          -9.46%
LLhits                   625,192|    643,751          +2.97%
LLiMissRate                    0|          0          -2.16%
RamHitRate                     0|          0          -9.37%
RamHits                   62,146|     56,485          -9.11%
TotalRW               70,560,146| 70,760,074          +0.28%

update_executor_iai::update_group::update_executor with_setup_5:setup_update_executor(valley-of-spires)
Instructions: 32,561,293 (master) → 32,700,914 (HEAD) : $$\color{red}+0.43\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          +0.32%
D1mr                     356,567|    359,316          +0.77%
D1mw                      78,712|     78,674          -0.05%
DLmr                       5,131|      5,230          +1.93%
DLmw                      21,581|     22,249          +3.10%
Dr                     8,288,050|  8,307,373          +0.23%
Dw                     5,599,179|  5,622,009          +0.41%
EstimatedCycles       49,046,044| 49,292,704          +0.50%
I1MissRate                     0|          0         +63.16%
I1mr                      12,149|     19,907         +63.86%
ILmr                         215|        215          +0.00%
Ir                    32,561,293| 32,700,914          +0.43%
L1HitRate                     99|         99          -0.02%
L1hits                46,001,094| 46,172,399          +0.37%
LLHitRate                      1|          1          +1.91%
LLMissRate                     0|          0          +2.45%
LLdMissRate                    0|          0          +2.56%
LLhits                   420,501|    430,203          +2.31%
LLiMissRate                    0|          0          -0.43%
RamHitRate                     0|          0          +2.45%
RamHits                   26,927|     27,694          +2.85%
TotalRW               46,448,522| 46,630,296          +0.39%

🚀 Render: Cold Execution

run_once_iai::run_once_group::run_once with_setup_0:setup_run_once(isometric-fountain)
Instructions: 21,461,969 (master) → 22,255,669 (HEAD) : $$\color{red}+3.70\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          -2.80%
D1mr                     244,101|    251,567          +3.06%
D1mw                      53,435|     58,495          +9.47%
DLmr                       9,099|     10,220         +12.32%
DLmw                      16,993|     20,085         +18.20%
Dr                     5,449,105|  5,798,814          +6.42%
Dw                     3,629,136|  3,934,052          +8.40%
EstimatedCycles       33,161,086| 34,782,889          +4.89%
I1MissRate                     1|          1          -6.01%
I1mr                     124,238|    121,084          -2.54%
ILmr                       5,034|      5,354          +6.36%
Ir                    21,461,969| 22,255,669          +3.70%
L1HitRate                     99|         99          +0.03%
L1hits                30,118,436| 31,557,389          +4.78%
LLHitRate                      1|          1          -3.35%
LLMissRate                     0|          0          +9.38%
LLdMissRate                    0|          0          +8.33%
LLhits                   390,648|    395,487          +1.24%
LLiMissRate                    0|          0          +2.56%
RamHitRate                     0|          0          +9.38%
RamHits                   31,126|     35,659         +14.56%
TotalRW               30,540,210| 31,988,535          +4.74%

run_once_iai::run_once_group::run_once with_setup_1:setup_run_once(painted-dreams)
Instructions: 78,508,477 (master) → 79,563,133 (HEAD) : $$\color{red}+1.34\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          2          +0.39%
D1mr                     402,425|    415,609          +3.28%
D1mw                     192,533|    199,582          +3.66%
DLmr                       5,484|      6,088         +11.01%
DLmw                      55,204|     60,355          +9.33%
Dr                    18,602,136| 19,096,775          +2.66%
Dw                    12,319,269| 12,750,558          +3.50%
EstimatedCycles      114,571,328|116,792,088          +1.94%
I1MissRate                     0|          0          -4.56%
I1mr                     180,696|    174,772          -3.28%
ILmr                       7,273|      7,616          +4.72%
Ir                    78,508,477| 79,563,133          +1.34%
L1HitRate                     99|         99          -0.00%
L1hits               108,654,228|110,620,503          +1.81%
LLHitRate                      1|          1          -0.64%
LLMissRate                     0|          0          +7.04%
LLdMissRate                    0|          0          +6.30%
LLhits                   707,693|    715,904          +1.16%
LLiMissRate                    0|          0          +3.33%
RamHitRate                     0|          0          +7.04%
RamHits                   67,961|     74,059          +8.97%
TotalRW              109,429,882|111,410,466          +1.81%

run_once_iai::run_once_group::run_once with_setup_2:setup_run_once(procedural-string-lights)
Instructions: 9,739,090 (master) → 10,486,308 (HEAD) : $$\color{red}+7.67\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          2         +11.50%
D1mr                      42,210|     55,458         +31.39%
D1mw                      18,711|     22,161         +18.44%
DLmr                         297|        392         +31.99%
DLmw                       4,140|      4,965         +19.93%
Dr                     2,247,992|  2,547,697         +13.33%
Dw                     1,582,118|  1,828,799         +15.59%
EstimatedCycles       14,252,530| 15,643,714          +9.76%
I1MissRate                     0|          0         -10.43%
I1mr                      45,854|     44,221          -3.56%
ILmr                       4,104|      4,428          +7.89%
Ir                     9,739,090| 10,486,308          +7.67%
L1HitRate                     99|         99          -0.03%
L1hits                13,462,425| 14,740,964          +9.50%
LLHitRate                      1|          1          +4.14%
LLMissRate                     0|          0          +4.59%
LLdMissRate                    0|          0          +5.66%
LLhits                    98,234|    112,055         +14.07%
LLiMissRate                    0|          0          +0.21%
RamHitRate                     0|          0          +4.59%
RamHits                    8,541|      9,785         +14.57%
TotalRW               13,569,200| 14,862,804          +9.53%

run_once_iai::run_once_group::run_once with_setup_3:setup_run_once(parametric-dunescape)
Instructions: 22,269,460 (master) → 23,106,240 (HEAD) : $$\color{red}+3.76\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          2          -1.89%
D1mr                     118,663|    127,064          +7.08%
D1mw                      55,210|     60,566          +9.70%
DLmr                       1,529|      1,643          +7.46%
DLmw                      11,127|     14,282         +28.35%
Dr                     5,001,406|  5,430,797          +8.59%
Dw                     3,223,081|  3,615,517         +12.18%
EstimatedCycles       31,904,131| 33,728,912          +5.72%
I1MissRate                     0|          0          -2.14%
I1mr                      58,448|     59,347          +1.54%
ILmr                       3,374|      3,690          +9.37%
Ir                    22,269,460| 23,106,240          +3.76%
L1HitRate                     99|         99          -0.01%
L1hits                30,261,626| 31,905,577          +5.43%
LLHitRate                      1|          1          -0.30%
LLMissRate                     0|          0         +16.05%
LLdMissRate                    0|          0         +14.40%
LLhits                   216,291|    227,362          +5.12%
LLiMissRate                    0|          0          +5.41%
RamHitRate                     0|          0         +16.05%
RamHits                   16,030|     19,615         +22.36%
TotalRW               30,493,947| 32,152,554          +5.44%

run_once_iai::run_once_group::run_once with_setup_4:setup_run_once(red-dress)
Instructions: 1,798,921,886 (master) → 1,808,907,038 (HEAD) : $$\color{red}+0.56\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     0|          0          +8.63%
D1mr                   1,685,441|  1,801,517          +6.89%
D1mw                     768,598|    878,454         +14.29%
DLmr                     396,109|    435,507          +9.95%
DLmw                     504,845|    574,867         +13.87%
Dr                   425,289,397|427,266,770          +0.46%
Dw                   277,102,272|278,822,031          +0.62%
EstimatedCycles      2,543,294,993|2,560,679,101          +0.68%
I1MissRate                     0|          0         -10.37%
I1mr                   1,243,658|  1,120,897          -9.87%
ILmr                       5,401|      5,619          +4.04%
Ir                   1,798,921,886|1,808,907,038          +0.56%
L1HitRate                    100|        100          -0.00%
L1hits               2,497,615,858|2,511,194,971          +0.54%
LLHitRate                      0|          0          -0.77%
LLMissRate                     0|          0         +11.49%
LLdMissRate                    0|          0         +11.56%
LLhits                 2,791,342|  2,784,875          -0.23%
LLiMissRate                    0|          0          +3.46%
RamHitRate                     0|          0         +11.49%
RamHits                  906,355|  1,015,993         +12.10%
TotalRW              2,501,313,555|2,514,995,839          +0.55%

run_once_iai::run_once_group::run_once with_setup_5:setup_run_once(valley-of-spires)
Instructions: 19,703,874 (master) → 20,713,475 (HEAD) : $$\color{red}+5.12\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3          -2.24%
D1mr                     199,119|    209,808          +5.37%
D1mw                      46,262|     52,595         +13.69%
DLmr                       5,735|      5,911          +3.07%
DLmw                      13,841|     17,296         +24.96%
Dr                     4,792,102|  5,194,853          +8.40%
Dw                     3,159,531|  3,503,521         +10.89%
EstimatedCycles       29,729,419| 31,662,017          +6.50%
I1MissRate                     1|          0          -7.33%
I1mr                     101,872|     99,244          -2.58%
ILmr                       3,254|      3,579          +9.99%
Ir                    19,703,874| 20,713,475          +5.12%
L1HitRate                     99|         99          +0.03%
L1hits                27,308,254| 29,050,202          +6.38%
LLHitRate                      1|          1          -2.95%
LLMissRate                     0|          0         +10.32%
LLdMissRate                    0|          0          +8.37%
LLhits                   324,423|    334,861          +3.22%
LLiMissRate                    0|          0          +4.63%
RamHitRate                     0|          0         +10.32%
RamHits                   22,830|     26,786         +17.33%
TotalRW               27,655,507| 29,411,849          +6.35%

⚡ Render: Cached Execution

run_cached_iai::run_cached_group::run_cached with_setup_0:setup_run_cached(isometric-fountain)
Instructions: 16,120,025 (master) → 7,529,446 (HEAD) : $$\color{lime}-53.29\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          5         +56.07%
D1mr                     197,823|    176,841         -10.61%
D1mw                      16,858|      7,495         -55.54%
DLmr                       2,289|      2,826         +23.46%
DLmw                         517|        263         -49.13%
Dr                     4,081,927|  2,328,557         -42.95%
Dw                     2,650,621|  1,375,519         -48.11%
EstimatedCycles       23,949,863| 12,072,556         -49.59%
I1MissRate                     0|          0         -95.41%
I1mr                      37,329|        800         -97.86%
ILmr                         169|        194         +14.79%
Ir                    16,120,025|  7,529,446         -53.29%
L1HitRate                     99|         98          -0.55%
L1hits                22,600,563| 11,048,386         -51.11%
LLHitRate                      1|          2         +48.55%
LLMissRate                     0|          0        +124.49%
LLdMissRate                    0|          0        +100.09%
LLhits                   249,035|    181,853         -26.98%
LLiMissRate                    0|          0        +145.76%
RamHitRate                     0|          0        +124.49%
RamHits                    2,975|      3,283         +10.35%
TotalRW               22,852,573| 11,233,522         -50.84%

run_cached_iai::run_cached_group::run_cached with_setup_1:setup_run_cached(painted-dreams)
Instructions: 21,880,328 (master) → 5,831,445 (HEAD) : $$\color{lime}-73.35\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          4         +98.51%
D1mr                     164,697|    124,959         -24.13%
D1mw                      28,996|      8,932         -69.20%
DLmr                       2,153|      2,376         +10.36%
DLmw                         225|         37         -83.56%
Dr                     5,297,614|  1,911,902         -63.91%
Dw                     3,603,735|  1,187,726         -67.04%
EstimatedCycles       31,878,411|  9,548,277         -70.05%
I1MissRate                     0|          0         -94.98%
I1mr                      61,343|        820         -98.66%
ILmr                         175|        199         +13.71%
Ir                    21,880,328|  5,831,445         -73.35%
L1HitRate                     99|         98          -0.69%
L1hits                30,526,641|  8,796,362         -71.18%
LLHitRate                      1|          1         +80.33%
LLMissRate                     0|          0        +252.62%
LLdMissRate                    0|          0        +191.40%
LLhits                   252,483|    132,099         -47.68%
LLiMissRate                    0|          0        +326.67%
RamHitRate                     0|          0        +252.62%
RamHits                    2,553|      2,612          +2.31%
TotalRW               30,781,677|  8,931,073         -70.99%

run_cached_iai::run_cached_group::run_cached with_setup_2:setup_run_cached(procedural-string-lights)
Instructions: 7,849,229 (master) → 1,441,315 (HEAD) : $$\color{lime}-81.64\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     1|          3        +157.23%
D1mr                      33,015|     25,481         -22.82%
D1mw                       8,995|      3,592         -60.07%
DLmr                           7|          6         -14.29%
DLmw                         204|         15         -92.65%
Dr                     1,832,140|    509,276         -72.20%
Dw                     1,301,193|    333,697         -74.35%
EstimatedCycles       11,296,368|  2,409,774         -78.67%
I1MissRate                     0|          0         -86.97%
I1mr                      33,674|        806         -97.61%
ILmr                         158|        178         +12.66%
Ir                     7,849,229|  1,441,315         -81.64%
L1HitRate                     99|         99          -0.62%
L1hits                10,906,878|  2,254,409         -79.33%
LLHitRate                      1|          1         +89.47%
LLMissRate                     0|          0        +159.29%
LLdMissRate                    0|          0         -63.01%
LLhits                    75,315|     29,680         -60.59%
LLiMissRate                    0|          0        +513.52%
RamHitRate                     0|          0        +159.29%
RamHits                      369|        199         -46.07%
TotalRW               10,982,562|  2,284,288         -79.20%

run_cached_iai::run_cached_group::run_cached with_setup_3:setup_run_cached(parametric-dunescape)
Instructions: 13,682,154 (master) → 3,083,589 (HEAD) : $$\color{lime}-77.46\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          4        +100.06%
D1mr                      83,630|     68,420         -18.19%
D1mw                      22,226|      7,633         -65.66%
DLmr                          30|         30          +0.00%
DLmw                         329|        129         -60.79%
Dr                     3,044,176|  1,099,760         -63.87%
Dw                     2,071,098|    737,285         -64.40%
EstimatedCycles       19,270,394|  5,237,180         -72.82%
I1MissRate                     0|          0         -60.25%
I1mr                       8,718|        781         -91.04%
ILmr                         130|        148         +13.85%
Ir                    13,682,154|  3,083,589         -77.46%
L1HitRate                     99|         98          -0.96%
L1hits                18,682,854|  4,843,800         -74.07%
LLHitRate                      1|          2        +156.25%
LLMissRate                     0|          0        +139.83%
LLdMissRate                    0|          0         +23.33%
LLhits                   114,085|     76,527         -32.92%
LLiMissRate                    0|          0        +405.15%
RamHitRate                     0|          0        +139.83%
RamHits                      489|        307         -37.22%
TotalRW               18,797,428|  4,920,634         -73.82%

run_cached_iai::run_cached_group::run_cached with_setup_4:setup_run_cached(red-dress)
Instructions: 246,439,245 (master) → 34,072,341 (HEAD) : $$\color{lime}-86.17\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     1|          5        +282.75%
D1mr                   1,041,582|    634,083         -39.12%
D1mw                     214,644|     99,070         -53.84%
DLmr                     377,718|    292,485         -22.57%
DLmw                     146,493|     56,525         -61.41%
Dr                    57,193,744|  9,719,847         -83.01%
Dw                    40,802,841|  5,222,621         -87.20%
EstimatedCycles      369,439,174| 62,446,063         -83.10%
I1MissRate                     0|          0         -99.39%
I1mr                   1,048,845|        883         -99.92%
ILmr                       1,891|        827         -56.27%
Ir                   246,439,245| 34,072,341         -86.17%
L1HitRate                     99|         99          -0.83%
L1hits               342,130,759| 48,280,773         -85.89%
LLHitRate                      1|          1         +51.76%
LLMissRate                     0|          1        +367.28%
LLdMissRate                    1|          2        +336.64%
LLhits                 1,778,969|    384,199         -78.40%
LLiMissRate                    0|          0        +216.32%
RamHitRate                     0|          1        +367.28%
RamHits                  526,102|    349,837         -33.50%
TotalRW              344,435,830| 49,014,809         -85.77%

run_cached_iai::run_cached_group::run_cached with_setup_5:setup_run_cached(valley-of-spires)
Instructions: 15,348,870 (master) → 6,073,606 (HEAD) : $$\color{lime}-60.43\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          5         +68.43%
D1mr                     164,389|    143,772         -12.54%
D1mw                      16,858|      7,536         -55.30%
DLmr                         382|        448         +17.28%
DLmw                         858|        404         -52.91%
Dr                     3,709,620|  1,895,027         -48.92%
Dw                     2,398,138|  1,132,264         -52.79%
EstimatedCycles       22,351,574|  9,740,465         -56.42%
I1MissRate                     0|          0         -93.68%
I1mr                      31,952|        799         -97.50%
ILmr                         165|        186         +12.73%
Ir                    15,348,870|  6,073,606         -60.43%
L1HitRate                     99|         98          -0.68%
L1hits                21,243,429|  8,948,790         -57.88%
LLHitRate                      1|          2         +68.17%
LLMissRate                     0|          0         +74.18%
LLdMissRate                    0|          0         +38.63%
LLhits                   211,794|    151,069         -28.67%
LLiMissRate                    0|          0        +184.88%
RamHitRate                     0|          0         +74.18%
RamHits                    1,405|      1,038         -26.12%
TotalRW               21,456,628|  9,100,897         -57.58%

@TrueDoctor TrueDoctor force-pushed the cache-intermediate-render-results branch from e166281 to 69deeea Compare September 11, 2025 07:48
Base automatically changed from cache-intermediate-render-results to master September 11, 2025 08:57
@Keavon Keavon changed the title Perf improvements Optimize editor performance for node selection, click target bounds, and batched messages Sep 11, 2025
@TrueDoctor TrueDoctor enabled auto-merge (squash) September 11, 2025 09:42
@TrueDoctor TrueDoctor removed the Performance Speed and efficiency improvements label Sep 11, 2025
@TrueDoctor TrueDoctor merged commit 5836416 into master Sep 11, 2025
4 checks passed
@TrueDoctor TrueDoctor deleted the perf-improvements branch September 11, 2025 10:08
@0HyperCube
Copy link
Contributor

0HyperCube commented Sep 16, 2025

Note that this makes the bounding boxes in the select tool very inaccurate. #3181

@Keavon
Copy link
Member

Keavon commented Sep 16, 2025

Partly reverted in #3184 to fix that regression.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants