Skip to content

[Doc] Huge doc refactoring #3231

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 7 commits into from
Nov 6, 2025
Merged

[Doc] Huge doc refactoring #3231

merged 7 commits into from
Nov 6, 2025
+3,220 −5,264

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Nov 6, 2025 •
edited
Loading

@vmoens
Update
8889aaf 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
78b9313 
ghstack-source-id: 4c64a65
Pull-Request: #3231
@vmoens vmoens mentioned this pull request Nov 6, 2025
Merged
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 6, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3231

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Nov 5, 2025
Merged
Merged
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2025
@github-actions
Copy link

github-actions bot commented Nov 6, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}28$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 81.6430μs 81.0355μs 12.3403 KOps/s 12.3852 KOps/s $\color{#d91a1a}-0.36\%$
test_tensor_to_bytestream_speed[torch.save] 0.1386ms 0.1380ms 7.2487 KOps/s 7.1869 KOps/s $\color{#35bf28}+0.86\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1146s 0.1142s 8.7588 Ops/s 8.4945 Ops/s $\color{#35bf28}+3.11\%$
test_tensor_to_bytestream_speed[numpy] 2.8249μs 2.8121μs 355.6080 KOps/s 357.6451 KOps/s $\color{#d91a1a}-0.57\%$
test_tensor_to_bytestream_speed[safetensors] 41.2708μs 40.6327μs 24.6107 KOps/s 24.3635 KOps/s $\color{#35bf28}+1.01\%$
test_simple 0.6492s 0.5602s 1.7850 Ops/s 1.7458 Ops/s $\color{#35bf28}+2.25\%$
test_transformed 1.2078s 1.1127s 0.8987 Ops/s 0.8961 Ops/s $\color{#35bf28}+0.29\%$
test_serial 1.6380s 1.6280s 0.6143 Ops/s 0.6095 Ops/s $\color{#35bf28}+0.77\%$
test_parallel 1.1717s 1.1163s 0.8958 Ops/s 0.9330 Ops/s $\color{#d91a1a}-3.99\%$
test_step_mdp_speed[True-True-True-True-True] 0.2702ms 43.5320μs 22.9716 KOps/s 23.1627 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-True-True-True-False] 58.1110μs 24.2524μs 41.2330 KOps/s 40.4413 KOps/s $\color{#35bf28}+1.96\%$
test_step_mdp_speed[True-True-True-False-True] 55.1610μs 24.4981μs 40.8195 KOps/s 40.3207 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[True-True-True-False-False] 43.4510μs 13.3633μs 74.8320 KOps/s 73.9369 KOps/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[True-True-False-True-True] 86.5920μs 46.7276μs 21.4006 KOps/s 21.6780 KOps/s $\color{#d91a1a}-1.28\%$
test_step_mdp_speed[True-True-False-True-False] 61.7720μs 26.8662μs 37.2215 KOps/s 37.0190 KOps/s $\color{#35bf28}+0.55\%$
test_step_mdp_speed[True-True-False-False-True] 71.5420μs 26.8119μs 37.2969 KOps/s 36.0779 KOps/s $\color{#35bf28}+3.38\%$
test_step_mdp_speed[True-True-False-False-False] 48.9310μs 16.1130μs 62.0617 KOps/s 60.3675 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[True-False-True-True-True] 85.2420μs 48.6330μs 20.5622 KOps/s 19.8342 KOps/s $\color{#35bf28}+3.67\%$
test_step_mdp_speed[True-False-True-True-False] 59.5510μs 29.0230μs 34.4554 KOps/s 32.8110 KOps/s $\textbf{\color{#35bf28}+5.01\%}$
test_step_mdp_speed[True-False-True-False-True] 64.1110μs 26.8980μs 37.1775 KOps/s 36.9027 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[True-False-True-False-False] 42.4310μs 15.9740μs 62.6018 KOps/s 60.7442 KOps/s $\color{#35bf28}+3.06\%$
test_step_mdp_speed[True-False-False-True-True] 89.7820μs 51.6247μs 19.3706 KOps/s 19.1211 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[True-False-False-True-False] 70.4510μs 32.0778μs 31.1742 KOps/s 30.3210 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[True-False-False-False-True] 61.1020μs 30.1425μs 33.1757 KOps/s 33.5200 KOps/s $\color{#d91a1a}-1.03\%$
test_step_mdp_speed[True-False-False-False-False] 44.5710μs 18.6468μs 53.6284 KOps/s 52.4903 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-True-True-True-True] 78.7610μs 48.4375μs 20.6452 KOps/s 19.9625 KOps/s $\color{#35bf28}+3.42\%$
test_step_mdp_speed[False-True-True-True-False] 64.5410μs 29.4140μs 33.9974 KOps/s 32.7775 KOps/s $\color{#35bf28}+3.72\%$
test_step_mdp_speed[False-True-True-False-True] 2.5196ms 30.8628μs 32.4015 KOps/s 31.7422 KOps/s $\color{#35bf28}+2.08\%$
test_step_mdp_speed[False-True-True-False-False] 66.6010μs 17.4473μs 57.3153 KOps/s 55.2550 KOps/s $\color{#35bf28}+3.73\%$
test_step_mdp_speed[False-True-False-True-True] 87.6010μs 51.3678μs 19.4675 KOps/s 18.9879 KOps/s $\color{#35bf28}+2.53\%$
test_step_mdp_speed[False-True-False-True-False] 59.6720μs 32.7154μs 30.5667 KOps/s 30.2404 KOps/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[False-True-False-False-True] 68.7220μs 33.9330μs 29.4699 KOps/s 29.6860 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[False-True-False-False-False] 78.5320μs 20.4720μs 48.8473 KOps/s 49.2597 KOps/s $\color{#d91a1a}-0.84\%$
test_step_mdp_speed[False-False-True-True-True] 0.1005ms 54.2663μs 18.4277 KOps/s 18.4123 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-False-True-True-False] 61.9620μs 35.3648μs 28.2767 KOps/s 27.7950 KOps/s $\color{#35bf28}+1.73\%$
test_step_mdp_speed[False-False-True-False-True] 80.9720μs 33.5027μs 29.8483 KOps/s 29.9438 KOps/s $\color{#d91a1a}-0.32\%$
test_step_mdp_speed[False-False-True-False-False] 78.4820μs 20.2608μs 49.3565 KOps/s 48.6871 KOps/s $\color{#35bf28}+1.37\%$
test_step_mdp_speed[False-False-False-True-True] 86.4720μs 55.2551μs 18.0979 KOps/s 17.4782 KOps/s $\color{#35bf28}+3.55\%$
test_step_mdp_speed[False-False-False-True-False] 63.3510μs 37.3612μs 26.7657 KOps/s 26.0950 KOps/s $\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-False-False-True] 86.5220μs 35.6853μs 28.0227 KOps/s 27.9188 KOps/s $\color{#35bf28}+0.37\%$
test_step_mdp_speed[False-False-False-False-False] 64.8410μs 22.7625μs 43.9319 KOps/s 43.3896 KOps/s $\color{#35bf28}+1.25\%$
test_values[generalized_advantage_estimate-True-True] 9.7756ms 9.5763ms 104.4242 Ops/s 102.0648 Ops/s $\color{#35bf28}+2.31\%$
test_values[vec_generalized_advantage_estimate-True-True] 15.2014ms 11.3028ms 88.4738 Ops/s 55.5389 Ops/s $\textbf{\color{#35bf28}+59.30\%}$
test_values[td0_return_estimate-False-False] 0.2381ms 0.1289ms 7.7550 KOps/s 7.8390 KOps/s $\color{#d91a1a}-1.07\%$
test_values[td1_return_estimate-False-False] 27.6983ms 26.7484ms 37.3854 Ops/s 37.3922 Ops/s $\color{#d91a1a}-0.02\%$
test_values[vec_td1_return_estimate-False-False] 11.6424ms 11.4352ms 87.4491 Ops/s 56.2064 Ops/s $\textbf{\color{#35bf28}+55.59\%}$
test_values[td_lambda_return_estimate-True-False] 41.5296ms 39.6358ms 25.2297 Ops/s 25.1151 Ops/s $\color{#35bf28}+0.46\%$
test_values[vec_td_lambda_return_estimate-True-False] 12.2288ms 11.3728ms 87.9289 Ops/s 56.5776 Ops/s $\textbf{\color{#35bf28}+55.41\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.4760ms 8.3084ms 120.3607 Ops/s 119.1182 Ops/s $\color{#35bf28}+1.04\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7609ms 1.4957ms 668.5644 Ops/s 677.2706 Ops/s $\color{#d91a1a}-1.29\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4751ms 0.4062ms 2.4618 KOps/s 2.4563 KOps/s $\color{#35bf28}+0.23\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 24.0946ms 23.4834ms 42.5833 Ops/s 29.1754 Ops/s $\textbf{\color{#35bf28}+45.96\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1295ms 1.7370ms 575.7166 Ops/s 582.5666 Ops/s $\color{#d91a1a}-1.18\%$
test_dqn_speed[False-None] 6.5096ms 1.3978ms 715.4281 Ops/s 715.8639 Ops/s $\color{#d91a1a}-0.06\%$
test_dqn_speed[False-backward] 1.9564ms 1.9007ms 526.1306 Ops/s 528.2198 Ops/s $\color{#d91a1a}-0.40\%$
test_dqn_speed[True-None] 0.8991ms 0.5286ms 1.8917 KOps/s 1.8548 KOps/s $\color{#35bf28}+1.99\%$
test_dqn_speed[True-backward] 0.9976ms 0.9468ms 1.0562 KOps/s 882.0225 Ops/s $\textbf{\color{#35bf28}+19.74\%}$
test_dqn_speed[reduce-overhead-None] 0.8676ms 0.5089ms 1.9650 KOps/s 1.9777 KOps/s $\color{#d91a1a}-0.64\%$
test_dqn_speed[reduce-overhead-backward] 0.9731ms 0.9350ms 1.0695 KOps/s 1.0512 KOps/s $\color{#35bf28}+1.74\%$
test_ddpg_speed[False-None] 3.1523ms 2.8195ms 354.6738 Ops/s 356.1915 Ops/s $\color{#d91a1a}-0.43\%$
test_ddpg_speed[False-backward] 4.1049ms 3.9830ms 251.0665 Ops/s 248.9250 Ops/s $\color{#35bf28}+0.86\%$
test_ddpg_speed[True-None] 1.5149ms 1.3658ms 732.1881 Ops/s 738.3327 Ops/s $\color{#d91a1a}-0.83\%$
test_ddpg_speed[True-backward] 2.3266ms 2.2811ms 438.3861 Ops/s 425.1941 Ops/s $\color{#35bf28}+3.10\%$
test_ddpg_speed[reduce-overhead-None] 1.5737ms 1.3658ms 732.1628 Ops/s 714.7135 Ops/s $\color{#35bf28}+2.44\%$
test_ddpg_speed[reduce-overhead-backward] 2.3288ms 2.2786ms 438.8620 Ops/s 431.2201 Ops/s $\color{#35bf28}+1.77\%$
test_sac_speed[False-None] 8.1387ms 7.7181ms 129.5663 Ops/s 129.1314 Ops/s $\color{#35bf28}+0.34\%$
test_sac_speed[False-backward] 11.3272ms 10.9608ms 91.2340 Ops/s 90.9977 Ops/s $\color{#35bf28}+0.26\%$
test_sac_speed[True-None] 2.4012ms 2.0275ms 493.2253 Ops/s 480.3638 Ops/s $\color{#35bf28}+2.68\%$
test_sac_speed[True-backward] 4.0397ms 3.8776ms 257.8887 Ops/s 247.2983 Ops/s $\color{#35bf28}+4.28\%$
test_sac_speed[reduce-overhead-None] 2.3108ms 2.0200ms 495.0592 Ops/s 465.9565 Ops/s $\textbf{\color{#35bf28}+6.25\%}$
test_sac_speed[reduce-overhead-backward] 3.9947ms 3.8811ms 257.6579 Ops/s 233.9951 Ops/s $\textbf{\color{#35bf28}+10.11\%}$
test_redq_speed[False-None] 10.6463ms 10.0468ms 99.5338 Ops/s 98.7034 Ops/s $\color{#35bf28}+0.84\%$
test_redq_speed[False-backward] 18.2859ms 17.3298ms 57.7040 Ops/s 56.7664 Ops/s $\color{#35bf28}+1.65\%$
test_redq_speed[True-None] 4.7019ms 4.1331ms 241.9485 Ops/s 226.7144 Ops/s $\textbf{\color{#35bf28}+6.72\%}$
test_redq_speed[True-backward] 9.6256ms 9.3630ms 106.8029 Ops/s 103.9276 Ops/s $\color{#35bf28}+2.77\%$
test_redq_speed[reduce-overhead-None] 4.4606ms 4.1371ms 241.7143 Ops/s 219.2369 Ops/s $\textbf{\color{#35bf28}+10.25\%}$
test_redq_speed[reduce-overhead-backward] 9.8366ms 9.5355ms 104.8714 Ops/s 105.8943 Ops/s $\color{#d91a1a}-0.97\%$
test_redq_deprec_speed[False-None] 11.3595ms 10.8119ms 92.4909 Ops/s 90.6970 Ops/s $\color{#35bf28}+1.98\%$
test_redq_deprec_speed[False-backward] 16.3575ms 15.7303ms 63.5717 Ops/s 62.1360 Ops/s $\color{#35bf28}+2.31\%$
test_redq_deprec_speed[True-None] 3.9466ms 3.5343ms 282.9438 Ops/s 282.3845 Ops/s $\color{#35bf28}+0.20\%$
test_redq_deprec_speed[True-backward] 7.8753ms 7.4935ms 133.4497 Ops/s 132.2613 Ops/s $\color{#35bf28}+0.90\%$
test_redq_deprec_speed[reduce-overhead-None] 3.8538ms 3.5091ms 284.9770 Ops/s 263.9229 Ops/s $\textbf{\color{#35bf28}+7.98\%}$
test_redq_deprec_speed[reduce-overhead-backward] 7.6624ms 7.4401ms 134.4074 Ops/s 126.8669 Ops/s $\textbf{\color{#35bf28}+5.94\%}$
test_td3_speed[False-None] 7.8443ms 7.7639ms 128.8020 Ops/s 128.2176 Ops/s $\color{#35bf28}+0.46\%$
test_td3_speed[False-backward] 10.9853ms 10.5636ms 94.6645 Ops/s 93.7642 Ops/s $\color{#35bf28}+0.96\%$
test_td3_speed[True-None] 1.8619ms 1.7337ms 576.7844 Ops/s 558.3217 Ops/s $\color{#35bf28}+3.31\%$
test_td3_speed[True-backward] 3.5976ms 3.4561ms 289.3448 Ops/s 281.7034 Ops/s $\color{#35bf28}+2.71\%$
test_td3_speed[reduce-overhead-None] 1.7276ms 1.6904ms 591.5605 Ops/s 574.9445 Ops/s $\color{#35bf28}+2.89\%$
test_td3_speed[reduce-overhead-backward] 3.5439ms 3.4448ms 290.2920 Ops/s 282.7556 Ops/s $\color{#35bf28}+2.67\%$
test_cql_speed[False-None] 27.7539ms 25.2476ms 39.6077 Ops/s 39.5399 Ops/s $\color{#35bf28}+0.17\%$
test_cql_speed[False-backward] 34.8808ms 34.2409ms 29.2049 Ops/s 28.6027 Ops/s $\color{#35bf28}+2.11\%$
test_cql_speed[True-None] 12.2027ms 11.8558ms 84.3471 Ops/s 80.9646 Ops/s $\color{#35bf28}+4.18\%$
test_cql_speed[True-backward] 18.0537ms 17.5673ms 56.9241 Ops/s 57.2172 Ops/s $\color{#d91a1a}-0.51\%$
test_cql_speed[reduce-overhead-None] 12.3765ms 11.9949ms 83.3691 Ops/s 82.3310 Ops/s $\color{#35bf28}+1.26\%$
test_cql_speed[reduce-overhead-backward] 18.0584ms 17.6064ms 56.7975 Ops/s 56.7387 Ops/s $\color{#35bf28}+0.10\%$
test_a2c_speed[False-None] 5.8609ms 5.2806ms 189.3719 Ops/s 183.4738 Ops/s $\color{#35bf28}+3.21\%$
test_a2c_speed[False-backward] 12.3302ms 11.5414ms 86.6444 Ops/s 85.4823 Ops/s $\color{#35bf28}+1.36\%$
test_a2c_speed[True-None] 3.8806ms 3.6250ms 275.8598 Ops/s 272.8597 Ops/s $\color{#35bf28}+1.10\%$
test_a2c_speed[True-backward] 8.6404ms 8.4618ms 118.1775 Ops/s 109.6967 Ops/s $\textbf{\color{#35bf28}+7.73\%}$
test_a2c_speed[reduce-overhead-None] 3.9607ms 3.5891ms 278.6191 Ops/s 273.1247 Ops/s $\color{#35bf28}+2.01\%$
test_a2c_speed[reduce-overhead-backward] 9.0592ms 8.6102ms 116.1414 Ops/s 111.0921 Ops/s $\color{#35bf28}+4.55\%$
test_ppo_speed[False-None] 6.1906ms 5.7936ms 172.6053 Ops/s 167.6709 Ops/s $\color{#35bf28}+2.94\%$
test_ppo_speed[False-backward] 12.8515ms 12.2849ms 81.4009 Ops/s 79.5172 Ops/s $\color{#35bf28}+2.37\%$
test_ppo_speed[True-None] 3.8179ms 3.5184ms 284.2238 Ops/s 272.9522 Ops/s $\color{#35bf28}+4.13\%$
test_ppo_speed[True-backward] 8.4788ms 8.2147ms 121.7327 Ops/s 108.1642 Ops/s $\textbf{\color{#35bf28}+12.54\%}$
test_ppo_speed[reduce-overhead-None] 3.7020ms 3.5182ms 284.2379 Ops/s 276.0955 Ops/s $\color{#35bf28}+2.95\%$
test_ppo_speed[reduce-overhead-backward] 8.7864ms 8.5120ms 117.4809 Ops/s 113.5423 Ops/s $\color{#35bf28}+3.47\%$
test_reinforce_speed[False-None] 4.8026ms 4.4574ms 224.3441 Ops/s 217.4482 Ops/s $\color{#35bf28}+3.17\%$
test_reinforce_speed[False-backward] 7.6773ms 7.3125ms 136.7518 Ops/s 134.5647 Ops/s $\color{#35bf28}+1.63\%$
test_reinforce_speed[True-None] 3.1282ms 2.7613ms 362.1490 Ops/s 355.0162 Ops/s $\color{#35bf28}+2.01\%$
test_reinforce_speed[True-backward] 8.0271ms 7.5738ms 132.0342 Ops/s 132.5970 Ops/s $\color{#d91a1a}-0.42\%$
test_reinforce_speed[reduce-overhead-None] 3.1162ms 2.7501ms 363.6261 Ops/s 347.4923 Ops/s $\color{#35bf28}+4.64\%$
test_reinforce_speed[reduce-overhead-backward] 8.0275ms 7.8257ms 127.7837 Ops/s 123.5363 Ops/s $\color{#35bf28}+3.44\%$
test_iql_speed[False-None] 20.1406ms 19.5473ms 51.1579 Ops/s 49.5210 Ops/s $\color{#35bf28}+3.31\%$
test_iql_speed[False-backward] 30.5958ms 29.9909ms 33.3434 Ops/s 32.6590 Ops/s $\color{#35bf28}+2.10\%$
test_iql_speed[True-None] 8.6886ms 8.2804ms 120.7674 Ops/s 118.7594 Ops/s $\color{#35bf28}+1.69\%$
test_iql_speed[True-backward] 16.7955ms 16.1112ms 62.0686 Ops/s 60.6447 Ops/s $\color{#35bf28}+2.35\%$
test_iql_speed[reduce-overhead-None] 8.7569ms 8.3023ms 120.4489 Ops/s 119.1706 Ops/s $\color{#35bf28}+1.07\%$
test_iql_speed[reduce-overhead-backward] 16.9784ms 16.5100ms 60.5695 Ops/s 58.2384 Ops/s $\color{#35bf28}+4.00\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.3603ms 5.8811ms 170.0351 Ops/s 170.7472 Ops/s $\color{#d91a1a}-0.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5521ms 0.3346ms 2.9887 KOps/s 2.8004 KOps/s $\textbf{\color{#35bf28}+6.72\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7218ms 0.3452ms 2.8972 KOps/s 2.8859 KOps/s $\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8375ms 5.6112ms 178.2143 Ops/s 178.0907 Ops/s $\color{#35bf28}+0.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.7005ms 0.3389ms 2.9506 KOps/s 3.1314 KOps/s $\textbf{\color{#d91a1a}-5.77\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5866ms 0.2829ms 3.5344 KOps/s 2.8508 KOps/s $\textbf{\color{#35bf28}+23.98\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6156ms 1.2860ms 777.5815 Ops/s 765.2328 Ops/s $\color{#35bf28}+1.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5580ms 1.2081ms 827.7372 Ops/s 810.8156 Ops/s $\color{#35bf28}+2.09\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.8002ms 5.7243ms 174.6924 Ops/s 170.0735 Ops/s $\color{#35bf28}+2.72\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0860ms 0.4411ms 2.2669 KOps/s 2.1230 KOps/s $\textbf{\color{#35bf28}+6.78\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6898ms 0.4094ms 2.4424 KOps/s 2.0800 KOps/s $\textbf{\color{#35bf28}+17.42\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.6659ms 5.5775ms 179.2923 Ops/s 176.7604 Ops/s $\color{#35bf28}+1.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0781ms 0.3534ms 2.8294 KOps/s 3.5162 KOps/s $\textbf{\color{#d91a1a}-19.53\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4235ms 0.2546ms 3.9279 KOps/s 3.7771 KOps/s $\color{#35bf28}+3.99\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.7952ms 5.5363ms 180.6275 Ops/s 178.5154 Ops/s $\color{#35bf28}+1.18\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.8280ms 0.3677ms 2.7194 KOps/s 3.1337 KOps/s $\textbf{\color{#d91a1a}-13.22\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4622ms 0.2509ms 3.9854 KOps/s 3.3103 KOps/s $\textbf{\color{#35bf28}+20.40\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.8051ms 5.6992ms 175.4638 Ops/s 172.8489 Ops/s $\color{#35bf28}+1.51\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7775ms 0.4222ms 2.3686 KOps/s 2.2119 KOps/s $\textbf{\color{#35bf28}+7.09\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6096ms 0.4023ms 2.4860 KOps/s 2.2049 KOps/s $\textbf{\color{#35bf28}+12.74\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.4385s 13.6300ms 73.3676 Ops/s 196.1445 Ops/s $\textbf{\color{#d91a1a}-62.60\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.4998ms 2.0362ms 491.1039 Ops/s 484.5061 Ops/s $\color{#35bf28}+1.36\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.1907ms 1.1327ms 882.8740 Ops/s 946.7780 Ops/s $\textbf{\color{#d91a1a}-6.75\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.3749ms 4.9203ms 203.2402 Ops/s 193.2971 Ops/s $\textbf{\color{#35bf28}+5.14\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 9.8126ms 2.0289ms 492.8773 Ops/s 499.8654 Ops/s $\color{#d91a1a}-1.40\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.8137ms 1.1345ms 881.4818 Ops/s 845.5565 Ops/s $\color{#35bf28}+4.25\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.4250s 13.5517ms 73.7913 Ops/s 58.3288 Ops/s $\textbf{\color{#35bf28}+26.51\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 3.9660ms 1.8968ms 527.2018 Ops/s 463.6745 Ops/s $\textbf{\color{#35bf28}+13.70\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.2994ms 0.9749ms 1.0257 KOps/s 755.5272 Ops/s $\textbf{\color{#35bf28}+35.76\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 35.0842ms 32.7600ms 30.5250 Ops/s 28.1993 Ops/s $\textbf{\color{#35bf28}+8.25\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.8991ms 17.1622ms 58.2674 Ops/s 54.3521 Ops/s $\textbf{\color{#35bf28}+7.20\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 35.0666ms 33.1116ms 30.2009 Ops/s 28.8720 Ops/s $\color{#35bf28}+4.60\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 18.9733ms 17.1847ms 58.1914 Ops/s 55.2668 Ops/s $\textbf{\color{#35bf28}+5.29\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 39.5854ms 34.5789ms 28.9194 Ops/s 27.6723 Ops/s $\color{#35bf28}+4.51\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 19.6117ms 18.2775ms 54.7122 Ops/s 52.7541 Ops/s $\color{#35bf28}+3.71\%$

@vmoens
Update
95a8461 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
571142f 
ghstack-source-id: bdeddbc
Pull-Request: #3231
@vmoens
Update
e9d8d3b 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
928035c 
ghstack-source-id: fe5682e
Pull-Request: #3231
@vmoens
Update
54917c1 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
43bafa3 
ghstack-source-id: 5925d2b
Pull-Request: #3231
@vmoens
Update
518898f 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
2c6e7df 
ghstack-source-id: 5747424
Pull-Request: #3231
@vmoens vmoens mentioned this pull request Nov 6, 2025
Merged
@vmoens
Update
28076ff 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
66c6777 
ghstack-source-id: 5eb6796
Pull-Request: #3231
@vmoens
Update
11a1012 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
a6e2ccd 
ghstack-source-id: 117aa76
Pull-Request: #3231
@vmoens vmoens added documentation Improvements or additions to documentation major major refactoring in the code base labels Nov 6, 2025
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
3d5dd1a 
ghstack-source-id: 117aa76
Pull-Request: #3231
@vmoens vmoens merged commit 11a1012 into gh/vmoens/173/base Nov 6, 2025
39 of 61 checks passed
@vmoens vmoens deleted the gh/vmoens/173/head branch November 6, 2025 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation major major refactoring in the code base

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens