Skip to content

[Feature] Tool services #3220

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 6 commits into
base: gh/vmoens/169/base
Choose a base branch
from
Open

[Feature] Tool services #3220

wants to merge 6 commits into from
+4,528 −260

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Oct 23, 2025 •
edited
Loading

@vmoens
Update
7f168a7 
[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Oct 23, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3220

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 5 Unrelated Failures

As of commit d747f8e with merge base 13434eb (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 23, 2025
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Tool services
33a1141 
ghstack-source-id: acf8de0
Pull-Request: #3220
This was referenced Oct 23, 2025
Merged
Open
Open
Open
@github-actions
Copy link

github-actions bot commented Oct 23, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}22$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 80.8296μs 79.2413μs 12.6197 KOps/s 12.4965 KOps/s $\color{#35bf28}+0.99\%$
test_tensor_to_bytestream_speed[torch.save] 0.1378ms 0.1370ms 7.2999 KOps/s 7.2308 KOps/s $\color{#35bf28}+0.96\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1229s 0.1222s 8.1829 Ops/s 8.2991 Ops/s $\color{#d91a1a}-1.40\%$
test_tensor_to_bytestream_speed[numpy] 2.8683μs 2.8584μs 349.8446 KOps/s 358.6061 KOps/s $\color{#d91a1a}-2.44\%$
test_tensor_to_bytestream_speed[safetensors] 43.7877μs 42.7440μs 23.3951 KOps/s 24.2952 KOps/s $\color{#d91a1a}-3.70\%$
test_simple 0.5430s 0.5421s 1.8446 Ops/s 1.7715 Ops/s $\color{#35bf28}+4.13\%$
test_transformed 1.0957s 1.0927s 0.9152 Ops/s 0.8964 Ops/s $\color{#35bf28}+2.09\%$
test_serial 1.6726s 1.6450s 0.6079 Ops/s 0.6012 Ops/s $\color{#35bf28}+1.12\%$
test_parallel 1.0953s 1.0588s 0.9445 Ops/s 0.9222 Ops/s $\color{#35bf28}+2.41\%$
test_step_mdp_speed[True-True-True-True-True] 0.2576ms 44.4916μs 22.4761 KOps/s 23.3410 KOps/s $\color{#d91a1a}-3.71\%$
test_step_mdp_speed[True-True-True-True-False] 54.2710μs 24.9710μs 40.0465 KOps/s 40.3573 KOps/s $\color{#d91a1a}-0.77\%$
test_step_mdp_speed[True-True-True-False-True] 54.1210μs 24.6895μs 40.5030 KOps/s 40.9672 KOps/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-True-True-False-False] 49.7410μs 13.4703μs 74.2375 KOps/s 73.7135 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-True-False-True-True] 0.1112ms 47.3138μs 21.1355 KOps/s 21.7681 KOps/s $\color{#d91a1a}-2.91\%$
test_step_mdp_speed[True-True-False-True-False] 61.8110μs 27.0150μs 37.0165 KOps/s 37.1398 KOps/s $\color{#d91a1a}-0.33\%$
test_step_mdp_speed[True-True-False-False-True] 91.0820μs 26.6057μs 37.5860 KOps/s 37.5696 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[True-True-False-False-False] 42.1200μs 15.8927μs 62.9220 KOps/s 61.5491 KOps/s $\color{#35bf28}+2.23\%$
test_step_mdp_speed[True-False-True-True-True] 96.3310μs 49.3250μs 20.2737 KOps/s 20.2021 KOps/s $\color{#35bf28}+0.35\%$
test_step_mdp_speed[True-False-True-True-False] 60.5410μs 29.7836μs 33.5755 KOps/s 33.6666 KOps/s $\color{#d91a1a}-0.27\%$
test_step_mdp_speed[True-False-True-False-True] 64.2010μs 27.0387μs 36.9840 KOps/s 36.6418 KOps/s $\color{#35bf28}+0.93\%$
test_step_mdp_speed[True-False-True-False-False] 54.8210μs 16.1138μs 62.0585 KOps/s 61.8210 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[True-False-False-True-True] 0.1037ms 52.9992μs 18.8682 KOps/s 18.9963 KOps/s $\color{#d91a1a}-0.67\%$
test_step_mdp_speed[True-False-False-True-False] 57.8510μs 33.6922μs 29.6805 KOps/s 30.9161 KOps/s $\color{#d91a1a}-4.00\%$
test_step_mdp_speed[True-False-False-False-True] 67.6210μs 29.8038μs 33.5527 KOps/s 33.5693 KOps/s $\color{#d91a1a}-0.05\%$
test_step_mdp_speed[True-False-False-False-False] 49.8610μs 18.9509μs 52.7678 KOps/s 54.1746 KOps/s $\color{#d91a1a}-2.60\%$
test_step_mdp_speed[False-True-True-True-True] 80.2710μs 49.7328μs 20.1075 KOps/s 20.2668 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[False-True-True-True-False] 0.1110ms 30.0816μs 33.2430 KOps/s 33.3244 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-True-True-False-True] 2.3618ms 31.6346μs 31.6110 KOps/s 32.3251 KOps/s $\color{#d91a1a}-2.21\%$
test_step_mdp_speed[False-True-True-False-False] 47.3610μs 18.5009μs 54.0514 KOps/s 55.3771 KOps/s $\color{#d91a1a}-2.39\%$
test_step_mdp_speed[False-True-False-True-True] 90.2720μs 52.1345μs 19.1811 KOps/s 19.2054 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[False-True-False-True-False] 61.4010μs 32.5389μs 30.7324 KOps/s 30.4267 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[False-True-False-False-True] 68.6010μs 33.7313μs 29.6461 KOps/s 29.2651 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[False-True-False-False-False] 48.6910μs 20.9065μs 47.8320 KOps/s 48.3193 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[False-False-True-True-True] 90.3710μs 54.9675μs 18.1926 KOps/s 18.2834 KOps/s $\color{#d91a1a}-0.50\%$
test_step_mdp_speed[False-False-True-True-False] 70.5710μs 36.1766μs 27.6422 KOps/s 28.7670 KOps/s $\color{#d91a1a}-3.91\%$
test_step_mdp_speed[False-False-True-False-True] 69.2410μs 34.2956μs 29.1583 KOps/s 30.3781 KOps/s $\color{#d91a1a}-4.02\%$
test_step_mdp_speed[False-False-True-False-False] 51.5000μs 20.6449μs 48.4381 KOps/s 48.5472 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-False-False-True-True] 0.1223ms 56.9348μs 17.5639 KOps/s 17.7845 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[False-False-False-True-False] 71.4110μs 38.9019μs 25.7057 KOps/s 26.6154 KOps/s $\color{#d91a1a}-3.42\%$
test_step_mdp_speed[False-False-False-False-True] 71.1310μs 36.6955μs 27.2513 KOps/s 28.6810 KOps/s $\color{#d91a1a}-4.98\%$
test_step_mdp_speed[False-False-False-False-False] 89.8910μs 23.0873μs 43.3138 KOps/s 43.9851 KOps/s $\color{#d91a1a}-1.53\%$
test_values[generalized_advantage_estimate-True-True] 10.4092ms 10.2532ms 97.5304 Ops/s 99.3627 Ops/s $\color{#d91a1a}-1.84\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.3682ms 17.4331ms 57.3620 Ops/s 57.5241 Ops/s $\color{#d91a1a}-0.28\%$
test_values[td0_return_estimate-False-False] 0.2039ms 0.1323ms 7.5559 KOps/s 7.9569 KOps/s $\textbf{\color{#d91a1a}-5.04\%}$
test_values[td1_return_estimate-False-False] 28.4547ms 27.9029ms 35.8386 Ops/s 36.1379 Ops/s $\color{#d91a1a}-0.83\%$
test_values[vec_td1_return_estimate-False-False] 18.6183ms 17.5786ms 56.8873 Ops/s 57.3242 Ops/s $\color{#d91a1a}-0.76\%$
test_values[td_lambda_return_estimate-True-False] 42.7527ms 41.9000ms 23.8664 Ops/s 23.9577 Ops/s $\color{#d91a1a}-0.38\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.9683ms 17.6208ms 56.7512 Ops/s 56.8821 Ops/s $\color{#d91a1a}-0.23\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.9652ms 8.8121ms 113.4809 Ops/s 114.8946 Ops/s $\color{#d91a1a}-1.23\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7755ms 1.5063ms 663.8718 Ops/s 652.9280 Ops/s $\color{#35bf28}+1.68\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5410ms 0.4122ms 2.4258 KOps/s 2.4287 KOps/s $\color{#d91a1a}-0.12\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 29.6223ms 29.1091ms 34.3535 Ops/s 29.1677 Ops/s $\textbf{\color{#35bf28}+17.78\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.8460ms 1.7165ms 582.5650 Ops/s 586.0302 Ops/s $\color{#d91a1a}-0.59\%$
test_dqn_speed[False-None] 6.3806ms 1.4014ms 713.5974 Ops/s 698.2145 Ops/s $\color{#35bf28}+2.20\%$
test_dqn_speed[False-backward] 1.9872ms 1.9099ms 523.5847 Ops/s 511.0335 Ops/s $\color{#35bf28}+2.46\%$
test_dqn_speed[True-None] 0.9140ms 0.5081ms 1.9680 KOps/s 1.9453 KOps/s $\color{#35bf28}+1.17\%$
test_dqn_speed[True-backward] 1.0013ms 0.9651ms 1.0362 KOps/s 882.2673 Ops/s $\textbf{\color{#35bf28}+17.45\%}$
test_dqn_speed[reduce-overhead-None] 0.9148ms 0.5037ms 1.9853 KOps/s 1.9994 KOps/s $\color{#d91a1a}-0.71\%$
test_dqn_speed[reduce-overhead-backward] 0.9960ms 0.9536ms 1.0486 KOps/s 888.2306 Ops/s $\textbf{\color{#35bf28}+18.06\%}$
test_ddpg_speed[False-None] 3.3503ms 2.9426ms 339.8349 Ops/s 347.7126 Ops/s $\color{#d91a1a}-2.27\%$
test_ddpg_speed[False-backward] 4.3396ms 4.0806ms 245.0623 Ops/s 247.4394 Ops/s $\color{#d91a1a}-0.96\%$
test_ddpg_speed[True-None] 1.5758ms 1.3797ms 724.8206 Ops/s 723.8214 Ops/s $\color{#35bf28}+0.14\%$
test_ddpg_speed[True-backward] 2.4202ms 2.3712ms 421.7327 Ops/s 414.0786 Ops/s $\color{#35bf28}+1.85\%$
test_ddpg_speed[reduce-overhead-None] 1.7580ms 1.3734ms 728.1262 Ops/s 741.5867 Ops/s $\color{#d91a1a}-1.82\%$
test_ddpg_speed[reduce-overhead-backward] 2.3880ms 2.3567ms 424.3172 Ops/s 423.1199 Ops/s $\color{#35bf28}+0.28\%$
test_sac_speed[False-None] 8.3282ms 7.8467ms 127.4428 Ops/s 127.1794 Ops/s $\color{#35bf28}+0.21\%$
test_sac_speed[False-backward] 11.6896ms 11.1979ms 89.3024 Ops/s 90.3227 Ops/s $\color{#d91a1a}-1.13\%$
test_sac_speed[True-None] 2.4650ms 2.0932ms 477.7453 Ops/s 472.1576 Ops/s $\color{#35bf28}+1.18\%$
test_sac_speed[True-backward] 4.0729ms 3.9818ms 251.1434 Ops/s 215.7969 Ops/s $\textbf{\color{#35bf28}+16.38\%}$
test_sac_speed[reduce-overhead-None] 2.2486ms 2.0781ms 481.2142 Ops/s 474.3333 Ops/s $\color{#35bf28}+1.45\%$
test_sac_speed[reduce-overhead-backward] 4.1365ms 3.9777ms 251.4037 Ops/s 223.3754 Ops/s $\textbf{\color{#35bf28}+12.55\%}$
test_redq_speed[False-None] 14.1488ms 10.2286ms 97.7652 Ops/s 97.2566 Ops/s $\color{#35bf28}+0.52\%$
test_redq_speed[False-backward] 22.4197ms 17.6208ms 56.7511 Ops/s 56.7552 Ops/s $-0.01\%$
test_redq_speed[True-None] 5.7540ms 4.3009ms 232.5105 Ops/s 239.0876 Ops/s $\color{#d91a1a}-2.75\%$
test_redq_speed[True-backward] 9.6745ms 9.4020ms 106.3599 Ops/s 99.3971 Ops/s $\textbf{\color{#35bf28}+7.00\%}$
test_redq_speed[reduce-overhead-None] 4.4825ms 4.1402ms 241.5363 Ops/s 231.7494 Ops/s $\color{#35bf28}+4.22\%$
test_redq_speed[reduce-overhead-backward] 9.7146ms 9.5150ms 105.0971 Ops/s 103.0926 Ops/s $\color{#35bf28}+1.94\%$
test_redq_deprec_speed[False-None] 11.2928ms 10.8430ms 92.2252 Ops/s 91.3680 Ops/s $\color{#35bf28}+0.94\%$
test_redq_deprec_speed[False-backward] 16.7227ms 15.6025ms 64.0923 Ops/s 63.5685 Ops/s $\color{#35bf28}+0.82\%$
test_redq_deprec_speed[True-None] 3.9485ms 3.5548ms 281.3085 Ops/s 270.3510 Ops/s $\color{#35bf28}+4.05\%$
test_redq_deprec_speed[True-backward] 7.6454ms 7.4893ms 133.5238 Ops/s 130.0116 Ops/s $\color{#35bf28}+2.70\%$
test_redq_deprec_speed[reduce-overhead-None] 3.8428ms 3.5255ms 283.6476 Ops/s 277.9889 Ops/s $\color{#35bf28}+2.04\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.8865ms 7.4606ms 134.0369 Ops/s 132.7817 Ops/s $\color{#35bf28}+0.95\%$
test_td3_speed[False-None] 7.8937ms 7.8475ms 127.4284 Ops/s 120.5785 Ops/s $\textbf{\color{#35bf28}+5.68\%}$
test_td3_speed[False-backward] 11.9067ms 10.8626ms 92.0590 Ops/s 93.2667 Ops/s $\color{#d91a1a}-1.29\%$
test_td3_speed[True-None] 1.8012ms 1.7577ms 568.9213 Ops/s 568.5337 Ops/s $\color{#35bf28}+0.07\%$
test_td3_speed[True-backward] 3.8966ms 3.5389ms 282.5745 Ops/s 243.5716 Ops/s $\textbf{\color{#35bf28}+16.01\%}$
test_td3_speed[reduce-overhead-None] 1.7623ms 1.7275ms 578.8729 Ops/s 579.5318 Ops/s $\color{#d91a1a}-0.11\%$
test_td3_speed[reduce-overhead-backward] 3.7517ms 3.5870ms 278.7865 Ops/s 248.5963 Ops/s $\textbf{\color{#35bf28}+12.14\%}$
test_cql_speed[False-None] 29.1525ms 25.5965ms 39.0678 Ops/s 39.1030 Ops/s $\color{#d91a1a}-0.09\%$
test_cql_speed[False-backward] 37.9824ms 34.9709ms 28.5952 Ops/s 28.4097 Ops/s $\color{#35bf28}+0.65\%$
test_cql_speed[True-None] 15.4202ms 12.2362ms 81.7248 Ops/s 83.3607 Ops/s $\color{#d91a1a}-1.96\%$
test_cql_speed[True-backward] 18.5433ms 17.7478ms 56.3450 Ops/s 54.9477 Ops/s $\color{#35bf28}+2.54\%$
test_cql_speed[reduce-overhead-None] 12.3918ms 12.1185ms 82.5188 Ops/s 81.6323 Ops/s $\color{#35bf28}+1.09\%$
test_cql_speed[reduce-overhead-backward] 18.0830ms 17.8313ms 56.0813 Ops/s 57.2176 Ops/s $\color{#d91a1a}-1.99\%$
test_a2c_speed[False-None] 5.5756ms 5.3302ms 187.6113 Ops/s 186.8765 Ops/s $\color{#35bf28}+0.39\%$
test_a2c_speed[False-backward] 11.9981ms 11.6374ms 85.9301 Ops/s 85.7667 Ops/s $\color{#35bf28}+0.19\%$
test_a2c_speed[True-None] 3.8169ms 3.5686ms 280.2240 Ops/s 273.9228 Ops/s $\color{#35bf28}+2.30\%$
test_a2c_speed[True-backward] 8.8222ms 8.4274ms 118.6610 Ops/s 116.3124 Ops/s $\color{#35bf28}+2.02\%$
test_a2c_speed[reduce-overhead-None] 3.7664ms 3.5859ms 278.8685 Ops/s 275.2816 Ops/s $\color{#35bf28}+1.30\%$
test_a2c_speed[reduce-overhead-backward] 8.7989ms 8.5564ms 116.8715 Ops/s 114.2739 Ops/s $\color{#35bf28}+2.27\%$
test_ppo_speed[False-None] 6.5256ms 5.7741ms 173.1885 Ops/s 172.1190 Ops/s $\color{#35bf28}+0.62\%$
test_ppo_speed[False-backward] 13.0782ms 12.4018ms 80.6338 Ops/s 83.2285 Ops/s $\color{#d91a1a}-3.12\%$
test_ppo_speed[True-None] 3.7235ms 3.5478ms 281.8617 Ops/s 273.5583 Ops/s $\color{#35bf28}+3.04\%$
test_ppo_speed[True-backward] 8.4569ms 8.2034ms 121.9006 Ops/s 114.9533 Ops/s $\textbf{\color{#35bf28}+6.04\%}$
test_ppo_speed[reduce-overhead-None] 3.7007ms 3.5412ms 282.3908 Ops/s 278.8655 Ops/s $\color{#35bf28}+1.26\%$
test_ppo_speed[reduce-overhead-backward] 8.6414ms 8.4689ms 118.0785 Ops/s 110.0801 Ops/s $\textbf{\color{#35bf28}+7.27\%}$
test_reinforce_speed[False-None] 4.6923ms 4.4931ms 222.5611 Ops/s 224.9403 Ops/s $\color{#d91a1a}-1.06\%$
test_reinforce_speed[False-backward] 7.5018ms 7.2663ms 137.6212 Ops/s 138.7194 Ops/s $\color{#d91a1a}-0.79\%$
test_reinforce_speed[True-None] 3.1279ms 2.7737ms 360.5270 Ops/s 351.9411 Ops/s $\color{#35bf28}+2.44\%$
test_reinforce_speed[True-backward] 7.6759ms 7.4763ms 133.7551 Ops/s 128.3747 Ops/s $\color{#35bf28}+4.19\%$
test_reinforce_speed[reduce-overhead-None] 3.0812ms 2.7733ms 360.5807 Ops/s 346.2527 Ops/s $\color{#35bf28}+4.14\%$
test_reinforce_speed[reduce-overhead-backward] 7.9879ms 7.7459ms 129.1005 Ops/s 126.2661 Ops/s $\color{#35bf28}+2.24\%$
test_iql_speed[False-None] 25.1050ms 19.9852ms 50.0370 Ops/s 50.6463 Ops/s $\color{#d91a1a}-1.20\%$
test_iql_speed[False-backward] 30.9149ms 29.8869ms 33.4595 Ops/s 32.8757 Ops/s $\color{#35bf28}+1.78\%$
test_iql_speed[True-None] 8.8477ms 8.2808ms 120.7611 Ops/s 120.2895 Ops/s $\color{#35bf28}+0.39\%$
test_iql_speed[True-backward] 16.6541ms 16.1182ms 62.0417 Ops/s 61.1870 Ops/s $\color{#35bf28}+1.40\%$
test_iql_speed[reduce-overhead-None] 8.6785ms 8.3128ms 120.2963 Ops/s 117.4886 Ops/s $\color{#35bf28}+2.39\%$
test_iql_speed[reduce-overhead-backward] 16.9370ms 16.5455ms 60.4393 Ops/s 57.2073 Ops/s $\textbf{\color{#35bf28}+5.65\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.1825ms 5.8144ms 171.9861 Ops/s 171.2015 Ops/s $\color{#35bf28}+0.46\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7121ms 0.3290ms 3.0396 KOps/s 3.1224 KOps/s $\color{#d91a1a}-2.65\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5659ms 0.3009ms 3.3235 KOps/s 3.0081 KOps/s $\textbf{\color{#35bf28}+10.48\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8512ms 5.5559ms 179.9903 Ops/s 179.3103 Ops/s $\color{#35bf28}+0.38\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.8587ms 0.3008ms 3.3249 KOps/s 2.7163 KOps/s $\textbf{\color{#35bf28}+22.41\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5509ms 0.2925ms 3.4194 KOps/s 3.0084 KOps/s $\textbf{\color{#35bf28}+13.66\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7049ms 1.4280ms 700.2703 Ops/s 699.1135 Ops/s $\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5445ms 1.3272ms 753.4831 Ops/s 742.0578 Ops/s $\color{#35bf28}+1.54\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.4524ms 5.8609ms 170.6219 Ops/s 175.5344 Ops/s $\color{#d91a1a}-2.80\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.1890ms 0.4376ms 2.2851 KOps/s 2.1048 KOps/s $\textbf{\color{#35bf28}+8.57\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6449ms 0.4344ms 2.3023 KOps/s 2.4416 KOps/s $\textbf{\color{#d91a1a}-5.71\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.8136ms 5.6023ms 178.4969 Ops/s 180.2194 Ops/s $\color{#d91a1a}-0.96\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.0083ms 0.2957ms 3.3817 KOps/s 816.2417 Ops/s $\textbf{\color{#35bf28}+314.30\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4565ms 0.2549ms 3.9234 KOps/s 3.9318 KOps/s $\color{#d91a1a}-0.22\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.7624ms 5.4887ms 182.1909 Ops/s 178.4686 Ops/s $\color{#35bf28}+2.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9493ms 0.2769ms 3.6114 KOps/s 3.2216 KOps/s $\textbf{\color{#35bf28}+12.10\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4458ms 0.2580ms 3.8754 KOps/s 3.4910 KOps/s $\textbf{\color{#35bf28}+11.01\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.8478ms 5.7042ms 175.3097 Ops/s 172.5393 Ops/s $\color{#35bf28}+1.61\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.6946ms 0.4480ms 2.2320 KOps/s 2.2883 KOps/s $\color{#d91a1a}-2.46\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8075ms 0.4488ms 2.2281 KOps/s 2.3599 KOps/s $\textbf{\color{#d91a1a}-5.58\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.4473ms 4.9503ms 202.0066 Ops/s 198.1699 Ops/s $\color{#35bf28}+1.94\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 5.5446ms 2.2261ms 449.2194 Ops/s 440.1404 Ops/s $\color{#35bf28}+2.06\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 9.4384ms 1.1774ms 849.3403 Ops/s 820.2186 Ops/s $\color{#35bf28}+3.55\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.5053s 15.0447ms 66.4686 Ops/s 54.9588 Ops/s $\textbf{\color{#35bf28}+20.94\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 3.8212ms 1.6586ms 602.9292 Ops/s 477.1797 Ops/s $\textbf{\color{#35bf28}+26.35\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 8.9634ms 1.1789ms 848.2553 Ops/s 842.9402 Ops/s $\color{#35bf28}+0.63\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.3387ms 5.1964ms 192.4412 Ops/s 187.3154 Ops/s $\color{#35bf28}+2.74\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.7869ms 2.1623ms 462.4630 Ops/s 443.1058 Ops/s $\color{#35bf28}+4.37\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.7302ms 1.3867ms 721.1374 Ops/s 716.2047 Ops/s $\color{#35bf28}+0.69\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 34.6730ms 32.9742ms 30.3267 Ops/s 29.5220 Ops/s $\color{#35bf28}+2.73\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.6963ms 17.4638ms 57.2613 Ops/s 55.2343 Ops/s $\color{#35bf28}+3.67\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 35.5710ms 33.7655ms 29.6160 Ops/s 29.4544 Ops/s $\color{#35bf28}+0.55\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 18.8163ms 17.4103ms 57.4373 Ops/s 54.3997 Ops/s $\textbf{\color{#35bf28}+5.58\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 36.6574ms 35.2441ms 28.3736 Ops/s 28.2072 Ops/s $\color{#35bf28}+0.59\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 21.4938ms 19.3370ms 51.7142 Ops/s 51.5615 Ops/s $\color{#35bf28}+0.30\%$

@vmoens
Update
8722fe9 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Tool services
f2164e9 
ghstack-source-id: 6863f90
Pull-Request: #3220
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Tool services
cc31c1e 
ghstack-source-id: 6863f90
Pull-Request: #3220
@vmoens
Update
da82d11 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 23, 2025
@vmoens
[Feature] Tool services
1ee24cf 
ghstack-source-id: f444d4d
Pull-Request: #3220
@vmoens
Update
8022360 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 25, 2025
@vmoens
[Feature] Tool services
f11c956 
ghstack-source-id: a6cdf57
Pull-Request: #3220
@vmoens
Update
fd322d9 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 25, 2025
@vmoens
[Feature] Tool services
a3274be 
ghstack-source-id: bbad726
Pull-Request: #3220
@vmoens vmoens mentioned this pull request Oct 26, 2025
Closed
@vmoens
Update
d747f8e 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 27, 2025
@vmoens
[Feature] Tool services
1610fe0 
ghstack-source-id: a95a346
Pull-Request: #3220
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens