Skip to content

[CI] Fix GenDGRL CI by adding missing requests dependency #3361

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vmoens merged 2 commits into from
Jan 20, 2026
Merged

[CI] Fix GenDGRL CI by adding missing requests dependency #3361

vmoens merged 2 commits into from
Jan 20, 2026

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Jan 20, 2026

Summary

  • Add missing requests package to GenDGRL CI environment

The Gen-DGRL dataset download requires the requests library, which was not included in the environment dependencies.

Error:

ImportError: The requests package is required for Gen-DGRL dataset download.

Test plan

  • GenDGRL CI should pass after this change

@vmoens
[CI] Fix GenDGRL CI by adding missing requests dependency
5c9a5f5 
The Gen-DGRL dataset download requires the requests package.
@vmoens vmoens added the Environments Adds or modifies an environment wrapper label Jan 20, 2026
@pytorch-bot
Copy link

pytorch-bot bot commented Jan 20, 2026 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3361

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 24 Pending

As of commit 486df2c with merge base 9162db5 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 20, 2026
@vmoens vmoens added the Data Data-related PR, will launch data-related jobs label Jan 20, 2026
@vmoens vmoens merged commit 7165a79 into main Jan 20, 2026
103 of 108 checks passed
@vmoens vmoens deleted the fix-gendgrl-ci branch January 20, 2026 14:21
@github-actions
Copy link

github-actions bot commented Jan 20, 2026

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 148. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}16$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 82.4224μs 81.3750μs 12.2888 KOps/s 12.4478 KOps/s $\color{#d91a1a}-1.28\%$
test_tensor_to_bytestream_speed[torch.save] 0.1472ms 0.1434ms 6.9751 KOps/s 7.1198 KOps/s $\color{#d91a1a}-2.03\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1081s 0.1075s 9.3045 Ops/s 9.3412 Ops/s $\color{#d91a1a}-0.39\%$
test_tensor_to_bytestream_speed[numpy] 2.4701μs 2.4681μs 405.1647 KOps/s 405.8358 KOps/s $\color{#d91a1a}-0.17\%$
test_tensor_to_bytestream_speed[safetensors] 37.2777μs 37.1284μs 26.9336 KOps/s 26.7442 KOps/s $\color{#35bf28}+0.71\%$
test_simple 0.7839s 0.7815s 1.2796 Ops/s 1.2254 Ops/s $\color{#35bf28}+4.43\%$
test_transformed 1.5199s 1.4251s 0.7017 Ops/s 0.6942 Ops/s $\color{#35bf28}+1.08\%$
test_serial 2.3705s 2.2798s 0.4386 Ops/s 0.4366 Ops/s $\color{#35bf28}+0.47\%$
test_parallel 2.1120s 2.0244s 0.4940 Ops/s 0.5149 Ops/s $\color{#d91a1a}-4.07\%$
test_step_mdp_speed[True-True-True-True-True] 0.3575ms 45.5519μs 21.9530 KOps/s 22.3897 KOps/s $\color{#d91a1a}-1.95\%$
test_step_mdp_speed[True-True-True-True-False] 51.7610μs 26.0155μs 38.4386 KOps/s 39.7565 KOps/s $\color{#d91a1a}-3.31\%$
test_step_mdp_speed[True-True-True-False-True] 51.3710μs 25.4316μs 39.3212 KOps/s 40.3403 KOps/s $\color{#d91a1a}-2.53\%$
test_step_mdp_speed[True-True-True-False-False] 37.2200μs 14.1401μs 70.7206 KOps/s 71.7551 KOps/s $\color{#d91a1a}-1.44\%$
test_step_mdp_speed[True-True-False-True-True] 82.8220μs 48.4429μs 20.6429 KOps/s 20.3290 KOps/s $\color{#35bf28}+1.54\%$
test_step_mdp_speed[True-True-False-True-False] 59.4010μs 28.2376μs 35.4138 KOps/s 35.5898 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-True-False-False-True] 56.2510μs 27.8616μs 35.8916 KOps/s 35.3326 KOps/s $\color{#35bf28}+1.58\%$
test_step_mdp_speed[True-True-False-False-False] 51.5110μs 16.8730μs 59.2662 KOps/s 58.8840 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[True-False-True-True-True] 82.2610μs 51.7188μs 19.3353 KOps/s 19.7285 KOps/s $\color{#d91a1a}-1.99\%$
test_step_mdp_speed[True-False-True-True-False] 64.2510μs 30.7983μs 32.4693 KOps/s 32.3366 KOps/s $\color{#35bf28}+0.41\%$
test_step_mdp_speed[True-False-True-False-True] 54.3610μs 28.2684μs 35.3752 KOps/s 35.9218 KOps/s $\color{#d91a1a}-1.52\%$
test_step_mdp_speed[True-False-True-False-False] 49.2400μs 16.9152μs 59.1184 KOps/s 60.7597 KOps/s $\color{#d91a1a}-2.70\%$
test_step_mdp_speed[True-False-False-True-True] 90.1320μs 53.6579μs 18.6366 KOps/s 18.9021 KOps/s $\color{#d91a1a}-1.40\%$
test_step_mdp_speed[True-False-False-True-False] 75.4010μs 33.9496μs 29.4554 KOps/s 30.3161 KOps/s $\color{#d91a1a}-2.84\%$
test_step_mdp_speed[True-False-False-False-True] 61.4710μs 31.1159μs 32.1379 KOps/s 33.2825 KOps/s $\color{#d91a1a}-3.44\%$
test_step_mdp_speed[True-False-False-False-False] 84.4020μs 19.5379μs 51.1826 KOps/s 51.6724 KOps/s $\color{#d91a1a}-0.95\%$
test_step_mdp_speed[False-True-True-True-True] 79.5510μs 51.4350μs 19.4420 KOps/s 19.8495 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[False-True-True-True-False] 57.5610μs 31.2912μs 31.9578 KOps/s 32.6519 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[False-True-True-False-True] 68.2010μs 31.5692μs 31.6765 KOps/s 31.9886 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[False-True-True-False-False] 88.3710μs 18.3679μs 54.4427 KOps/s 54.2020 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-True-False-True-True] 2.7942ms 54.3601μs 18.3958 KOps/s 18.5102 KOps/s $\color{#d91a1a}-0.62\%$
test_step_mdp_speed[False-True-False-True-False] 83.7810μs 34.2251μs 29.2183 KOps/s 29.9067 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[False-True-False-False-True] 60.7110μs 34.6965μs 28.8213 KOps/s 29.4129 KOps/s $\color{#d91a1a}-2.01\%$
test_step_mdp_speed[False-True-False-False-False] 49.3310μs 21.2161μs 47.1340 KOps/s 47.8787 KOps/s $\color{#d91a1a}-1.56\%$
test_step_mdp_speed[False-False-True-True-True] 0.1213ms 57.1064μs 17.5112 KOps/s 17.8570 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[False-False-True-True-False] 63.6610μs 36.7663μs 27.1988 KOps/s 27.6099 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[False-False-True-False-True] 65.9810μs 34.5807μs 28.9179 KOps/s 29.4215 KOps/s $\color{#d91a1a}-1.71\%$
test_step_mdp_speed[False-False-True-False-False] 49.2300μs 20.8772μs 47.8992 KOps/s 47.3079 KOps/s $\color{#35bf28}+1.25\%$
test_step_mdp_speed[False-False-False-True-True] 94.2320μs 57.7443μs 17.3177 KOps/s 17.1237 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[False-False-False-True-False] 0.1041ms 38.9526μs 25.6722 KOps/s 25.8258 KOps/s $\color{#d91a1a}-0.59\%$
test_step_mdp_speed[False-False-False-False-True] 73.1910μs 35.9383μs 27.8255 KOps/s 27.5170 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-False-False-False-False] 66.4110μs 23.5029μs 42.5480 KOps/s 42.4788 KOps/s $\color{#35bf28}+0.16\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.7476s 0.7459s 1.3406 Ops/s 1.3135 Ops/s $\color{#35bf28}+2.06\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7311s 0.6310s 1.5849 Ops/s 1.5919 Ops/s $\color{#d91a1a}-0.44\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7524s 1.6760s 0.5967 Ops/s 0.6003 Ops/s $\color{#d91a1a}-0.61\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5282s 1.4520s 0.6887 Ops/s 0.6921 Ops/s $\color{#d91a1a}-0.49\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 1.9954s 1.9163s 0.5218 Ops/s 0.5242 Ops/s $\color{#d91a1a}-0.45\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7724s 1.6988s 0.5887 Ops/s 0.5917 Ops/s $\color{#d91a1a}-0.51\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.7220s 4.6269s 0.2161 Ops/s 0.2172 Ops/s $\color{#d91a1a}-0.49\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.5401s 4.4458s 0.2249 Ops/s 0.2251 Ops/s $\color{#d91a1a}-0.06\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0425s 1.9750s 0.5063 Ops/s 0.5067 Ops/s $\color{#d91a1a}-0.07\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7453s 1.6782s 0.5959 Ops/s 0.6011 Ops/s $\color{#d91a1a}-0.87\%$
test_values[generalized_advantage_estimate-True-True] 20.0425ms 19.6556ms 50.8761 Ops/s 50.8832 Ops/s $\color{#d91a1a}-0.01\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1350s 3.6038ms 277.4873 Ops/s 277.4898 Ops/s $-0.00\%$
test_values[td0_return_estimate-False-False] 0.1057ms 80.3993μs 12.4379 KOps/s 12.5305 KOps/s $\color{#d91a1a}-0.74\%$
test_values[td1_return_estimate-False-False] 48.5241ms 47.2594ms 21.1598 Ops/s 21.4905 Ops/s $\color{#d91a1a}-1.54\%$
test_values[vec_td1_return_estimate-False-False] 1.2973ms 1.0724ms 932.4786 Ops/s 936.2675 Ops/s $\color{#d91a1a}-0.40\%$
test_values[td_lambda_return_estimate-True-False] 79.8803ms 77.2600ms 12.9433 Ops/s 13.0204 Ops/s $\color{#d91a1a}-0.59\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3029ms 1.0628ms 940.8844 Ops/s 942.2702 Ops/s $\color{#d91a1a}-0.15\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 20.2653ms 19.9036ms 50.2422 Ops/s 49.6924 Ops/s $\color{#35bf28}+1.11\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0339ms 0.7345ms 1.3614 KOps/s 1.3649 KOps/s $\color{#d91a1a}-0.25\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7222ms 0.6600ms 1.5151 KOps/s 1.5271 KOps/s $\color{#d91a1a}-0.78\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5376ms 1.4737ms 678.5552 Ops/s 679.5566 Ops/s $\color{#d91a1a}-0.15\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.8267ms 0.6779ms 1.4751 KOps/s 1.4848 KOps/s $\color{#d91a1a}-0.65\%$
test_dqn_speed[False-None] 1.6486ms 1.5333ms 652.1942 Ops/s 657.3780 Ops/s $\color{#d91a1a}-0.79\%$
test_dqn_speed[False-backward] 2.2310ms 2.1535ms 464.3581 Ops/s 462.9351 Ops/s $\color{#35bf28}+0.31\%$
test_dqn_speed[True-None] 0.6368ms 0.5782ms 1.7296 KOps/s 1.6780 KOps/s $\color{#35bf28}+3.07\%$
test_dqn_speed[True-backward] 1.2528ms 1.2129ms 824.4995 Ops/s 896.6140 Ops/s $\textbf{\color{#d91a1a}-8.04\%}$
test_dqn_speed[reduce-overhead-None] 0.6629ms 0.6061ms 1.6499 KOps/s 1.6420 KOps/s $\color{#35bf28}+0.48\%$
test_ddpg_speed[False-None] 3.3076ms 2.8976ms 345.1169 Ops/s 347.5396 Ops/s $\color{#d91a1a}-0.70\%$
test_ddpg_speed[False-backward] 4.7229ms 4.3032ms 232.3874 Ops/s 242.6874 Ops/s $\color{#d91a1a}-4.24\%$
test_ddpg_speed[True-None] 1.3993ms 1.3194ms 757.9058 Ops/s 745.7526 Ops/s $\color{#35bf28}+1.63\%$
test_ddpg_speed[True-backward] 3.0607ms 2.5723ms 388.7619 Ops/s 410.6398 Ops/s $\textbf{\color{#d91a1a}-5.33\%}$
test_ddpg_speed[reduce-overhead-None] 1.4520ms 1.3501ms 740.6916 Ops/s 728.6895 Ops/s $\color{#35bf28}+1.65\%$
test_sac_speed[False-None] 8.8406ms 8.3212ms 120.1754 Ops/s 120.2943 Ops/s $\color{#d91a1a}-0.10\%$
test_sac_speed[False-backward] 11.9810ms 11.5547ms 86.5449 Ops/s 86.7751 Ops/s $\color{#d91a1a}-0.27\%$
test_sac_speed[True-None] 1.9008ms 1.8444ms 542.1890 Ops/s 540.6397 Ops/s $\color{#35bf28}+0.29\%$
test_sac_speed[True-backward] 3.7254ms 3.6397ms 274.7511 Ops/s 269.9530 Ops/s $\color{#35bf28}+1.78\%$
test_sac_speed[reduce-overhead-None] 20.3581ms 10.5522ms 94.7668 Ops/s 94.6729 Ops/s $\color{#35bf28}+0.10\%$
test_redq_deprec_speed[False-None] 10.1200ms 9.3397ms 107.0694 Ops/s 107.3785 Ops/s $\color{#d91a1a}-0.29\%$
test_redq_deprec_speed[False-backward] 13.2900ms 12.7298ms 78.5557 Ops/s 78.9708 Ops/s $\color{#d91a1a}-0.53\%$
test_redq_deprec_speed[True-None] 2.6746ms 2.5465ms 392.6969 Ops/s 393.2361 Ops/s $\color{#d91a1a}-0.14\%$
test_redq_deprec_speed[True-backward] 4.6500ms 4.3299ms 230.9541 Ops/s 226.9322 Ops/s $\color{#35bf28}+1.77\%$
test_redq_deprec_speed[reduce-overhead-None] 15.5114ms 9.5727ms 104.4640 Ops/s 122.6273 Ops/s $\textbf{\color{#d91a1a}-14.81\%}$
test_td3_speed[False-None] 8.3814ms 8.1892ms 122.1122 Ops/s 122.1139 Ops/s $-0.00\%$
test_td3_speed[False-backward] 11.0125ms 10.6396ms 93.9889 Ops/s 92.5607 Ops/s $\color{#35bf28}+1.54\%$
test_td3_speed[True-None] 1.7845ms 1.7437ms 573.4983 Ops/s 593.2295 Ops/s $\color{#d91a1a}-3.33\%$
test_td3_speed[True-backward] 3.4718ms 3.2987ms 303.1491 Ops/s 298.0884 Ops/s $\color{#35bf28}+1.70\%$
test_td3_speed[reduce-overhead-None] 54.7525ms 23.8034ms 42.0107 Ops/s 40.8063 Ops/s $\color{#35bf28}+2.95\%$
test_cql_speed[False-None] 17.3877ms 17.1294ms 58.3792 Ops/s 57.9282 Ops/s $\color{#35bf28}+0.78\%$
test_cql_speed[False-backward] 22.8109ms 22.3770ms 44.6888 Ops/s 43.9822 Ops/s $\color{#35bf28}+1.61\%$
test_cql_speed[True-None] 3.6305ms 3.4675ms 288.3916 Ops/s 291.6760 Ops/s $\color{#d91a1a}-1.13\%$
test_cql_speed[True-backward] 5.9388ms 5.5401ms 180.5037 Ops/s 172.2091 Ops/s $\color{#35bf28}+4.82\%$
test_cql_speed[reduce-overhead-None] 18.4190ms 11.6235ms 86.0326 Ops/s 85.8733 Ops/s $\color{#35bf28}+0.19\%$
test_a2c_speed[False-None] 3.8391ms 3.2245ms 310.1226 Ops/s 310.6459 Ops/s $\color{#d91a1a}-0.17\%$
test_a2c_speed[False-backward] 6.5047ms 6.0875ms 164.2722 Ops/s 156.9040 Ops/s $\color{#35bf28}+4.70\%$
test_a2c_speed[True-None] 1.4062ms 1.3367ms 748.0863 Ops/s 732.8745 Ops/s $\color{#35bf28}+2.08\%$
test_a2c_speed[True-backward] 3.0772ms 2.9847ms 335.0396 Ops/s 329.8387 Ops/s $\color{#35bf28}+1.58\%$
test_a2c_speed[reduce-overhead-None] 1.0420ms 0.9601ms 1.0416 KOps/s 1.0432 KOps/s $\color{#d91a1a}-0.15\%$
test_ppo_speed[False-None] 3.8892ms 3.7765ms 264.7920 Ops/s 264.5883 Ops/s $\color{#35bf28}+0.08\%$
test_ppo_speed[False-backward] 7.4992ms 6.8500ms 145.9860 Ops/s 145.6961 Ops/s $\color{#35bf28}+0.20\%$
test_ppo_speed[True-None] 1.6270ms 1.4028ms 712.8841 Ops/s 697.5083 Ops/s $\color{#35bf28}+2.20\%$
test_ppo_speed[True-backward] 3.3521ms 3.2007ms 312.4312 Ops/s 293.5971 Ops/s $\textbf{\color{#35bf28}+6.41\%}$
test_ppo_speed[reduce-overhead-None] 1.1960ms 1.0176ms 982.6977 Ops/s 960.5578 Ops/s $\color{#35bf28}+2.30\%$
test_reinforce_speed[False-None] 2.4113ms 2.2742ms 439.7161 Ops/s 439.6814 Ops/s $+0.01\%$
test_reinforce_speed[False-backward] 3.5066ms 3.4076ms 293.4593 Ops/s 295.2883 Ops/s $\color{#d91a1a}-0.62\%$
test_reinforce_speed[True-None] 1.4287ms 1.2660ms 789.9165 Ops/s 760.6570 Ops/s $\color{#35bf28}+3.85\%$
test_reinforce_speed[True-backward] 3.2158ms 3.1419ms 318.2820 Ops/s 319.0611 Ops/s $\color{#d91a1a}-0.24\%$
test_reinforce_speed[reduce-overhead-None] 0.4707s 10.1710ms 98.3185 Ops/s 96.2316 Ops/s $\color{#35bf28}+2.17\%$
test_iql_speed[False-None] 10.0406ms 9.4362ms 105.9746 Ops/s 105.0870 Ops/s $\color{#35bf28}+0.84\%$
test_iql_speed[False-backward] 13.4211ms 13.2197ms 75.6445 Ops/s 74.0156 Ops/s $\color{#35bf28}+2.20\%$
test_iql_speed[True-None] 2.5352ms 2.2207ms 450.2997 Ops/s 442.5393 Ops/s $\color{#35bf28}+1.75\%$
test_iql_speed[True-backward] 5.0230ms 4.8621ms 205.6721 Ops/s 199.5476 Ops/s $\color{#35bf28}+3.07\%$
test_iql_speed[reduce-overhead-None] 0.7168s 12.4941ms 80.0377 Ops/s 98.5014 Ops/s $\textbf{\color{#d91a1a}-18.74\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.5217ms 6.0774ms 164.5449 Ops/s 164.3617 Ops/s $\color{#35bf28}+0.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7019ms 0.3552ms 2.8155 KOps/s 3.0255 KOps/s $\textbf{\color{#d91a1a}-6.94\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5873ms 0.3564ms 2.8056 KOps/s 3.1422 KOps/s $\textbf{\color{#d91a1a}-10.71\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0128ms 5.7921ms 172.6501 Ops/s 170.7151 Ops/s $\color{#35bf28}+1.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.8551ms 0.2964ms 3.3743 KOps/s 2.8135 KOps/s $\textbf{\color{#35bf28}+19.93\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5173ms 0.2826ms 3.5383 KOps/s 3.1099 KOps/s $\textbf{\color{#35bf28}+13.77\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.4986ms 1.2740ms 784.9262 Ops/s 702.6917 Ops/s $\textbf{\color{#35bf28}+11.70\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4418ms 1.1852ms 843.7638 Ops/s 754.5343 Ops/s $\textbf{\color{#35bf28}+11.83\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 10.1208ms 6.1283ms 163.1767 Ops/s 168.3204 Ops/s $\color{#d91a1a}-3.06\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0014ms 0.4404ms 2.2704 KOps/s 2.2488 KOps/s $\color{#35bf28}+0.96\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7257ms 0.4601ms 2.1734 KOps/s 2.2919 KOps/s $\textbf{\color{#d91a1a}-5.17\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.9312ms 5.8395ms 171.2474 Ops/s 170.5578 Ops/s $\color{#35bf28}+0.40\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.9256ms 0.3708ms 2.6969 KOps/s 3.1823 KOps/s $\textbf{\color{#d91a1a}-15.26\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5857ms 0.3811ms 2.6237 KOps/s 3.3185 KOps/s $\textbf{\color{#d91a1a}-20.94\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0878ms 5.7783ms 173.0608 Ops/s 172.7526 Ops/s $\color{#35bf28}+0.18\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.3156ms 0.3825ms 2.6146 KOps/s 3.1809 KOps/s $\textbf{\color{#d91a1a}-17.80\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5320ms 0.3534ms 2.8299 KOps/s 3.3098 KOps/s $\textbf{\color{#d91a1a}-14.50\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.0639ms 5.9402ms 168.3447 Ops/s 168.5067 Ops/s $\color{#d91a1a}-0.10\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.2034ms 0.5285ms 1.8923 KOps/s 2.1292 KOps/s $\textbf{\color{#d91a1a}-11.12\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7294ms 0.5117ms 1.9543 KOps/s 1.9967 KOps/s $\color{#d91a1a}-2.13\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.4105ms 4.9849ms 200.6053 Ops/s 49.1065 Ops/s $\textbf{\color{#35bf28}+308.51\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 12.1748ms 2.2607ms 442.3326 Ops/s 562.1581 Ops/s $\textbf{\color{#d91a1a}-21.32\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1023ms 1.1530ms 867.2870 Ops/s 796.4386 Ops/s $\textbf{\color{#35bf28}+8.90\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.6036s 17.0783ms 58.5539 Ops/s 197.3669 Ops/s $\textbf{\color{#d91a1a}-70.33\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.0624ms 1.9192ms 521.0473 Ops/s 552.6018 Ops/s $\textbf{\color{#d91a1a}-5.71\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 10.3523ms 1.3258ms 754.2363 Ops/s 766.5523 Ops/s $\color{#d91a1a}-1.61\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 8.1517ms 5.2718ms 189.6899 Ops/s 192.2857 Ops/s $\color{#d91a1a}-1.35\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 10.2110ms 2.0532ms 487.0557 Ops/s 494.1137 Ops/s $\color{#d91a1a}-1.43\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.0846ms 1.1378ms 878.9056 Ops/s 932.4060 Ops/s $\textbf{\color{#d91a1a}-5.74\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 38.1876ms 34.6073ms 28.8957 Ops/s 20.5822 Ops/s $\textbf{\color{#35bf28}+40.39\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.1414ms 17.6007ms 56.8158 Ops/s 56.7003 Ops/s $\color{#35bf28}+0.20\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 38.7613ms 35.6931ms 28.0166 Ops/s 28.1798 Ops/s $\color{#d91a1a}-0.58\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 20.4475ms 18.0249ms 55.4789 Ops/s 54.4438 Ops/s $\color{#35bf28}+1.90\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 38.7946ms 37.3247ms 26.7919 Ops/s 26.5534 Ops/s $\color{#35bf28}+0.90\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.3396ms 19.2927ms 51.8330 Ops/s 51.5479 Ops/s $\color{#35bf28}+0.55\%$

@github-actions
Copy link

github-actions bot commented Jan 20, 2026

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 153. Improved: $\large\color{#35bf28}22$. Worsened: $\large\color{#d91a1a}12$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 81.4247μs 80.6129μs 12.4050 KOps/s 12.0561 KOps/s $\color{#35bf28}+2.89\%$
test_tensor_to_bytestream_speed[torch.save] 0.1471ms 0.1420ms 7.0403 KOps/s 7.0944 KOps/s $\color{#d91a1a}-0.76\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1122s 0.1119s 8.9395 Ops/s 7.9079 Ops/s $\textbf{\color{#35bf28}+13.04\%}$
test_tensor_to_bytestream_speed[numpy] 2.4876μs 2.4832μs 402.7031 KOps/s 386.7254 KOps/s $\color{#35bf28}+4.13\%$
test_tensor_to_bytestream_speed[safetensors] 39.7673μs 39.5201μs 25.3036 KOps/s 25.0650 KOps/s $\color{#35bf28}+0.95\%$
test_simple 0.6672s 0.5749s 1.7394 Ops/s 1.7212 Ops/s $\color{#35bf28}+1.06\%$
test_transformed 1.2708s 1.1632s 0.8597 Ops/s 0.8584 Ops/s $\color{#35bf28}+0.15\%$
test_serial 1.6885s 1.6827s 0.5943 Ops/s 0.5794 Ops/s $\color{#35bf28}+2.58\%$
test_parallel 1.2099s 1.1298s 0.8851 Ops/s 0.8645 Ops/s $\color{#35bf28}+2.39\%$
test_step_mdp_speed[True-True-True-True-True] 0.1287ms 44.4077μs 22.5186 KOps/s 21.9725 KOps/s $\color{#35bf28}+2.49\%$
test_step_mdp_speed[True-True-True-True-False] 70.3120μs 24.7930μs 40.3339 KOps/s 40.3833 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[True-True-True-False-True] 63.3000μs 25.2756μs 39.5638 KOps/s 40.0551 KOps/s $\color{#d91a1a}-1.23\%$
test_step_mdp_speed[True-True-True-False-False] 45.5710μs 13.8994μs 71.9457 KOps/s 72.1211 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[True-True-False-True-True] 92.0520μs 47.4282μs 21.0845 KOps/s 20.7710 KOps/s $\color{#35bf28}+1.51\%$
test_step_mdp_speed[True-True-False-True-False] 56.0310μs 28.1988μs 35.4626 KOps/s 36.0027 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[True-True-False-False-True] 60.0010μs 27.8700μs 35.8809 KOps/s 35.5676 KOps/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[True-True-False-False-False] 43.0610μs 16.7380μs 59.7441 KOps/s 60.7446 KOps/s $\color{#d91a1a}-1.65\%$
test_step_mdp_speed[True-False-True-True-True] 81.1110μs 51.0126μs 19.6030 KOps/s 19.5111 KOps/s $\color{#35bf28}+0.47\%$
test_step_mdp_speed[True-False-True-True-False] 70.2110μs 31.0521μs 32.2040 KOps/s 32.8903 KOps/s $\color{#d91a1a}-2.09\%$
test_step_mdp_speed[True-False-True-False-True] 56.1810μs 28.4349μs 35.1681 KOps/s 36.6522 KOps/s $\color{#d91a1a}-4.05\%$
test_step_mdp_speed[True-False-True-False-False] 47.5900μs 16.7107μs 59.8418 KOps/s 60.8139 KOps/s $\color{#d91a1a}-1.60\%$
test_step_mdp_speed[True-False-False-True-True] 90.5410μs 54.2109μs 18.4465 KOps/s 18.5431 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[True-False-False-True-False] 63.6810μs 33.6102μs 29.7529 KOps/s 30.0820 KOps/s $\color{#d91a1a}-1.09\%$
test_step_mdp_speed[True-False-False-False-True] 74.1410μs 31.0834μs 32.1715 KOps/s 32.7362 KOps/s $\color{#d91a1a}-1.73\%$
test_step_mdp_speed[True-False-False-False-False] 44.9910μs 19.3180μs 51.7651 KOps/s 52.2530 KOps/s $\color{#d91a1a}-0.93\%$
test_step_mdp_speed[False-True-True-True-True] 92.4710μs 50.8606μs 19.6616 KOps/s 19.8580 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-True-True-True-False] 63.2910μs 30.8123μs 32.4546 KOps/s 32.6971 KOps/s $\color{#d91a1a}-0.74\%$
test_step_mdp_speed[False-True-True-False-True] 60.0610μs 32.3424μs 30.9191 KOps/s 31.0131 KOps/s $\color{#d91a1a}-0.30\%$
test_step_mdp_speed[False-True-True-False-False] 41.9710μs 18.5213μs 53.9919 KOps/s 54.2138 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-True-False-True-True] 2.7369ms 54.6164μs 18.3095 KOps/s 18.5123 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[False-True-False-True-False] 60.7510μs 33.7085μs 29.6661 KOps/s 29.5760 KOps/s $\color{#35bf28}+0.30\%$
test_step_mdp_speed[False-True-False-False-True] 73.9310μs 34.8589μs 28.6871 KOps/s 29.0801 KOps/s $\color{#d91a1a}-1.35\%$
test_step_mdp_speed[False-True-False-False-False] 50.8310μs 21.2034μs 47.1622 KOps/s 47.6055 KOps/s $\color{#d91a1a}-0.93\%$
test_step_mdp_speed[False-False-True-True-True] 0.1103ms 56.8915μs 17.5773 KOps/s 17.7963 KOps/s $\color{#d91a1a}-1.23\%$
test_step_mdp_speed[False-False-True-True-False] 71.3410μs 36.7050μs 27.2442 KOps/s 27.6365 KOps/s $\color{#d91a1a}-1.42\%$
test_step_mdp_speed[False-False-True-False-True] 72.3210μs 34.2970μs 29.1571 KOps/s 29.0362 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-False-True-False-False] 91.4420μs 21.0627μs 47.4773 KOps/s 47.9589 KOps/s $\color{#d91a1a}-1.00\%$
test_step_mdp_speed[False-False-False-True-True] 89.9710μs 58.7186μs 17.0304 KOps/s 17.1983 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[False-False-False-True-False] 64.9310μs 38.8444μs 25.7437 KOps/s 26.1305 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-False-False-False-True] 77.2120μs 36.3816μs 27.4864 KOps/s 27.5357 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[False-False-False-False-False] 47.1710μs 23.5245μs 42.5088 KOps/s 42.5309 KOps/s $\color{#d91a1a}-0.05\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8612s 0.7606s 1.3147 Ops/s 1.2838 Ops/s $\color{#35bf28}+2.40\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7182s 0.6298s 1.5877 Ops/s 1.5584 Ops/s $\color{#35bf28}+1.88\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7505s 1.6740s 0.5974 Ops/s 0.5923 Ops/s $\color{#35bf28}+0.85\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5191s 1.4466s 0.6913 Ops/s 0.6816 Ops/s $\color{#35bf28}+1.41\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 1.9927s 1.9191s 0.5211 Ops/s 0.5165 Ops/s $\color{#35bf28}+0.89\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7732s 1.6977s 0.5890 Ops/s 0.5799 Ops/s $\color{#35bf28}+1.58\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.7312s 4.6537s 0.2149 Ops/s 0.2152 Ops/s $\color{#d91a1a}-0.15\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.5134s 4.3738s 0.2286 Ops/s 0.2251 Ops/s $\color{#35bf28}+1.58\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0619s 1.9570s 0.5110 Ops/s 0.5086 Ops/s $\color{#35bf28}+0.47\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7610s 1.6969s 0.5893 Ops/s 0.5893 Ops/s $-0.00\%$
test_values[generalized_advantage_estimate-True-True] 10.8405ms 10.2918ms 97.1650 Ops/s 90.8791 Ops/s $\textbf{\color{#35bf28}+6.92\%}$
test_values[vec_generalized_advantage_estimate-True-True] 20.9113ms 18.1002ms 55.2480 Ops/s 55.8394 Ops/s $\color{#d91a1a}-1.06\%$
test_values[td0_return_estimate-False-False] 0.3350ms 0.1387ms 7.2122 KOps/s 7.7841 KOps/s $\textbf{\color{#d91a1a}-7.35\%}$
test_values[td1_return_estimate-False-False] 28.0053ms 27.6256ms 36.1983 Ops/s 33.3600 Ops/s $\textbf{\color{#35bf28}+8.51\%}$
test_values[vec_td1_return_estimate-False-False] 21.6276ms 18.3214ms 54.5809 Ops/s 55.7242 Ops/s $\color{#d91a1a}-2.05\%$
test_values[td_lambda_return_estimate-True-False] 46.4169ms 41.6717ms 23.9971 Ops/s 22.6598 Ops/s $\textbf{\color{#35bf28}+5.90\%}$
test_values[vec_td_lambda_return_estimate-True-False] 21.3656ms 18.4282ms 54.2646 Ops/s 55.7844 Ops/s $\color{#d91a1a}-2.72\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.1504ms 9.0300ms 110.7418 Ops/s 102.0070 Ops/s $\textbf{\color{#35bf28}+8.56\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.8254ms 1.5252ms 655.6321 Ops/s 647.6456 Ops/s $\color{#35bf28}+1.23\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5496ms 0.4288ms 2.3319 KOps/s 2.2990 KOps/s $\color{#35bf28}+1.43\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 35.0959ms 34.4478ms 29.0294 Ops/s 28.6755 Ops/s $\color{#35bf28}+1.23\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.8722ms 1.7511ms 571.0627 Ops/s 568.7443 Ops/s $\color{#35bf28}+0.41\%$
test_dqn_speed[False-None] 1.5081ms 1.4119ms 708.2606 Ops/s 692.7091 Ops/s $\color{#35bf28}+2.25\%$
test_dqn_speed[False-backward] 2.0365ms 1.9502ms 512.7810 Ops/s 507.8615 Ops/s $\color{#35bf28}+0.97\%$
test_dqn_speed[True-None] 0.6679ms 0.5499ms 1.8184 KOps/s 1.8062 KOps/s $\color{#35bf28}+0.68\%$
test_dqn_speed[True-backward] 1.0331ms 0.9990ms 1.0010 KOps/s 876.0107 Ops/s $\textbf{\color{#35bf28}+14.27\%}$
test_dqn_speed[reduce-overhead-None] 0.6636ms 0.5350ms 1.8693 KOps/s 1.7561 KOps/s $\textbf{\color{#35bf28}+6.45\%}$
test_ddpg_speed[False-None] 3.0302ms 2.8668ms 348.8202 Ops/s 338.9216 Ops/s $\color{#35bf28}+2.92\%$
test_ddpg_speed[False-backward] 4.5734ms 4.1589ms 240.4478 Ops/s 235.1668 Ops/s $\color{#35bf28}+2.25\%$
test_ddpg_speed[True-None] 1.5742ms 1.4133ms 707.5709 Ops/s 667.3116 Ops/s $\textbf{\color{#35bf28}+6.03\%}$
test_ddpg_speed[True-backward] 2.5283ms 2.4023ms 416.2684 Ops/s 404.6732 Ops/s $\color{#35bf28}+2.87\%$
test_ddpg_speed[reduce-overhead-None] 1.5456ms 1.3968ms 715.9046 Ops/s 700.2003 Ops/s $\color{#35bf28}+2.24\%$
test_sac_speed[False-None] 8.6694ms 8.0402ms 124.3756 Ops/s 121.2871 Ops/s $\color{#35bf28}+2.55\%$
test_sac_speed[False-backward] 11.7584ms 11.3732ms 87.9259 Ops/s 86.3008 Ops/s $\color{#35bf28}+1.88\%$
test_sac_speed[True-None] 2.3575ms 2.1739ms 460.0066 Ops/s 453.3958 Ops/s $\color{#35bf28}+1.46\%$
test_sac_speed[True-backward] 4.1751ms 4.0349ms 247.8384 Ops/s 240.4336 Ops/s $\color{#35bf28}+3.08\%$
test_sac_speed[reduce-overhead-None] 2.3335ms 2.1619ms 462.5658 Ops/s 455.2267 Ops/s $\color{#35bf28}+1.61\%$
test_redq_speed[False-None] 10.7686ms 10.3216ms 96.8845 Ops/s 93.7607 Ops/s $\color{#35bf28}+3.33\%$
test_redq_speed[False-backward] 18.8821ms 18.1661ms 55.0476 Ops/s 54.2202 Ops/s $\color{#35bf28}+1.53\%$
test_redq_speed[True-None] 4.6894ms 4.4658ms 223.9244 Ops/s 210.3801 Ops/s $\textbf{\color{#35bf28}+6.44\%}$
test_redq_speed[True-backward] 10.0539ms 9.6758ms 103.3502 Ops/s 103.8976 Ops/s $\color{#d91a1a}-0.53\%$
test_redq_speed[reduce-overhead-None] 4.6407ms 4.3918ms 227.6959 Ops/s 217.2817 Ops/s $\color{#35bf28}+4.79\%$
test_redq_deprec_speed[False-None] 11.5371ms 11.0573ms 90.4380 Ops/s 86.5571 Ops/s $\color{#35bf28}+4.48\%$
test_redq_deprec_speed[False-backward] 16.5751ms 15.9854ms 62.5571 Ops/s 60.2942 Ops/s $\color{#35bf28}+3.75\%$
test_redq_deprec_speed[True-None] 3.9783ms 3.6521ms 273.8167 Ops/s 250.0830 Ops/s $\textbf{\color{#35bf28}+9.49\%}$
test_redq_deprec_speed[True-backward] 7.8183ms 7.5133ms 133.0977 Ops/s 125.7868 Ops/s $\textbf{\color{#35bf28}+5.81\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.8102ms 3.6147ms 276.6511 Ops/s 266.3455 Ops/s $\color{#35bf28}+3.87\%$
test_td3_speed[False-None] 8.1377ms 8.0211ms 124.6707 Ops/s 121.4289 Ops/s $\color{#35bf28}+2.67\%$
test_td3_speed[False-backward] 11.5045ms 11.0125ms 90.8058 Ops/s 89.8651 Ops/s $\color{#35bf28}+1.05\%$
test_td3_speed[True-None] 1.8964ms 1.8589ms 537.9633 Ops/s 527.2774 Ops/s $\color{#35bf28}+2.03\%$
test_td3_speed[True-backward] 3.7557ms 3.6321ms 275.3214 Ops/s 213.7876 Ops/s $\textbf{\color{#35bf28}+28.78\%}$
test_td3_speed[reduce-overhead-None] 1.8737ms 1.8152ms 550.8937 Ops/s 542.9783 Ops/s $\color{#35bf28}+1.46\%$
test_cql_speed[False-None] 30.2299ms 26.2315ms 38.1222 Ops/s 37.3633 Ops/s $\color{#35bf28}+2.03\%$
test_cql_speed[False-backward] 38.8001ms 35.4507ms 28.2082 Ops/s 27.5636 Ops/s $\color{#35bf28}+2.34\%$
test_cql_speed[True-None] 12.5002ms 12.1700ms 82.1695 Ops/s 77.6117 Ops/s $\textbf{\color{#35bf28}+5.87\%}$
test_cql_speed[True-backward] 18.1469ms 17.5715ms 56.9103 Ops/s 54.2345 Ops/s $\color{#35bf28}+4.93\%$
test_cql_speed[reduce-overhead-None] 13.7323ms 12.4897ms 80.0658 Ops/s 77.0657 Ops/s $\color{#35bf28}+3.89\%$
test_a2c_speed[False-None] 5.6665ms 5.4276ms 184.2423 Ops/s 179.2236 Ops/s $\color{#35bf28}+2.80\%$
test_a2c_speed[False-backward] 12.5203ms 11.9856ms 83.4331 Ops/s 82.8332 Ops/s $\color{#35bf28}+0.72\%$
test_a2c_speed[True-None] 3.9201ms 3.7540ms 266.3856 Ops/s 264.0909 Ops/s $\color{#35bf28}+0.87\%$
test_a2c_speed[True-backward] 8.9585ms 8.7004ms 114.9373 Ops/s 105.4202 Ops/s $\textbf{\color{#35bf28}+9.03\%}$
test_a2c_speed[reduce-overhead-None] 3.8902ms 3.7479ms 266.8183 Ops/s 266.0532 Ops/s $\color{#35bf28}+0.29\%$
test_ppo_speed[False-None] 6.3766ms 6.0052ms 166.5215 Ops/s 167.9982 Ops/s $\color{#d91a1a}-0.88\%$
test_ppo_speed[False-backward] 13.2763ms 12.6772ms 78.8816 Ops/s 79.8913 Ops/s $\color{#d91a1a}-1.26\%$
test_ppo_speed[True-None] 3.9556ms 3.6593ms 273.2738 Ops/s 272.0691 Ops/s $\color{#35bf28}+0.44\%$
test_ppo_speed[True-backward] 9.2086ms 8.4936ms 117.7358 Ops/s 116.5195 Ops/s $\color{#35bf28}+1.04\%$
test_ppo_speed[reduce-overhead-None] 3.7516ms 3.6202ms 276.2259 Ops/s 273.7869 Ops/s $\color{#35bf28}+0.89\%$
test_reinforce_speed[False-None] 5.1295ms 4.5725ms 218.6964 Ops/s 214.7662 Ops/s $\color{#35bf28}+1.83\%$
test_reinforce_speed[False-backward] 7.6799ms 7.4728ms 133.8187 Ops/s 132.6664 Ops/s $\color{#35bf28}+0.87\%$
test_reinforce_speed[True-None] 3.1409ms 2.8558ms 350.1702 Ops/s 340.4443 Ops/s $\color{#35bf28}+2.86\%$
test_reinforce_speed[True-backward] 8.3738ms 7.8637ms 127.1663 Ops/s 126.5582 Ops/s $\color{#35bf28}+0.48\%$
test_reinforce_speed[reduce-overhead-None] 3.3032ms 2.8833ms 346.8198 Ops/s 335.9477 Ops/s $\color{#35bf28}+3.24\%$
test_iql_speed[False-None] 25.8136ms 20.1964ms 49.5138 Ops/s 48.7315 Ops/s $\color{#35bf28}+1.61\%$
test_iql_speed[False-backward] 31.5402ms 30.6822ms 32.5922 Ops/s 31.7840 Ops/s $\color{#35bf28}+2.54\%$
test_iql_speed[True-None] 9.0132ms 8.6141ms 116.0886 Ops/s 115.0024 Ops/s $\color{#35bf28}+0.94\%$
test_iql_speed[True-backward] 17.4625ms 16.9320ms 59.0599 Ops/s 57.1280 Ops/s $\color{#35bf28}+3.38\%$
test_iql_speed[reduce-overhead-None] 9.1569ms 8.6145ms 116.0840 Ops/s 108.3024 Ops/s $\textbf{\color{#35bf28}+7.19\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.6767ms 6.0724ms 164.6809 Ops/s 164.6501 Ops/s $\color{#35bf28}+0.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5620ms 0.3300ms 3.0307 KOps/s 3.4022 KOps/s $\textbf{\color{#d91a1a}-10.92\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5367ms 0.2764ms 3.6185 KOps/s 3.3507 KOps/s $\textbf{\color{#35bf28}+7.99\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0287ms 5.7734ms 173.2086 Ops/s 172.2478 Ops/s $\color{#35bf28}+0.56\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.7685ms 0.3347ms 2.9877 KOps/s 3.2114 KOps/s $\textbf{\color{#d91a1a}-6.96\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5728ms 0.3066ms 3.2615 KOps/s 3.5136 KOps/s $\textbf{\color{#d91a1a}-7.17\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6261ms 1.4465ms 691.3036 Ops/s 757.4558 Ops/s $\textbf{\color{#d91a1a}-8.73\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6388ms 1.3478ms 741.9455 Ops/s 808.9509 Ops/s $\textbf{\color{#d91a1a}-8.28\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.8815ms 6.1205ms 163.3850 Ops/s 166.6772 Ops/s $\color{#d91a1a}-1.98\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0880ms 0.5111ms 1.9567 KOps/s 2.0946 KOps/s $\textbf{\color{#d91a1a}-6.58\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7278ms 0.4973ms 2.0109 KOps/s 2.1484 KOps/s $\textbf{\color{#d91a1a}-6.40\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.8389ms 5.7521ms 173.8484 Ops/s 170.4967 Ops/s $\color{#35bf28}+1.97\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.8056ms 0.3212ms 3.1138 KOps/s 2.8687 KOps/s $\textbf{\color{#35bf28}+8.54\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6917ms 0.3240ms 3.0866 KOps/s 3.3176 KOps/s $\textbf{\color{#d91a1a}-6.97\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0419ms 5.7225ms 174.7501 Ops/s 172.4664 Ops/s $\color{#35bf28}+1.32\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.7934ms 0.3347ms 2.9881 KOps/s 2.8064 KOps/s $\textbf{\color{#35bf28}+6.47\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4810ms 0.2660ms 3.7588 KOps/s 3.0535 KOps/s $\textbf{\color{#35bf28}+23.10\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.2695ms 5.9025ms 169.4210 Ops/s 166.3977 Ops/s $\color{#35bf28}+1.82\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0259ms 0.4809ms 2.0795 KOps/s 2.1692 KOps/s $\color{#d91a1a}-4.14\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6571ms 0.4777ms 2.0934 KOps/s 2.3220 KOps/s $\textbf{\color{#d91a1a}-9.85\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.5793s 16.5878ms 60.2854 Ops/s 196.7380 Ops/s $\textbf{\color{#d91a1a}-69.36\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 11.6856ms 2.0375ms 490.7926 Ops/s 514.6767 Ops/s $\color{#d91a1a}-4.64\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.3461ms 0.8958ms 1.1164 KOps/s 735.0819 Ops/s $\textbf{\color{#35bf28}+51.87\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.5017ms 5.0248ms 199.0111 Ops/s 197.1319 Ops/s $\color{#35bf28}+0.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 13.2181ms 2.0151ms 496.2458 Ops/s 522.3126 Ops/s $\color{#d91a1a}-4.99\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.6226ms 1.1396ms 877.4714 Ops/s 746.5546 Ops/s $\textbf{\color{#35bf28}+17.54\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.5211s 15.6326ms 63.9690 Ops/s 58.1795 Ops/s $\textbf{\color{#35bf28}+9.95\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 7.8386ms 2.0520ms 487.3216 Ops/s 479.6995 Ops/s $\color{#35bf28}+1.59\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 12.0126ms 1.4821ms 674.7369 Ops/s 924.2873 Ops/s $\textbf{\color{#d91a1a}-27.00\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 36.1400ms 33.7944ms 29.5907 Ops/s 28.5019 Ops/s $\color{#35bf28}+3.82\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.5674ms 17.7082ms 56.4712 Ops/s 53.8880 Ops/s $\color{#35bf28}+4.79\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 38.3778ms 35.5012ms 28.1681 Ops/s 27.6090 Ops/s $\color{#35bf28}+2.03\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.7182ms 17.9792ms 55.6199 Ops/s 54.5205 Ops/s $\color{#35bf28}+2.02\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 38.5566ms 36.8333ms 27.1494 Ops/s 26.1170 Ops/s $\color{#35bf28}+3.95\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.9400ms 19.4568ms 51.3958 Ops/s 49.9938 Ops/s $\color{#35bf28}+2.80\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Data Data-related PR, will launch data-related jobs Environments Adds or modifies an environment wrapper

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens