Skip to content

Conversation

[ghstack-poisoned]
Copy link

pytorch-bot bot commented Oct 20, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3213

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 6 New Failures, 10 Unrelated Failures

As of commit a2c2973 with merge base a7707ca (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[ghstack-poisoned]
Copy link

github-actions bot commented Oct 20, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}18$. Worsened: $\large\color{#d91a1a}12$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 83.7819μs 82.3663μs 12.1409 KOps/s 12.1855 KOps/s $\color{#d91a1a}-0.37\%$
test_tensor_to_bytestream_speed[torch.save] 0.1389ms 0.1379ms 7.2527 KOps/s 7.1921 KOps/s $\color{#35bf28}+0.84\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1209s 0.1200s 8.3347 Ops/s 8.3608 Ops/s $\color{#d91a1a}-0.31\%$
test_tensor_to_bytestream_speed[numpy] 2.9435μs 2.9395μs 340.1882 KOps/s 354.0686 KOps/s $\color{#d91a1a}-3.92\%$
test_tensor_to_bytestream_speed[safetensors] 42.4952μs 42.1821μs 23.7068 KOps/s 23.5520 KOps/s $\color{#35bf28}+0.66\%$
test_simple 0.5473s 0.5463s 1.8306 Ops/s 1.7477 Ops/s $\color{#35bf28}+4.74\%$
test_transformed 1.2208s 1.1289s 0.8858 Ops/s 0.8804 Ops/s $\color{#35bf28}+0.62\%$
test_serial 1.6721s 1.6682s 0.5995 Ops/s 0.5952 Ops/s $\color{#35bf28}+0.72\%$
test_parallel 1.1914s 1.1222s 0.8911 Ops/s 0.9187 Ops/s $\color{#d91a1a}-3.00\%$
test_step_mdp_speed[True-True-True-True-True] 0.2533ms 46.2990μs 21.5987 KOps/s 22.3136 KOps/s $\color{#d91a1a}-3.20\%$
test_step_mdp_speed[True-True-True-True-False] 52.4410μs 25.9325μs 38.5617 KOps/s 39.4419 KOps/s $\color{#d91a1a}-2.23\%$
test_step_mdp_speed[True-True-True-False-True] 54.8910μs 25.7841μs 38.7836 KOps/s 39.3116 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[True-True-True-False-False] 45.8810μs 14.2134μs 70.3559 KOps/s 71.6458 KOps/s $\color{#d91a1a}-1.80\%$
test_step_mdp_speed[True-True-False-True-True] 79.9020μs 48.6641μs 20.5490 KOps/s 20.7832 KOps/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-True-False-True-False] 58.9310μs 28.5322μs 35.0481 KOps/s 35.4503 KOps/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-True-False-False-True] 57.8810μs 28.4436μs 35.1573 KOps/s 35.2912 KOps/s $\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-True-False-False-False] 51.9100μs 17.0964μs 58.4917 KOps/s 59.2319 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-False-True-True-True] 0.1229ms 51.0732μs 19.5797 KOps/s 19.6930 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-False-True-True-False] 70.8310μs 31.2147μs 32.0362 KOps/s 32.1536 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[True-False-True-False-True] 62.9410μs 28.6306μs 34.9276 KOps/s 35.8004 KOps/s $\color{#d91a1a}-2.44\%$
test_step_mdp_speed[True-False-True-False-False] 45.7900μs 17.1112μs 58.4413 KOps/s 59.6673 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[True-False-False-True-True] 85.9720μs 54.6837μs 18.2870 KOps/s 18.6905 KOps/s $\color{#d91a1a}-2.16\%$
test_step_mdp_speed[True-False-False-True-False] 0.1039ms 33.9248μs 29.4769 KOps/s 29.8895 KOps/s $\color{#d91a1a}-1.38\%$
test_step_mdp_speed[True-False-False-False-True] 67.7310μs 31.4980μs 31.7480 KOps/s 32.8618 KOps/s $\color{#d91a1a}-3.39\%$
test_step_mdp_speed[True-False-False-False-False] 52.8410μs 19.4689μs 51.3639 KOps/s 51.6087 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[False-True-True-True-True] 83.3110μs 51.5800μs 19.3874 KOps/s 19.6786 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-True-True-True-False] 65.7910μs 30.7712μs 32.4979 KOps/s 32.1524 KOps/s $\color{#35bf28}+1.07\%$
test_step_mdp_speed[False-True-True-False-True] 2.4820ms 32.5745μs 30.6989 KOps/s 30.9124 KOps/s $\color{#d91a1a}-0.69\%$
test_step_mdp_speed[False-True-True-False-False] 50.8200μs 18.5592μs 53.8815 KOps/s 54.5796 KOps/s $\color{#d91a1a}-1.28\%$
test_step_mdp_speed[False-True-False-True-True] 90.1420μs 53.3379μs 18.7484 KOps/s 18.8043 KOps/s $\color{#d91a1a}-0.30\%$
test_step_mdp_speed[False-True-False-True-False] 74.5420μs 33.9815μs 29.4278 KOps/s 29.7913 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[False-True-False-False-True] 71.6810μs 34.2580μs 29.1902 KOps/s 28.9523 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[False-True-False-False-False] 62.5110μs 21.2931μs 46.9636 KOps/s 46.9710 KOps/s $\color{#d91a1a}-0.02\%$
test_step_mdp_speed[False-False-True-True-True] 96.3010μs 56.1533μs 17.8084 KOps/s 17.6131 KOps/s $\color{#35bf28}+1.11\%$
test_step_mdp_speed[False-False-True-True-False] 74.1010μs 36.4823μs 27.4106 KOps/s 27.6347 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[False-False-True-False-True] 66.2410μs 34.9224μs 28.6349 KOps/s 28.8556 KOps/s $\color{#d91a1a}-0.76\%$
test_step_mdp_speed[False-False-True-False-False] 94.1620μs 21.3555μs 46.8264 KOps/s 47.1909 KOps/s $\color{#d91a1a}-0.77\%$
test_step_mdp_speed[False-False-False-True-True] 0.1179ms 58.3855μs 17.1275 KOps/s 17.2856 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-False-False-True-False] 71.0110μs 38.8082μs 25.7677 KOps/s 25.9075 KOps/s $\color{#d91a1a}-0.54\%$
test_step_mdp_speed[False-False-False-False-True] 65.9010μs 36.4198μs 27.4576 KOps/s 27.3171 KOps/s $\color{#35bf28}+0.51\%$
test_step_mdp_speed[False-False-False-False-False] 58.0410μs 23.5414μs 42.4784 KOps/s 42.9621 KOps/s $\color{#d91a1a}-1.13\%$
test_values[generalized_advantage_estimate-True-True] 10.3717ms 9.5861ms 104.3178 Ops/s 102.6082 Ops/s $\color{#35bf28}+1.67\%$
test_values[vec_generalized_advantage_estimate-True-True] 13.4654ms 11.0212ms 90.7340 Ops/s 57.0194 Ops/s $\textbf{\color{#35bf28}+59.13\%}$
test_values[td0_return_estimate-False-False] 0.2288ms 0.1313ms 7.6167 KOps/s 7.7308 KOps/s $\color{#d91a1a}-1.48\%$
test_values[td1_return_estimate-False-False] 27.0750ms 26.6402ms 37.5372 Ops/s 37.9899 Ops/s $\color{#d91a1a}-1.19\%$
test_values[vec_td1_return_estimate-False-False] 11.5460ms 11.1530ms 89.6622 Ops/s 56.8749 Ops/s $\textbf{\color{#35bf28}+57.65\%}$
test_values[td_lambda_return_estimate-True-False] 40.1745ms 39.5529ms 25.2826 Ops/s 25.4506 Ops/s $\color{#d91a1a}-0.66\%$
test_values[vec_td_lambda_return_estimate-True-False] 11.4175ms 11.1477ms 89.7047 Ops/s 56.9961 Ops/s $\textbf{\color{#35bf28}+57.39\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.3672ms 8.1963ms 122.0056 Ops/s 121.5140 Ops/s $\color{#35bf28}+0.40\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.9498ms 1.5079ms 663.1940 Ops/s 661.8364 Ops/s $\color{#35bf28}+0.21\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4713ms 0.4067ms 2.4586 KOps/s 2.4686 KOps/s $\color{#d91a1a}-0.40\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 23.5418ms 23.0017ms 43.4750 Ops/s 30.0861 Ops/s $\textbf{\color{#35bf28}+44.50\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1049ms 1.7081ms 585.4425 Ops/s 588.2862 Ops/s $\color{#d91a1a}-0.48\%$
test_dqn_speed[False-None] 1.5059ms 1.4102ms 709.0969 Ops/s 700.2723 Ops/s $\color{#35bf28}+1.26\%$
test_dqn_speed[False-backward] 1.9885ms 1.9289ms 518.4433 Ops/s 517.3751 Ops/s $\color{#35bf28}+0.21\%$
test_dqn_speed[True-None] 0.9236ms 0.5254ms 1.9033 KOps/s 1.7983 KOps/s $\textbf{\color{#35bf28}+5.83\%}$
test_dqn_speed[True-backward] 1.0577ms 0.9836ms 1.0167 KOps/s 837.7946 Ops/s $\textbf{\color{#35bf28}+21.35\%}$
test_dqn_speed[reduce-overhead-None] 0.8204ms 0.5137ms 1.9465 KOps/s 1.8877 KOps/s $\color{#35bf28}+3.12\%$
test_dqn_speed[reduce-overhead-backward] 1.0013ms 0.9625ms 1.0389 KOps/s 923.5029 Ops/s $\textbf{\color{#35bf28}+12.50\%}$
test_ddpg_speed[False-None] 3.3205ms 2.8983ms 345.0318 Ops/s 346.5410 Ops/s $\color{#d91a1a}-0.44\%$
test_ddpg_speed[False-backward] 4.2914ms 4.1329ms 241.9623 Ops/s 243.3108 Ops/s $\color{#d91a1a}-0.55\%$
test_ddpg_speed[True-None] 1.6947ms 1.4149ms 706.7798 Ops/s 699.5493 Ops/s $\color{#35bf28}+1.03\%$
test_ddpg_speed[True-backward] 2.5542ms 2.4171ms 413.7248 Ops/s 374.2651 Ops/s $\textbf{\color{#35bf28}+10.54\%}$
test_ddpg_speed[reduce-overhead-None] 1.5183ms 1.4121ms 708.1746 Ops/s 704.7307 Ops/s $\color{#35bf28}+0.49\%$
test_ddpg_speed[reduce-overhead-backward] 2.4635ms 2.4071ms 415.4377 Ops/s 418.7963 Ops/s $\color{#d91a1a}-0.80\%$
test_sac_speed[False-None] 8.3945ms 7.8996ms 126.5891 Ops/s 127.0872 Ops/s $\color{#d91a1a}-0.39\%$
test_sac_speed[False-backward] 11.6791ms 11.2217ms 89.1132 Ops/s 89.5740 Ops/s $\color{#d91a1a}-0.51\%$
test_sac_speed[True-None] 2.5571ms 2.1539ms 464.2749 Ops/s 458.7864 Ops/s $\color{#35bf28}+1.20\%$
test_sac_speed[True-backward] 4.4597ms 4.0846ms 244.8210 Ops/s 216.4135 Ops/s $\textbf{\color{#35bf28}+13.13\%}$
test_sac_speed[reduce-overhead-None] 2.4240ms 2.1353ms 468.3127 Ops/s 454.4225 Ops/s $\color{#35bf28}+3.06\%$
test_sac_speed[reduce-overhead-backward] 4.2557ms 4.1569ms 240.5634 Ops/s 242.3120 Ops/s $\color{#d91a1a}-0.72\%$
test_redq_speed[False-None] 11.1122ms 10.4086ms 96.0746 Ops/s 93.5050 Ops/s $\color{#35bf28}+2.75\%$
test_redq_speed[False-backward] 18.9598ms 17.9957ms 55.5687 Ops/s 51.6457 Ops/s $\textbf{\color{#35bf28}+7.60\%}$
test_redq_speed[True-None] 4.7048ms 4.5435ms 220.0939 Ops/s 225.2318 Ops/s $\color{#d91a1a}-2.28\%$
test_redq_speed[True-backward] 10.3565ms 10.0651ms 99.3531 Ops/s 101.8173 Ops/s $\color{#d91a1a}-2.42\%$
test_redq_speed[reduce-overhead-None] 5.0599ms 4.4486ms 224.7890 Ops/s 230.2226 Ops/s $\color{#d91a1a}-2.36\%$
test_redq_speed[reduce-overhead-backward] 10.8079ms 10.3241ms 96.8605 Ops/s 91.5712 Ops/s $\textbf{\color{#35bf28}+5.78\%}$
test_redq_deprec_speed[False-None] 11.7776ms 11.0879ms 90.1886 Ops/s 88.4472 Ops/s $\color{#35bf28}+1.97\%$
test_redq_deprec_speed[False-backward] 16.7070ms 16.1104ms 62.0717 Ops/s 61.3817 Ops/s $\color{#35bf28}+1.12\%$
test_redq_deprec_speed[True-None] 4.0800ms 3.7069ms 269.7664 Ops/s 257.6140 Ops/s $\color{#35bf28}+4.72\%$
test_redq_deprec_speed[True-backward] 8.0711ms 7.7682ms 128.7307 Ops/s 120.6560 Ops/s $\textbf{\color{#35bf28}+6.69\%}$
test_redq_deprec_speed[reduce-overhead-None] 4.0640ms 3.6397ms 274.7447 Ops/s 267.3946 Ops/s $\color{#35bf28}+2.75\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.2201ms 7.7913ms 128.3481 Ops/s 125.5083 Ops/s $\color{#35bf28}+2.26\%$
test_td3_speed[False-None] 8.1169ms 7.9613ms 125.6075 Ops/s 126.1545 Ops/s $\color{#d91a1a}-0.43\%$
test_td3_speed[False-backward] 11.6584ms 10.9155ms 91.6125 Ops/s 91.9945 Ops/s $\color{#d91a1a}-0.42\%$
test_td3_speed[True-None] 1.9572ms 1.8648ms 536.2459 Ops/s 526.7031 Ops/s $\color{#35bf28}+1.81\%$
test_td3_speed[True-backward] 3.8690ms 3.7031ms 270.0457 Ops/s 221.1490 Ops/s $\textbf{\color{#35bf28}+22.11\%}$
test_td3_speed[reduce-overhead-None] 1.8451ms 1.8203ms 549.3654 Ops/s 542.1679 Ops/s $\color{#35bf28}+1.33\%$
test_td3_speed[reduce-overhead-backward] 3.8021ms 3.6958ms 270.5800 Ops/s 243.0503 Ops/s $\textbf{\color{#35bf28}+11.33\%}$
test_cql_speed[False-None] 30.3799ms 26.4830ms 37.7601 Ops/s 38.7755 Ops/s $\color{#d91a1a}-2.62\%$
test_cql_speed[False-backward] 39.6626ms 36.1824ms 27.6377 Ops/s 28.2652 Ops/s $\color{#d91a1a}-2.22\%$
test_cql_speed[True-None] 13.0644ms 12.7087ms 78.6865 Ops/s 80.6360 Ops/s $\color{#d91a1a}-2.42\%$
test_cql_speed[True-backward] 19.8387ms 18.8300ms 53.1066 Ops/s 55.2126 Ops/s $\color{#d91a1a}-3.81\%$
test_cql_speed[reduce-overhead-None] 13.1932ms 12.8314ms 77.9340 Ops/s 79.8640 Ops/s $\color{#d91a1a}-2.42\%$
test_cql_speed[reduce-overhead-backward] 19.2268ms 19.0295ms 52.5500 Ops/s 51.9509 Ops/s $\color{#35bf28}+1.15\%$
test_a2c_speed[False-None] 5.7214ms 5.3814ms 185.8263 Ops/s 179.3144 Ops/s $\color{#35bf28}+3.63\%$
test_a2c_speed[False-backward] 12.2464ms 12.0246ms 83.1630 Ops/s 82.4271 Ops/s $\color{#35bf28}+0.89\%$
test_a2c_speed[True-None] 4.0478ms 3.7551ms 266.3028 Ops/s 260.3469 Ops/s $\color{#35bf28}+2.29\%$
test_a2c_speed[True-backward] 9.1420ms 8.8340ms 113.1993 Ops/s 112.6369 Ops/s $\color{#35bf28}+0.50\%$
test_a2c_speed[reduce-overhead-None] 3.9748ms 3.7581ms 266.0890 Ops/s 266.7614 Ops/s $\color{#d91a1a}-0.25\%$
test_a2c_speed[reduce-overhead-backward] 9.1811ms 9.0207ms 110.8556 Ops/s 107.1160 Ops/s $\color{#35bf28}+3.49\%$
test_ppo_speed[False-None] 6.1765ms 5.9898ms 166.9512 Ops/s 171.0524 Ops/s $\color{#d91a1a}-2.40\%$
test_ppo_speed[False-backward] 13.1737ms 12.8778ms 77.6528 Ops/s 78.7087 Ops/s $\color{#d91a1a}-1.34\%$
test_ppo_speed[True-None] 4.6781ms 3.7503ms 266.6467 Ops/s 269.5750 Ops/s $\color{#d91a1a}-1.09\%$
test_ppo_speed[True-backward] 8.7814ms 8.5964ms 116.3283 Ops/s 113.7416 Ops/s $\color{#35bf28}+2.27\%$
test_ppo_speed[reduce-overhead-None] 3.8761ms 3.7330ms 267.8808 Ops/s 265.9609 Ops/s $\color{#35bf28}+0.72\%$
test_ppo_speed[reduce-overhead-backward] 8.9853ms 8.8361ms 113.1717 Ops/s 111.8950 Ops/s $\color{#35bf28}+1.14\%$
test_reinforce_speed[False-None] 4.9184ms 4.6719ms 214.0468 Ops/s 212.1550 Ops/s $\color{#35bf28}+0.89\%$
test_reinforce_speed[False-backward] 7.8063ms 7.5749ms 132.0154 Ops/s 132.4550 Ops/s $\color{#d91a1a}-0.33\%$
test_reinforce_speed[True-None] 3.1721ms 2.9456ms 339.4948 Ops/s 333.9149 Ops/s $\color{#35bf28}+1.67\%$
test_reinforce_speed[True-backward] 8.2249ms 7.8894ms 126.7526 Ops/s 124.7857 Ops/s $\color{#35bf28}+1.58\%$
test_reinforce_speed[reduce-overhead-None] 3.0835ms 2.8967ms 345.2240 Ops/s 347.0025 Ops/s $\color{#d91a1a}-0.51\%$
test_reinforce_speed[reduce-overhead-backward] 8.3030ms 8.0518ms 124.1961 Ops/s 115.9822 Ops/s $\textbf{\color{#35bf28}+7.08\%}$
test_iql_speed[False-None] 27.1475ms 20.8840ms 47.8835 Ops/s 49.7896 Ops/s $\color{#d91a1a}-3.83\%$
test_iql_speed[False-backward] 37.1301ms 31.4921ms 31.7540 Ops/s 32.2427 Ops/s $\color{#d91a1a}-1.52\%$
test_iql_speed[True-None] 9.0280ms 8.6979ms 114.9699 Ops/s 114.5907 Ops/s $\color{#35bf28}+0.33\%$
test_iql_speed[True-backward] 17.4333ms 17.0526ms 58.6421 Ops/s 57.8772 Ops/s $\color{#35bf28}+1.32\%$
test_iql_speed[reduce-overhead-None] 9.1890ms 8.7910ms 113.7532 Ops/s 113.1268 Ops/s $\color{#35bf28}+0.55\%$
test_iql_speed[reduce-overhead-backward] 18.0073ms 17.6061ms 56.7983 Ops/s 56.4499 Ops/s $\color{#35bf28}+0.62\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.4160ms 6.0369ms 165.6486 Ops/s 166.8080 Ops/s $\color{#d91a1a}-0.70\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6286ms 0.3884ms 2.5744 KOps/s 3.0413 KOps/s $\textbf{\color{#d91a1a}-15.35\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6937ms 0.3509ms 2.8498 KOps/s 2.8413 KOps/s $\color{#35bf28}+0.30\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0846ms 5.7681ms 173.3688 Ops/s 174.7732 Ops/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.6620ms 0.3890ms 2.5708 KOps/s 2.9910 KOps/s $\textbf{\color{#d91a1a}-14.05\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5966ms 0.3670ms 2.7250 KOps/s 3.6467 KOps/s $\textbf{\color{#d91a1a}-25.27\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7542ms 1.4292ms 699.6963 Ops/s 782.6656 Ops/s $\textbf{\color{#d91a1a}-10.60\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6563ms 1.2987ms 770.0046 Ops/s 839.1736 Ops/s $\textbf{\color{#d91a1a}-8.24\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.2952ms 6.0208ms 166.0919 Ops/s 169.0130 Ops/s $\color{#d91a1a}-1.73\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.3414ms 0.4975ms 2.0102 KOps/s 2.2295 KOps/s $\textbf{\color{#d91a1a}-9.84\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7992ms 0.4278ms 2.3375 KOps/s 2.3000 KOps/s $\color{#35bf28}+1.63\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.8919ms 5.8053ms 172.2553 Ops/s 173.0079 Ops/s $\color{#d91a1a}-0.44\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.1227ms 0.3498ms 2.8586 KOps/s 3.3701 KOps/s $\textbf{\color{#d91a1a}-15.18\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5678ms 0.3249ms 3.0777 KOps/s 3.1530 KOps/s $\color{#d91a1a}-2.39\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0162ms 5.7575ms 173.6866 Ops/s 173.9062 Ops/s $\color{#d91a1a}-0.13\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9516ms 0.4135ms 2.4185 KOps/s 3.2625 KOps/s $\textbf{\color{#d91a1a}-25.87\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6568ms 0.3488ms 2.8672 KOps/s 3.1515 KOps/s $\textbf{\color{#d91a1a}-9.02\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1229ms 5.9634ms 167.6896 Ops/s 168.1627 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0933ms 0.4803ms 2.0820 KOps/s 2.0012 KOps/s $\color{#35bf28}+4.04\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6601ms 0.4419ms 2.2631 KOps/s 2.1463 KOps/s $\textbf{\color{#35bf28}+5.44\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.6998ms 5.0984ms 196.1409 Ops/s 196.4543 Ops/s $\color{#d91a1a}-0.16\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 8.1248ms 2.3128ms 432.3799 Ops/s 485.6414 Ops/s $\textbf{\color{#d91a1a}-10.97\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.9378ms 1.2019ms 831.9964 Ops/s 836.3553 Ops/s $\color{#d91a1a}-0.52\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.9757ms 5.1462ms 194.3172 Ops/s 192.5630 Ops/s $\color{#35bf28}+0.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.5267s 12.6353ms 79.1432 Ops/s 494.5715 Ops/s $\textbf{\color{#d91a1a}-84.00\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.0411ms 1.1390ms 878.0006 Ops/s 833.8828 Ops/s $\textbf{\color{#35bf28}+5.29\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 6.8047ms 5.2432ms 190.7249 Ops/s 55.3267 Ops/s $\textbf{\color{#35bf28}+244.73\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 12.2992ms 2.0655ms 484.1555 Ops/s 463.8255 Ops/s $\color{#35bf28}+4.38\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.6326ms 1.2967ms 771.1633 Ops/s 979.7860 Ops/s $\textbf{\color{#d91a1a}-21.29\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 34.6300ms 32.5880ms 30.6862 Ops/s 30.3847 Ops/s $\color{#35bf28}+0.99\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.2416ms 17.6526ms 56.6490 Ops/s 55.7889 Ops/s $\color{#35bf28}+1.54\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 36.3557ms 33.4748ms 29.8732 Ops/s 29.0968 Ops/s $\color{#35bf28}+2.67\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.3306ms 17.7528ms 56.3291 Ops/s 55.2706 Ops/s $\color{#35bf28}+1.92\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 37.6056ms 34.9685ms 28.5972 Ops/s 28.3578 Ops/s $\color{#35bf28}+0.84\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.7600ms 19.2277ms 52.0084 Ops/s 51.8797 Ops/s $\color{#35bf28}+0.25\%$

[ghstack-poisoned]
[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant