-
Notifications
You must be signed in to change notification settings - Fork 413
[BugFix] Fix GRPO tests and runs #3213
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
vmoens
wants to merge
4
commits into
gh/vmoens/167/base
Choose a base branch
from
gh/vmoens/167/head
base: gh/vmoens/167/base
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3213
Note: Links to docs will display an error until the docs builds have been completed. ❗ 1 Active SEVsThere are 1 currently active SEVs. If your PR is affected, please view them below: ❌ 6 New Failures, 10 Unrelated FailuresAs of commit a2c2973 with merge base a7707ca ( NEW FAILURES - The following jobs have failed:
FLAKY - The following jobs failed but were likely due to flakiness present on trunk:
BROKEN TRUNK - The following jobs failed but were present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This was referenced Oct 20, 2025
|
Name | Max | Mean | Ops | Ops on Repo HEAD
|
Change |
---|---|---|---|---|---|
test_tensor_to_bytestream_speed[pickle] | 83.7819μs | 82.3663μs | 12.1409 KOps/s | 12.1855 KOps/s | |
test_tensor_to_bytestream_speed[torch.save] | 0.1389ms | 0.1379ms | 7.2527 KOps/s | 7.1921 KOps/s | |
test_tensor_to_bytestream_speed[untyped_storage] | 0.1209s | 0.1200s | 8.3347 Ops/s | 8.3608 Ops/s | |
test_tensor_to_bytestream_speed[numpy] | 2.9435μs | 2.9395μs | 340.1882 KOps/s | 354.0686 KOps/s | |
test_tensor_to_bytestream_speed[safetensors] | 42.4952μs | 42.1821μs | 23.7068 KOps/s | 23.5520 KOps/s | |
test_simple | 0.5473s | 0.5463s | 1.8306 Ops/s | 1.7477 Ops/s | |
test_transformed | 1.2208s | 1.1289s | 0.8858 Ops/s | 0.8804 Ops/s | |
test_serial | 1.6721s | 1.6682s | 0.5995 Ops/s | 0.5952 Ops/s | |
test_parallel | 1.1914s | 1.1222s | 0.8911 Ops/s | 0.9187 Ops/s | |
test_step_mdp_speed[True-True-True-True-True] | 0.2533ms | 46.2990μs | 21.5987 KOps/s | 22.3136 KOps/s | |
test_step_mdp_speed[True-True-True-True-False] | 52.4410μs | 25.9325μs | 38.5617 KOps/s | 39.4419 KOps/s | |
test_step_mdp_speed[True-True-True-False-True] | 54.8910μs | 25.7841μs | 38.7836 KOps/s | 39.3116 KOps/s | |
test_step_mdp_speed[True-True-True-False-False] | 45.8810μs | 14.2134μs | 70.3559 KOps/s | 71.6458 KOps/s | |
test_step_mdp_speed[True-True-False-True-True] | 79.9020μs | 48.6641μs | 20.5490 KOps/s | 20.7832 KOps/s | |
test_step_mdp_speed[True-True-False-True-False] | 58.9310μs | 28.5322μs | 35.0481 KOps/s | 35.4503 KOps/s | |
test_step_mdp_speed[True-True-False-False-True] | 57.8810μs | 28.4436μs | 35.1573 KOps/s | 35.2912 KOps/s | |
test_step_mdp_speed[True-True-False-False-False] | 51.9100μs | 17.0964μs | 58.4917 KOps/s | 59.2319 KOps/s | |
test_step_mdp_speed[True-False-True-True-True] | 0.1229ms | 51.0732μs | 19.5797 KOps/s | 19.6930 KOps/s | |
test_step_mdp_speed[True-False-True-True-False] | 70.8310μs | 31.2147μs | 32.0362 KOps/s | 32.1536 KOps/s | |
test_step_mdp_speed[True-False-True-False-True] | 62.9410μs | 28.6306μs | 34.9276 KOps/s | 35.8004 KOps/s | |
test_step_mdp_speed[True-False-True-False-False] | 45.7900μs | 17.1112μs | 58.4413 KOps/s | 59.6673 KOps/s | |
test_step_mdp_speed[True-False-False-True-True] | 85.9720μs | 54.6837μs | 18.2870 KOps/s | 18.6905 KOps/s | |
test_step_mdp_speed[True-False-False-True-False] | 0.1039ms | 33.9248μs | 29.4769 KOps/s | 29.8895 KOps/s | |
test_step_mdp_speed[True-False-False-False-True] | 67.7310μs | 31.4980μs | 31.7480 KOps/s | 32.8618 KOps/s | |
test_step_mdp_speed[True-False-False-False-False] | 52.8410μs | 19.4689μs | 51.3639 KOps/s | 51.6087 KOps/s | |
test_step_mdp_speed[False-True-True-True-True] | 83.3110μs | 51.5800μs | 19.3874 KOps/s | 19.6786 KOps/s | |
test_step_mdp_speed[False-True-True-True-False] | 65.7910μs | 30.7712μs | 32.4979 KOps/s | 32.1524 KOps/s | |
test_step_mdp_speed[False-True-True-False-True] | 2.4820ms | 32.5745μs | 30.6989 KOps/s | 30.9124 KOps/s | |
test_step_mdp_speed[False-True-True-False-False] | 50.8200μs | 18.5592μs | 53.8815 KOps/s | 54.5796 KOps/s | |
test_step_mdp_speed[False-True-False-True-True] | 90.1420μs | 53.3379μs | 18.7484 KOps/s | 18.8043 KOps/s | |
test_step_mdp_speed[False-True-False-True-False] | 74.5420μs | 33.9815μs | 29.4278 KOps/s | 29.7913 KOps/s | |
test_step_mdp_speed[False-True-False-False-True] | 71.6810μs | 34.2580μs | 29.1902 KOps/s | 28.9523 KOps/s | |
test_step_mdp_speed[False-True-False-False-False] | 62.5110μs | 21.2931μs | 46.9636 KOps/s | 46.9710 KOps/s | |
test_step_mdp_speed[False-False-True-True-True] | 96.3010μs | 56.1533μs | 17.8084 KOps/s | 17.6131 KOps/s | |
test_step_mdp_speed[False-False-True-True-False] | 74.1010μs | 36.4823μs | 27.4106 KOps/s | 27.6347 KOps/s | |
test_step_mdp_speed[False-False-True-False-True] | 66.2410μs | 34.9224μs | 28.6349 KOps/s | 28.8556 KOps/s | |
test_step_mdp_speed[False-False-True-False-False] | 94.1620μs | 21.3555μs | 46.8264 KOps/s | 47.1909 KOps/s | |
test_step_mdp_speed[False-False-False-True-True] | 0.1179ms | 58.3855μs | 17.1275 KOps/s | 17.2856 KOps/s | |
test_step_mdp_speed[False-False-False-True-False] | 71.0110μs | 38.8082μs | 25.7677 KOps/s | 25.9075 KOps/s | |
test_step_mdp_speed[False-False-False-False-True] | 65.9010μs | 36.4198μs | 27.4576 KOps/s | 27.3171 KOps/s | |
test_step_mdp_speed[False-False-False-False-False] | 58.0410μs | 23.5414μs | 42.4784 KOps/s | 42.9621 KOps/s | |
test_values[generalized_advantage_estimate-True-True] | 10.3717ms | 9.5861ms | 104.3178 Ops/s | 102.6082 Ops/s | |
test_values[vec_generalized_advantage_estimate-True-True] | 13.4654ms | 11.0212ms | 90.7340 Ops/s | 57.0194 Ops/s | |
test_values[td0_return_estimate-False-False] | 0.2288ms | 0.1313ms | 7.6167 KOps/s | 7.7308 KOps/s | |
test_values[td1_return_estimate-False-False] | 27.0750ms | 26.6402ms | 37.5372 Ops/s | 37.9899 Ops/s | |
test_values[vec_td1_return_estimate-False-False] | 11.5460ms | 11.1530ms | 89.6622 Ops/s | 56.8749 Ops/s | |
test_values[td_lambda_return_estimate-True-False] | 40.1745ms | 39.5529ms | 25.2826 Ops/s | 25.4506 Ops/s | |
test_values[vec_td_lambda_return_estimate-True-False] | 11.4175ms | 11.1477ms | 89.7047 Ops/s | 56.9961 Ops/s | |
test_gae_speed[generalized_advantage_estimate-False-1-512] | 8.3672ms | 8.1963ms | 122.0056 Ops/s | 121.5140 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 1.9498ms | 1.5079ms | 663.1940 Ops/s | 661.8364 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.4713ms | 0.4067ms | 2.4586 KOps/s | 2.4686 KOps/s | |
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 23.5418ms | 23.0017ms | 43.4750 Ops/s | 30.0861 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 2.1049ms | 1.7081ms | 585.4425 Ops/s | 588.2862 Ops/s | |
test_dqn_speed[False-None] | 1.5059ms | 1.4102ms | 709.0969 Ops/s | 700.2723 Ops/s | |
test_dqn_speed[False-backward] | 1.9885ms | 1.9289ms | 518.4433 Ops/s | 517.3751 Ops/s | |
test_dqn_speed[True-None] | 0.9236ms | 0.5254ms | 1.9033 KOps/s | 1.7983 KOps/s | |
test_dqn_speed[True-backward] | 1.0577ms | 0.9836ms | 1.0167 KOps/s | 837.7946 Ops/s | |
test_dqn_speed[reduce-overhead-None] | 0.8204ms | 0.5137ms | 1.9465 KOps/s | 1.8877 KOps/s | |
test_dqn_speed[reduce-overhead-backward] | 1.0013ms | 0.9625ms | 1.0389 KOps/s | 923.5029 Ops/s | |
test_ddpg_speed[False-None] | 3.3205ms | 2.8983ms | 345.0318 Ops/s | 346.5410 Ops/s | |
test_ddpg_speed[False-backward] | 4.2914ms | 4.1329ms | 241.9623 Ops/s | 243.3108 Ops/s | |
test_ddpg_speed[True-None] | 1.6947ms | 1.4149ms | 706.7798 Ops/s | 699.5493 Ops/s | |
test_ddpg_speed[True-backward] | 2.5542ms | 2.4171ms | 413.7248 Ops/s | 374.2651 Ops/s | |
test_ddpg_speed[reduce-overhead-None] | 1.5183ms | 1.4121ms | 708.1746 Ops/s | 704.7307 Ops/s | |
test_ddpg_speed[reduce-overhead-backward] | 2.4635ms | 2.4071ms | 415.4377 Ops/s | 418.7963 Ops/s | |
test_sac_speed[False-None] | 8.3945ms | 7.8996ms | 126.5891 Ops/s | 127.0872 Ops/s | |
test_sac_speed[False-backward] | 11.6791ms | 11.2217ms | 89.1132 Ops/s | 89.5740 Ops/s | |
test_sac_speed[True-None] | 2.5571ms | 2.1539ms | 464.2749 Ops/s | 458.7864 Ops/s | |
test_sac_speed[True-backward] | 4.4597ms | 4.0846ms | 244.8210 Ops/s | 216.4135 Ops/s | |
test_sac_speed[reduce-overhead-None] | 2.4240ms | 2.1353ms | 468.3127 Ops/s | 454.4225 Ops/s | |
test_sac_speed[reduce-overhead-backward] | 4.2557ms | 4.1569ms | 240.5634 Ops/s | 242.3120 Ops/s | |
test_redq_speed[False-None] | 11.1122ms | 10.4086ms | 96.0746 Ops/s | 93.5050 Ops/s | |
test_redq_speed[False-backward] | 18.9598ms | 17.9957ms | 55.5687 Ops/s | 51.6457 Ops/s | |
test_redq_speed[True-None] | 4.7048ms | 4.5435ms | 220.0939 Ops/s | 225.2318 Ops/s | |
test_redq_speed[True-backward] | 10.3565ms | 10.0651ms | 99.3531 Ops/s | 101.8173 Ops/s | |
test_redq_speed[reduce-overhead-None] | 5.0599ms | 4.4486ms | 224.7890 Ops/s | 230.2226 Ops/s | |
test_redq_speed[reduce-overhead-backward] | 10.8079ms | 10.3241ms | 96.8605 Ops/s | 91.5712 Ops/s | |
test_redq_deprec_speed[False-None] | 11.7776ms | 11.0879ms | 90.1886 Ops/s | 88.4472 Ops/s | |
test_redq_deprec_speed[False-backward] | 16.7070ms | 16.1104ms | 62.0717 Ops/s | 61.3817 Ops/s | |
test_redq_deprec_speed[True-None] | 4.0800ms | 3.7069ms | 269.7664 Ops/s | 257.6140 Ops/s | |
test_redq_deprec_speed[True-backward] | 8.0711ms | 7.7682ms | 128.7307 Ops/s | 120.6560 Ops/s | |
test_redq_deprec_speed[reduce-overhead-None] | 4.0640ms | 3.6397ms | 274.7447 Ops/s | 267.3946 Ops/s | |
test_redq_deprec_speed[reduce-overhead-backward] | 8.2201ms | 7.7913ms | 128.3481 Ops/s | 125.5083 Ops/s | |
test_td3_speed[False-None] | 8.1169ms | 7.9613ms | 125.6075 Ops/s | 126.1545 Ops/s | |
test_td3_speed[False-backward] | 11.6584ms | 10.9155ms | 91.6125 Ops/s | 91.9945 Ops/s | |
test_td3_speed[True-None] | 1.9572ms | 1.8648ms | 536.2459 Ops/s | 526.7031 Ops/s | |
test_td3_speed[True-backward] | 3.8690ms | 3.7031ms | 270.0457 Ops/s | 221.1490 Ops/s | |
test_td3_speed[reduce-overhead-None] | 1.8451ms | 1.8203ms | 549.3654 Ops/s | 542.1679 Ops/s | |
test_td3_speed[reduce-overhead-backward] | 3.8021ms | 3.6958ms | 270.5800 Ops/s | 243.0503 Ops/s | |
test_cql_speed[False-None] | 30.3799ms | 26.4830ms | 37.7601 Ops/s | 38.7755 Ops/s | |
test_cql_speed[False-backward] | 39.6626ms | 36.1824ms | 27.6377 Ops/s | 28.2652 Ops/s | |
test_cql_speed[True-None] | 13.0644ms | 12.7087ms | 78.6865 Ops/s | 80.6360 Ops/s | |
test_cql_speed[True-backward] | 19.8387ms | 18.8300ms | 53.1066 Ops/s | 55.2126 Ops/s | |
test_cql_speed[reduce-overhead-None] | 13.1932ms | 12.8314ms | 77.9340 Ops/s | 79.8640 Ops/s | |
test_cql_speed[reduce-overhead-backward] | 19.2268ms | 19.0295ms | 52.5500 Ops/s | 51.9509 Ops/s | |
test_a2c_speed[False-None] | 5.7214ms | 5.3814ms | 185.8263 Ops/s | 179.3144 Ops/s | |
test_a2c_speed[False-backward] | 12.2464ms | 12.0246ms | 83.1630 Ops/s | 82.4271 Ops/s | |
test_a2c_speed[True-None] | 4.0478ms | 3.7551ms | 266.3028 Ops/s | 260.3469 Ops/s | |
test_a2c_speed[True-backward] | 9.1420ms | 8.8340ms | 113.1993 Ops/s | 112.6369 Ops/s | |
test_a2c_speed[reduce-overhead-None] | 3.9748ms | 3.7581ms | 266.0890 Ops/s | 266.7614 Ops/s | |
test_a2c_speed[reduce-overhead-backward] | 9.1811ms | 9.0207ms | 110.8556 Ops/s | 107.1160 Ops/s | |
test_ppo_speed[False-None] | 6.1765ms | 5.9898ms | 166.9512 Ops/s | 171.0524 Ops/s | |
test_ppo_speed[False-backward] | 13.1737ms | 12.8778ms | 77.6528 Ops/s | 78.7087 Ops/s | |
test_ppo_speed[True-None] | 4.6781ms | 3.7503ms | 266.6467 Ops/s | 269.5750 Ops/s | |
test_ppo_speed[True-backward] | 8.7814ms | 8.5964ms | 116.3283 Ops/s | 113.7416 Ops/s | |
test_ppo_speed[reduce-overhead-None] | 3.8761ms | 3.7330ms | 267.8808 Ops/s | 265.9609 Ops/s | |
test_ppo_speed[reduce-overhead-backward] | 8.9853ms | 8.8361ms | 113.1717 Ops/s | 111.8950 Ops/s | |
test_reinforce_speed[False-None] | 4.9184ms | 4.6719ms | 214.0468 Ops/s | 212.1550 Ops/s | |
test_reinforce_speed[False-backward] | 7.8063ms | 7.5749ms | 132.0154 Ops/s | 132.4550 Ops/s | |
test_reinforce_speed[True-None] | 3.1721ms | 2.9456ms | 339.4948 Ops/s | 333.9149 Ops/s | |
test_reinforce_speed[True-backward] | 8.2249ms | 7.8894ms | 126.7526 Ops/s | 124.7857 Ops/s | |
test_reinforce_speed[reduce-overhead-None] | 3.0835ms | 2.8967ms | 345.2240 Ops/s | 347.0025 Ops/s | |
test_reinforce_speed[reduce-overhead-backward] | 8.3030ms | 8.0518ms | 124.1961 Ops/s | 115.9822 Ops/s | |
test_iql_speed[False-None] | 27.1475ms | 20.8840ms | 47.8835 Ops/s | 49.7896 Ops/s | |
test_iql_speed[False-backward] | 37.1301ms | 31.4921ms | 31.7540 Ops/s | 32.2427 Ops/s | |
test_iql_speed[True-None] | 9.0280ms | 8.6979ms | 114.9699 Ops/s | 114.5907 Ops/s | |
test_iql_speed[True-backward] | 17.4333ms | 17.0526ms | 58.6421 Ops/s | 57.8772 Ops/s | |
test_iql_speed[reduce-overhead-None] | 9.1890ms | 8.7910ms | 113.7532 Ops/s | 113.1268 Ops/s | |
test_iql_speed[reduce-overhead-backward] | 18.0073ms | 17.6061ms | 56.7983 Ops/s | 56.4499 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 7.4160ms | 6.0369ms | 165.6486 Ops/s | 166.8080 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.6286ms | 0.3884ms | 2.5744 KOps/s | 3.0413 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6937ms | 0.3509ms | 2.8498 KOps/s | 2.8413 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 6.0846ms | 5.7681ms | 173.3688 Ops/s | 174.7732 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.6620ms | 0.3890ms | 2.5708 KOps/s | 2.9910 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.5966ms | 0.3670ms | 2.7250 KOps/s | 3.6467 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 1.7542ms | 1.4292ms | 699.6963 Ops/s | 782.6656 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.6563ms | 1.2987ms | 770.0046 Ops/s | 839.1736 Ops/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 9.2952ms | 6.0208ms | 166.0919 Ops/s | 169.0130 Ops/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.3414ms | 0.4975ms | 2.0102 KOps/s | 2.2295 KOps/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.7992ms | 0.4278ms | 2.3375 KOps/s | 2.3000 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 5.8919ms | 5.8053ms | 172.2553 Ops/s | 173.0079 Ops/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 2.1227ms | 0.3498ms | 2.8586 KOps/s | 3.3701 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.5678ms | 0.3249ms | 3.0777 KOps/s | 3.1530 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 6.0162ms | 5.7575ms | 173.6866 Ops/s | 173.9062 Ops/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.9516ms | 0.4135ms | 2.4185 KOps/s | 3.2625 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6568ms | 0.3488ms | 2.8672 KOps/s | 3.1515 KOps/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 6.1229ms | 5.9634ms | 167.6896 Ops/s | 168.1627 Ops/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.0933ms | 0.4803ms | 2.0820 KOps/s | 2.0012 KOps/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.6601ms | 0.4419ms | 2.2631 KOps/s | 2.1463 KOps/s | |
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 6.6998ms | 5.0984ms | 196.1409 Ops/s | 196.4543 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 8.1248ms | 2.3128ms | 432.3799 Ops/s | 485.6414 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 7.9378ms | 1.2019ms | 831.9964 Ops/s | 836.3553 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 6.9757ms | 5.1462ms | 194.3172 Ops/s | 192.5630 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 0.5267s | 12.6353ms | 79.1432 Ops/s | 494.5715 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 7.0411ms | 1.1390ms | 878.0006 Ops/s | 833.8828 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 6.8047ms | 5.2432ms | 190.7249 Ops/s | 55.3267 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 12.2992ms | 2.0655ms | 484.1555 Ops/s | 463.8255 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 6.6326ms | 1.2967ms | 771.1633 Ops/s | 979.7860 Ops/s | |
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] | 34.6300ms | 32.5880ms | 30.6862 Ops/s | 30.3847 Ops/s | |
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] | 19.2416ms | 17.6526ms | 56.6490 Ops/s | 55.7889 Ops/s | |
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] | 36.3557ms | 33.4748ms | 29.8732 Ops/s | 29.0968 Ops/s | |
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] | 19.3306ms | 17.7528ms | 56.3291 Ops/s | 55.2706 Ops/s | |
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] | 37.6056ms | 34.9685ms | 28.5972 Ops/s | 28.3578 Ops/s | |
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] | 20.7600ms | 19.2277ms | 52.0084 Ops/s | 51.8797 Ops/s |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Stack from ghstack (oldest at bottom):