Skip to content

[Doc] Per-release doc #2108

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 32 commits into from
Apr 25, 2024
Merged

[Doc] Per-release doc #2108

merged 32 commits into from
Apr 25, 2024

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Apr 24, 2024

No description provided.

@pytorch-bot
Copy link

pytorch-bot bot commented Apr 24, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2108

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 15 Unrelated Failures

As of commit fae6da8 with merge base 45c91cc (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 24, 2024
@vmoens vmoens added documentation Improvements or additions to documentation ciflow/docs tests full docs CI labels Apr 24, 2024
@pytorch-bot
Copy link

pytorch-bot bot commented Apr 24, 2024

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki

@github-actions
Copy link

github-actions bot commented Apr 24, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 56.7362ms 54.8200ms 18.2415 Ops/s 18.7665 Ops/s $\color{#d91a1a}-2.80\%$
test_sync 39.0692ms 30.0422ms 33.2865 Ops/s 33.9681 Ops/s $\color{#d91a1a}-2.01\%$
test_async 54.4581ms 26.4730ms 37.7743 Ops/s 36.7790 Ops/s $\color{#35bf28}+2.71\%$
test_simple 0.3395s 0.3378s 2.9601 Ops/s 2.9622 Ops/s $\color{#d91a1a}-0.07\%$
test_transformed 0.5573s 0.5089s 1.9648 Ops/s 2.0152 Ops/s $\color{#d91a1a}-2.50\%$
test_serial 1.2768s 1.2246s 0.8166 Ops/s 0.8197 Ops/s $\color{#d91a1a}-0.38\%$
test_parallel 1.0547s 1.0005s 0.9995 Ops/s 0.9836 Ops/s $\color{#35bf28}+1.61\%$
test_step_mdp_speed[True-True-True-True-True] 0.1554ms 22.5923μs 44.2629 KOps/s 46.3515 KOps/s $\color{#d91a1a}-4.51\%$
test_step_mdp_speed[True-True-True-True-False] 37.7100μs 13.6354μs 73.3384 KOps/s 76.9909 KOps/s $\color{#d91a1a}-4.74\%$
test_step_mdp_speed[True-True-True-False-True] 43.2010μs 13.0212μs 76.7979 KOps/s 79.8208 KOps/s $\color{#d91a1a}-3.79\%$
test_step_mdp_speed[True-True-True-False-False] 37.4400μs 7.9416μs 125.9191 KOps/s 132.9588 KOps/s $\textbf{\color{#d91a1a}-5.29\%}$
test_step_mdp_speed[True-True-False-True-True] 72.7260μs 24.0226μs 41.6275 KOps/s 44.0193 KOps/s $\textbf{\color{#d91a1a}-5.43\%}$
test_step_mdp_speed[True-True-False-True-False] 51.6970μs 15.1203μs 66.1362 KOps/s 69.5779 KOps/s $\color{#d91a1a}-4.95\%$
test_step_mdp_speed[True-True-False-False-True] 63.5180μs 14.5265μs 68.8399 KOps/s 72.5627 KOps/s $\textbf{\color{#d91a1a}-5.13\%}$
test_step_mdp_speed[True-True-False-False-False] 45.7260μs 9.1923μs 108.7873 KOps/s 113.4468 KOps/s $\color{#d91a1a}-4.11\%$
test_step_mdp_speed[True-False-True-True-True] 80.4010μs 25.4211μs 39.3373 KOps/s 40.8047 KOps/s $\color{#d91a1a}-3.60\%$
test_step_mdp_speed[True-False-True-True-False] 65.0520μs 16.5966μs 60.2533 KOps/s 63.6168 KOps/s $\textbf{\color{#d91a1a}-5.29\%}$
test_step_mdp_speed[True-False-True-False-True] 47.7490μs 14.4356μs 69.2734 KOps/s 72.1132 KOps/s $\color{#d91a1a}-3.94\%$
test_step_mdp_speed[True-False-True-False-False] 63.8390μs 9.2815μs 107.7416 KOps/s 113.2428 KOps/s $\color{#d91a1a}-4.86\%$
test_step_mdp_speed[True-False-False-True-True] 51.8480μs 26.6364μs 37.5426 KOps/s 39.2232 KOps/s $\color{#d91a1a}-4.28\%$
test_step_mdp_speed[True-False-False-True-False] 63.7590μs 17.7098μs 56.4659 KOps/s 59.6345 KOps/s $\textbf{\color{#d91a1a}-5.31\%}$
test_step_mdp_speed[True-False-False-False-True] 46.1460μs 15.6703μs 63.8150 KOps/s 66.8021 KOps/s $\color{#d91a1a}-4.47\%$
test_step_mdp_speed[True-False-False-False-False] 56.3850μs 10.5335μs 94.9348 KOps/s 101.2772 KOps/s $\textbf{\color{#d91a1a}-6.26\%}$
test_step_mdp_speed[False-True-True-True-True] 75.8620μs 25.0780μs 39.8756 KOps/s 41.4215 KOps/s $\color{#d91a1a}-3.73\%$
test_step_mdp_speed[False-True-True-True-False] 64.5710μs 16.3991μs 60.9788 KOps/s 64.6462 KOps/s $\textbf{\color{#d91a1a}-5.67\%}$
test_step_mdp_speed[False-True-True-False-True] 72.4250μs 16.5562μs 60.4003 KOps/s 62.3510 KOps/s $\color{#d91a1a}-3.13\%$
test_step_mdp_speed[False-True-True-False-False] 64.0390μs 10.3520μs 96.5999 KOps/s 98.8689 KOps/s $\color{#d91a1a}-2.29\%$
test_step_mdp_speed[False-True-False-True-True] 41.6180μs 26.8836μs 37.1974 KOps/s 38.6082 KOps/s $\color{#d91a1a}-3.65\%$
test_step_mdp_speed[False-True-False-True-False] 61.2050μs 17.7070μs 56.4749 KOps/s 59.7160 KOps/s $\textbf{\color{#d91a1a}-5.43\%}$
test_step_mdp_speed[False-True-False-False-True] 50.6350μs 18.0494μs 55.4035 KOps/s 57.6452 KOps/s $\color{#d91a1a}-3.89\%$
test_step_mdp_speed[False-True-False-False-False] 52.8790μs 11.8378μs 84.4754 KOps/s 88.9014 KOps/s $\color{#d91a1a}-4.98\%$
test_step_mdp_speed[False-False-True-True-True] 59.6610μs 28.0796μs 35.6130 KOps/s 37.0979 KOps/s $\color{#d91a1a}-4.00\%$
test_step_mdp_speed[False-False-True-True-False] 66.0340μs 19.2402μs 51.9746 KOps/s 55.1437 KOps/s $\textbf{\color{#d91a1a}-5.75\%}$
test_step_mdp_speed[False-False-True-False-True] 49.5430μs 18.0968μs 55.2584 KOps/s 57.7358 KOps/s $\color{#d91a1a}-4.29\%$
test_step_mdp_speed[False-False-True-False-False] 29.4860μs 11.7919μs 84.8039 KOps/s 88.5639 KOps/s $\color{#d91a1a}-4.25\%$
test_step_mdp_speed[False-False-False-True-True] 72.7460μs 29.1945μs 34.2530 KOps/s 35.7389 KOps/s $\color{#d91a1a}-4.16\%$
test_step_mdp_speed[False-False-False-True-False] 52.1580μs 20.4412μs 48.9208 KOps/s 51.8514 KOps/s $\textbf{\color{#d91a1a}-5.65\%}$
test_step_mdp_speed[False-False-False-False-True] 59.6910μs 19.2572μs 51.9287 KOps/s 54.0603 KOps/s $\color{#d91a1a}-3.94\%$
test_step_mdp_speed[False-False-False-False-False] 37.9510μs 12.9076μs 77.4739 KOps/s 80.4940 KOps/s $\color{#d91a1a}-3.75\%$
test_values[generalized_advantage_estimate-True-True] 10.7471ms 9.5766ms 104.4213 Ops/s 106.3145 Ops/s $\color{#d91a1a}-1.78\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.5123ms 35.1713ms 28.4323 Ops/s 28.3862 Ops/s $\color{#35bf28}+0.16\%$
test_values[td0_return_estimate-False-False] 0.2534ms 0.1806ms 5.5376 KOps/s 5.7708 KOps/s $\color{#d91a1a}-4.04\%$
test_values[td1_return_estimate-False-False] 26.9703ms 23.9229ms 41.8009 Ops/s 42.7620 Ops/s $\color{#d91a1a}-2.25\%$
test_values[vec_td1_return_estimate-False-False] 37.2785ms 35.3962ms 28.2517 Ops/s 28.3147 Ops/s $\color{#d91a1a}-0.22\%$
test_values[td_lambda_return_estimate-True-False] 34.9932ms 34.5277ms 28.9623 Ops/s 29.6133 Ops/s $\color{#d91a1a}-2.20\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.5717ms 35.3400ms 28.2965 Ops/s 28.2951 Ops/s $+0.00\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.3202ms 8.3580ms 119.6453 Ops/s 121.6900 Ops/s $\color{#d91a1a}-1.68\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3990ms 1.9082ms 524.0529 Ops/s 538.5155 Ops/s $\color{#d91a1a}-2.69\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4750ms 0.3552ms 2.8150 KOps/s 2.8497 KOps/s $\color{#d91a1a}-1.22\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 46.5152ms 45.2616ms 22.0938 Ops/s 21.7176 Ops/s $\color{#35bf28}+1.73\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.6187ms 3.0495ms 327.9199 Ops/s 328.9293 Ops/s $\color{#d91a1a}-0.31\%$
test_dqn_speed 7.3819ms 1.4404ms 694.2355 Ops/s 729.5173 Ops/s $\color{#d91a1a}-4.84\%$
test_ddpg_speed 3.2344ms 2.8815ms 347.0471 Ops/s 348.7472 Ops/s $\color{#d91a1a}-0.49\%$
test_sac_speed 9.6828ms 8.5715ms 116.6654 Ops/s 108.3785 Ops/s $\textbf{\color{#35bf28}+7.65\%}$
test_redq_speed 15.0610ms 13.3383ms 74.9718 Ops/s 74.7748 Ops/s $\color{#35bf28}+0.26\%$
test_redq_deprec_speed 15.2884ms 13.6717ms 73.1440 Ops/s 73.8777 Ops/s $\color{#d91a1a}-0.99\%$
test_td3_speed 8.6616ms 8.4550ms 118.2725 Ops/s 118.1866 Ops/s $\color{#35bf28}+0.07\%$
test_cql_speed 40.1420ms 37.5385ms 26.6393 Ops/s 26.9353 Ops/s $\color{#d91a1a}-1.10\%$
test_a2c_speed 8.1230ms 7.6221ms 131.1966 Ops/s 132.0964 Ops/s $\color{#d91a1a}-0.68\%$
test_ppo_speed 9.1451ms 7.7935ms 128.3120 Ops/s 127.2111 Ops/s $\color{#35bf28}+0.87\%$
test_reinforce_speed 7.3330ms 6.7172ms 148.8711 Ops/s 148.3546 Ops/s $\color{#35bf28}+0.35\%$
test_iql_speed 34.9165ms 33.4601ms 29.8864 Ops/s 30.3055 Ops/s $\color{#d91a1a}-1.38\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.2645ms 2.2212ms 450.2097 Ops/s 438.1355 Ops/s $\color{#35bf28}+2.76\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0985ms 0.5026ms 1.9895 KOps/s 2.0164 KOps/s $\color{#d91a1a}-1.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6488ms 0.4749ms 2.1057 KOps/s 2.1171 KOps/s $\color{#d91a1a}-0.54\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.5849ms 2.2854ms 437.5544 Ops/s 442.7273 Ops/s $\color{#d91a1a}-1.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8114ms 0.4880ms 2.0490 KOps/s 2.0432 KOps/s $\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.7186ms 0.4702ms 2.1266 KOps/s 2.1379 KOps/s $\color{#d91a1a}-0.53\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.3575ms 1.2422ms 805.0249 Ops/s 816.8407 Ops/s $\color{#d91a1a}-1.45\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 4.3741ms 1.1922ms 838.7790 Ops/s 852.7258 Ops/s $\color{#d91a1a}-1.64\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.5383ms 2.3421ms 426.9674 Ops/s 436.7680 Ops/s $\color{#d91a1a}-2.24\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1486ms 0.6182ms 1.6177 KOps/s 1.6366 KOps/s $\color{#d91a1a}-1.16\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9250ms 0.5932ms 1.6857 KOps/s 1.7006 KOps/s $\color{#d91a1a}-0.87\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.2929ms 2.1967ms 455.2341 Ops/s 457.8878 Ops/s $\color{#d91a1a}-0.58\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0675ms 0.4943ms 2.0229 KOps/s 2.0109 KOps/s $\color{#35bf28}+0.60\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7828ms 0.4758ms 2.1015 KOps/s 2.1105 KOps/s $\color{#d91a1a}-0.42\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6732ms 2.2955ms 435.6301 Ops/s 452.7844 Ops/s $\color{#d91a1a}-3.79\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6013ms 0.4882ms 2.0485 KOps/s 2.0356 KOps/s $\color{#35bf28}+0.63\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.6691ms 0.4708ms 2.1239 KOps/s 2.0678 KOps/s $\color{#35bf28}+2.71\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.5756ms 2.3968ms 417.2208 Ops/s 433.8632 Ops/s $\color{#d91a1a}-3.84\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0017ms 0.6222ms 1.6073 KOps/s 1.6401 KOps/s $\color{#d91a1a}-2.00\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7962ms 0.5921ms 1.6889 KOps/s 1.6782 KOps/s $\color{#35bf28}+0.64\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1136s 8.0179ms 124.7213 Ops/s 129.6072 Ops/s $\color{#d91a1a}-3.77\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.2657ms 12.0376ms 83.0731 Ops/s 82.3085 Ops/s $\color{#35bf28}+0.93\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.5852ms 1.0922ms 915.6031 Ops/s 905.4772 Ops/s $\color{#35bf28}+1.12\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1019s 5.6937ms 175.6342 Ops/s 175.9039 Ops/s $\color{#d91a1a}-0.15\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.5267ms 11.9818ms 83.4600 Ops/s 82.4648 Ops/s $\color{#35bf28}+1.21\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.5974ms 1.0624ms 941.2307 Ops/s 913.1950 Ops/s $\color{#35bf28}+3.07\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1092s 8.0945ms 123.5412 Ops/s 115.7607 Ops/s $\textbf{\color{#35bf28}+6.72\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 14.6539ms 12.3826ms 80.7587 Ops/s 79.6867 Ops/s $\color{#35bf28}+1.35\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 3.9250ms 1.4457ms 691.6943 Ops/s 692.0948 Ops/s $\color{#d91a1a}-0.06\%$

@github-actions
Copy link

github-actions bot commented Apr 24, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1040s 0.1033s 9.6837 Ops/s 9.8576 Ops/s $\color{#d91a1a}-1.76\%$
test_sync 90.7765ms 86.8065ms 11.5199 Ops/s 11.4288 Ops/s $\color{#35bf28}+0.80\%$
test_async 0.1697s 84.8265ms 11.7888 Ops/s 13.8282 Ops/s $\textbf{\color{#d91a1a}-14.75\%}$
test_single_pixels 0.1112s 0.1109s 9.0184 Ops/s 9.0904 Ops/s $\color{#d91a1a}-0.79\%$
test_sync_pixels 0.1265s 70.5266ms 14.1790 Ops/s 13.9515 Ops/s $\color{#35bf28}+1.63\%$
test_async_pixels 0.1240s 62.1356ms 16.0938 Ops/s 16.1277 Ops/s $\color{#d91a1a}-0.21\%$
test_simple 0.6622s 0.6613s 1.5122 Ops/s 1.4445 Ops/s $\color{#35bf28}+4.69\%$
test_transformed 0.8853s 0.8841s 1.1310 Ops/s 1.1031 Ops/s $\color{#35bf28}+2.53\%$
test_serial 2.1172s 2.0569s 0.4862 Ops/s 0.4834 Ops/s $\color{#35bf28}+0.58\%$
test_parallel 1.8195s 1.7693s 0.5652 Ops/s 0.5637 Ops/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-True-True-True-True] 73.9710μs 33.0838μs 30.2263 KOps/s 30.5442 KOps/s $\color{#d91a1a}-1.04\%$
test_step_mdp_speed[True-True-True-True-False] 39.8210μs 19.3695μs 51.6277 KOps/s 52.1047 KOps/s $\color{#d91a1a}-0.92\%$
test_step_mdp_speed[True-True-True-False-True] 44.1110μs 18.6278μs 53.6831 KOps/s 53.9255 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[True-True-True-False-False] 30.6600μs 10.9893μs 90.9973 KOps/s 91.6885 KOps/s $\color{#d91a1a}-0.75\%$
test_step_mdp_speed[True-True-False-True-True] 52.7210μs 34.5004μs 28.9852 KOps/s 28.8810 KOps/s $\color{#35bf28}+0.36\%$
test_step_mdp_speed[True-True-False-True-False] 39.0110μs 21.0396μs 47.5295 KOps/s 47.2719 KOps/s $\color{#35bf28}+0.54\%$
test_step_mdp_speed[True-True-False-False-True] 39.5010μs 20.4774μs 48.8344 KOps/s 50.2771 KOps/s $\color{#d91a1a}-2.87\%$
test_step_mdp_speed[True-True-False-False-False] 30.0510μs 12.7205μs 78.6134 KOps/s 78.1452 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[True-False-True-True-True] 64.2610μs 36.2480μs 27.5877 KOps/s 27.2723 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[True-False-True-True-False] 37.8200μs 23.0600μs 43.3651 KOps/s 43.3480 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[True-False-True-False-True] 39.7310μs 20.5009μs 48.7784 KOps/s 49.0090 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-False-True-False-False] 31.4110μs 12.8272μs 77.9595 KOps/s 78.5053 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-False-False-True-True] 54.6910μs 38.9530μs 25.6719 KOps/s 26.4870 KOps/s $\color{#d91a1a}-3.08\%$
test_step_mdp_speed[True-False-False-True-False] 49.0910μs 24.7365μs 40.4261 KOps/s 40.3584 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[True-False-False-False-True] 40.0310μs 22.3066μs 44.8298 KOps/s 45.5805 KOps/s $\color{#d91a1a}-1.65\%$
test_step_mdp_speed[True-False-False-False-False] 30.1610μs 14.7161μs 67.9529 KOps/s 69.1831 KOps/s $\color{#d91a1a}-1.78\%$
test_step_mdp_speed[False-True-True-True-True] 59.6510μs 36.0164μs 27.7651 KOps/s 27.9770 KOps/s $\color{#d91a1a}-0.76\%$
test_step_mdp_speed[False-True-True-True-False] 42.6010μs 22.8008μs 43.8581 KOps/s 44.0722 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[False-True-True-False-True] 42.6300μs 24.5085μs 40.8021 KOps/s 41.9222 KOps/s $\color{#d91a1a}-2.67\%$
test_step_mdp_speed[False-True-True-False-False] 35.6100μs 14.4412μs 69.2462 KOps/s 68.6597 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-True-False-True-True] 65.9510μs 38.6586μs 25.8675 KOps/s 26.1269 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-True-False-True-False] 0.1299ms 24.7899μs 40.3390 KOps/s 40.1235 KOps/s $\color{#35bf28}+0.54\%$
test_step_mdp_speed[False-True-False-False-True] 44.9700μs 26.4693μs 37.7796 KOps/s 38.9607 KOps/s $\color{#d91a1a}-3.03\%$
test_step_mdp_speed[False-True-False-False-False] 32.9100μs 16.2478μs 61.5467 KOps/s 62.3228 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[False-False-True-True-True] 57.7200μs 40.0216μs 24.9865 KOps/s 24.9206 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[False-False-True-True-False] 51.5110μs 26.9312μs 37.1317 KOps/s 37.1412 KOps/s $\color{#d91a1a}-0.03\%$
test_step_mdp_speed[False-False-True-False-True] 44.1010μs 26.6087μs 37.5817 KOps/s 38.3247 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[False-False-True-False-False] 30.5600μs 16.3927μs 61.0027 KOps/s 60.4285 KOps/s $\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-False-False-True-True] 60.9400μs 41.0032μs 24.3884 KOps/s 24.2328 KOps/s $\color{#35bf28}+0.64\%$
test_step_mdp_speed[False-False-False-True-False] 45.1310μs 28.2197μs 35.4362 KOps/s 35.3230 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[False-False-False-False-True] 51.1010μs 27.7193μs 36.0759 KOps/s 36.7569 KOps/s $\color{#d91a1a}-1.85\%$
test_step_mdp_speed[False-False-False-False-False] 43.4110μs 18.2281μs 54.8605 KOps/s 55.7887 KOps/s $\color{#d91a1a}-1.66\%$
test_values[generalized_advantage_estimate-True-True] 25.1787ms 24.1458ms 41.4150 Ops/s 40.0989 Ops/s $\color{#35bf28}+3.28\%$
test_values[vec_generalized_advantage_estimate-True-True] 80.3387ms 3.1648ms 315.9741 Ops/s 309.9023 Ops/s $\color{#35bf28}+1.96\%$
test_values[td0_return_estimate-False-False] 90.7610μs 62.9314μs 15.8903 KOps/s 15.5751 KOps/s $\color{#35bf28}+2.02\%$
test_values[td1_return_estimate-False-False] 53.8468ms 51.6291ms 19.3689 Ops/s 18.6021 Ops/s $\color{#35bf28}+4.12\%$
test_values[vec_td1_return_estimate-False-False] 2.0927ms 1.7507ms 571.1845 Ops/s 569.1376 Ops/s $\color{#35bf28}+0.36\%$
test_values[td_lambda_return_estimate-True-False] 85.8741ms 83.2850ms 12.0070 Ops/s 11.6983 Ops/s $\color{#35bf28}+2.64\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.1448ms 1.7491ms 571.7236 Ops/s 569.1961 Ops/s $\color{#35bf28}+0.44\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.1712ms 22.9196ms 43.6307 Ops/s 43.2277 Ops/s $\color{#35bf28}+0.93\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8551ms 0.6849ms 1.4600 KOps/s 1.4358 KOps/s $\color{#35bf28}+1.69\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7076ms 0.6408ms 1.5605 KOps/s 1.5444 KOps/s $\color{#35bf28}+1.04\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4995ms 1.4395ms 694.6620 Ops/s 687.5195 Ops/s $\color{#35bf28}+1.04\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9511ms 0.6638ms 1.5065 KOps/s 1.4922 KOps/s $\color{#35bf28}+0.96\%$
test_dqn_speed 76.9236ms 1.5646ms 639.1377 Ops/s 700.6227 Ops/s $\textbf{\color{#d91a1a}-8.78\%}$
test_ddpg_speed 3.2480ms 2.9265ms 341.7106 Ops/s 343.8074 Ops/s $\color{#d91a1a}-0.61\%$
test_sac_speed 8.6749ms 8.4241ms 118.7077 Ops/s 116.9329 Ops/s $\color{#35bf28}+1.52\%$
test_redq_speed 11.1536ms 10.1322ms 98.6948 Ops/s 97.0062 Ops/s $\color{#35bf28}+1.74\%$
test_redq_deprec_speed 12.2044ms 11.3388ms 88.1926 Ops/s 88.3538 Ops/s $\color{#d91a1a}-0.18\%$
test_td3_speed 17.3655ms 8.4788ms 117.9411 Ops/s 118.8182 Ops/s $\color{#d91a1a}-0.74\%$
test_cql_speed 27.3648ms 26.1890ms 38.1839 Ops/s 38.8774 Ops/s $\color{#d91a1a}-1.78\%$
test_a2c_speed 6.3027ms 5.6927ms 175.6637 Ops/s 180.2701 Ops/s $\color{#d91a1a}-2.56\%$
test_ppo_speed 7.0205ms 5.9893ms 166.9633 Ops/s 171.8707 Ops/s $\color{#d91a1a}-2.86\%$
test_reinforce_speed 4.9896ms 4.6524ms 214.9433 Ops/s 218.8174 Ops/s $\color{#d91a1a}-1.77\%$
test_iql_speed 20.5121ms 20.0006ms 49.9984 Ops/s 51.2357 Ops/s $\color{#d91a1a}-2.41\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9942ms 2.7579ms 362.5992 Ops/s 366.6743 Ops/s $\color{#d91a1a}-1.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1029ms 0.5411ms 1.8481 KOps/s 1.8532 KOps/s $\color{#d91a1a}-0.27\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7349ms 0.5171ms 1.9340 KOps/s 1.9474 KOps/s $\color{#d91a1a}-0.69\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9818ms 2.7527ms 363.2821 Ops/s 366.5134 Ops/s $\color{#d91a1a}-0.88\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2301ms 0.5310ms 1.8834 KOps/s 1.8903 KOps/s $\color{#d91a1a}-0.36\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7467ms 0.5078ms 1.9691 KOps/s 1.9727 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 3.8310ms 1.4410ms 693.9552 Ops/s 677.6908 Ops/s $\color{#35bf28}+2.40\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6473ms 1.3626ms 733.8847 Ops/s 703.9273 Ops/s $\color{#35bf28}+4.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0230ms 2.8997ms 344.8585 Ops/s 350.9276 Ops/s $\color{#d91a1a}-1.73\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9339ms 0.6672ms 1.4989 KOps/s 1.4674 KOps/s $\color{#35bf28}+2.14\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9000ms 0.6415ms 1.5589 KOps/s 1.5138 KOps/s $\color{#35bf28}+2.98\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0079ms 2.7505ms 363.5716 Ops/s 367.9151 Ops/s $\color{#d91a1a}-1.18\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7021ms 0.5388ms 1.8561 KOps/s 1.7744 KOps/s $\color{#35bf28}+4.61\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8047ms 0.5173ms 1.9333 KOps/s 1.8008 KOps/s $\textbf{\color{#35bf28}+7.36\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0355ms 2.7621ms 362.0379 Ops/s 365.8120 Ops/s $\color{#d91a1a}-1.03\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6632ms 0.5311ms 1.8830 KOps/s 1.8618 KOps/s $\color{#35bf28}+1.14\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.5639ms 0.5193ms 1.9256 KOps/s 1.9190 KOps/s $\color{#35bf28}+0.35\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1179ms 2.8963ms 345.2709 Ops/s 352.3301 Ops/s $\color{#d91a1a}-2.00\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7900ms 0.6666ms 1.5002 KOps/s 1.5095 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9263ms 0.6403ms 1.5619 KOps/s 1.5642 KOps/s $\color{#d91a1a}-0.15\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1298s 9.6890ms 103.2095 Ops/s 104.8046 Ops/s $\color{#d91a1a}-1.52\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.4571ms 14.6792ms 68.1235 Ops/s 69.3121 Ops/s $\color{#d91a1a}-1.71\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.1910ms 1.1127ms 898.7541 Ops/s 867.9597 Ops/s $\color{#35bf28}+3.55\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1180s 7.1398ms 140.0606 Ops/s 140.3343 Ops/s $\color{#d91a1a}-0.20\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.0388ms 14.3975ms 69.4566 Ops/s 69.1628 Ops/s $\color{#35bf28}+0.42\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.6061ms 1.2496ms 800.2298 Ops/s 871.2490 Ops/s $\textbf{\color{#d91a1a}-8.15\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1160s 7.4091ms 134.9694 Ops/s 134.3230 Ops/s $\color{#35bf28}+0.48\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.1053ms 14.6263ms 68.3700 Ops/s 58.9842 Ops/s $\textbf{\color{#35bf28}+15.91\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.6741ms 1.5153ms 659.9434 Ops/s 682.1997 Ops/s $\color{#d91a1a}-3.26\%$

@vmoens vmoens merged commit 62a3adb into main Apr 25, 2024
@vmoens vmoens deleted the release-doc branch April 25, 2024 12:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ciflow/docs tests full docs CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@vmoens @facebook-github-bot