Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Fix README example #2398

Merged
merged 1 commit into from
Aug 14, 2024
Merged

[Doc] Fix README example #2398

merged 1 commit into from
Aug 14, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Aug 14, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Aug 14, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2398

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 22 Unrelated Failures

As of commit 0576fed with merge base 012cf74 (image):

NEW FAILURE - The following job has failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 14, 2024
@vmoens vmoens added the documentation Improvements or additions to documentation label Aug 14, 2024
@vmoens vmoens merged commit e82a69f into main Aug 14, 2024
22 of 36 checks passed
@vmoens vmoens deleted the fix-readme-example branch August 14, 2024 02:40
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}40$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 64.1773ms 63.2019ms 15.8223 Ops/s 16.9262 Ops/s $\textbf{\color{#d91a1a}-6.52\%}$
test_sync 33.9446ms 32.6685ms 30.6105 Ops/s 30.4975 Ops/s $\color{#35bf28}+0.37\%$
test_async 75.6786ms 31.7162ms 31.5297 Ops/s 32.4610 Ops/s $\color{#d91a1a}-2.87\%$
test_simple 0.5055s 0.4349s 2.2991 Ops/s 2.3789 Ops/s $\color{#d91a1a}-3.35\%$
test_transformed 0.6560s 0.5972s 1.6746 Ops/s 1.7262 Ops/s $\color{#d91a1a}-2.99\%$
test_serial 1.3931s 1.3304s 0.7516 Ops/s 0.7944 Ops/s $\textbf{\color{#d91a1a}-5.38\%}$
test_parallel 1.2201s 1.1393s 0.8777 Ops/s 0.9000 Ops/s $\color{#d91a1a}-2.48\%$
test_step_mdp_speed[True-True-True-True-True] 0.1942ms 26.5784μs 37.6245 KOps/s 40.0537 KOps/s $\textbf{\color{#d91a1a}-6.06\%}$
test_step_mdp_speed[True-True-True-True-False] 59.0100μs 15.5263μs 64.4069 KOps/s 68.4467 KOps/s $\textbf{\color{#d91a1a}-5.90\%}$
test_step_mdp_speed[True-True-True-False-True] 57.1670μs 15.2867μs 65.4162 KOps/s 69.0039 KOps/s $\textbf{\color{#d91a1a}-5.20\%}$
test_step_mdp_speed[True-True-True-False-False] 61.1640μs 8.8610μs 112.8536 KOps/s 119.7715 KOps/s $\textbf{\color{#d91a1a}-5.78\%}$
test_step_mdp_speed[True-True-False-True-True] 65.9220μs 28.7121μs 34.8286 KOps/s 37.2350 KOps/s $\textbf{\color{#d91a1a}-6.46\%}$
test_step_mdp_speed[True-True-False-True-False] 62.4160μs 17.0557μs 58.6313 KOps/s 62.1324 KOps/s $\textbf{\color{#d91a1a}-5.63\%}$
test_step_mdp_speed[True-True-False-False-True] 45.1840μs 17.0466μs 58.6629 KOps/s 62.7125 KOps/s $\textbf{\color{#d91a1a}-6.46\%}$
test_step_mdp_speed[True-True-False-False-False] 63.7590μs 10.6082μs 94.2664 KOps/s 101.7544 KOps/s $\textbf{\color{#d91a1a}-7.36\%}$
test_step_mdp_speed[True-False-True-True-True] 0.1147ms 30.6108μs 32.6682 KOps/s 35.1707 KOps/s $\textbf{\color{#d91a1a}-7.12\%}$
test_step_mdp_speed[True-False-True-True-False] 67.2550μs 18.8536μs 53.0403 KOps/s 56.6717 KOps/s $\textbf{\color{#d91a1a}-6.41\%}$
test_step_mdp_speed[True-False-True-False-True] 67.6160μs 17.0546μs 58.6354 KOps/s 62.6851 KOps/s $\textbf{\color{#d91a1a}-6.46\%}$
test_step_mdp_speed[True-False-True-False-False] 36.4380μs 10.5514μs 94.7744 KOps/s 100.4416 KOps/s $\textbf{\color{#d91a1a}-5.64\%}$
test_step_mdp_speed[True-False-False-True-True] 80.0190μs 32.2287μs 31.0283 KOps/s 33.4500 KOps/s $\textbf{\color{#d91a1a}-7.24\%}$
test_step_mdp_speed[True-False-False-True-False] 65.9410μs 20.5026μs 48.7743 KOps/s 52.1912 KOps/s $\textbf{\color{#d91a1a}-6.55\%}$
test_step_mdp_speed[True-False-False-False-True] 51.9970μs 18.7397μs 53.3627 KOps/s 57.7276 KOps/s $\textbf{\color{#d91a1a}-7.56\%}$
test_step_mdp_speed[True-False-False-False-False] 39.8840μs 12.3600μs 80.9059 KOps/s 88.6373 KOps/s $\textbf{\color{#d91a1a}-8.72\%}$
test_step_mdp_speed[False-True-True-True-True] 91.0500μs 30.4316μs 32.8606 KOps/s 35.0162 KOps/s $\textbf{\color{#d91a1a}-6.16\%}$
test_step_mdp_speed[False-True-True-True-False] 89.5760μs 18.9653μs 52.7279 KOps/s 56.8813 KOps/s $\textbf{\color{#d91a1a}-7.30\%}$
test_step_mdp_speed[False-True-True-False-True] 74.0170μs 20.1230μs 49.6944 KOps/s 54.5068 KOps/s $\textbf{\color{#d91a1a}-8.83\%}$
test_step_mdp_speed[False-True-True-False-False] 80.2790μs 11.8790μs 84.1823 KOps/s 90.1642 KOps/s $\textbf{\color{#d91a1a}-6.63\%}$
test_step_mdp_speed[False-True-False-True-True] 70.8320μs 32.3902μs 30.8735 KOps/s 33.7523 KOps/s $\textbf{\color{#d91a1a}-8.53\%}$
test_step_mdp_speed[False-True-False-True-False] 44.9440μs 20.7049μs 48.2978 KOps/s 52.3436 KOps/s $\textbf{\color{#d91a1a}-7.73\%}$
test_step_mdp_speed[False-True-False-False-True] 52.1470μs 21.5530μs 46.3972 KOps/s 50.3521 KOps/s $\textbf{\color{#d91a1a}-7.85\%}$
test_step_mdp_speed[False-True-False-False-False] 62.0050μs 13.5250μs 73.9369 KOps/s 80.2719 KOps/s $\textbf{\color{#d91a1a}-7.89\%}$
test_step_mdp_speed[False-False-True-True-True] 3.1666ms 34.3364μs 29.1236 KOps/s 32.1842 KOps/s $\textbf{\color{#d91a1a}-9.51\%}$
test_step_mdp_speed[False-False-True-True-False] 50.9650μs 22.5140μs 44.4168 KOps/s 48.8177 KOps/s $\textbf{\color{#d91a1a}-9.01\%}$
test_step_mdp_speed[False-False-True-False-True] 73.3860μs 21.4516μs 46.6166 KOps/s 50.4026 KOps/s $\textbf{\color{#d91a1a}-7.51\%}$
test_step_mdp_speed[False-False-True-False-False] 39.6240μs 13.5317μs 73.9004 KOps/s 80.1793 KOps/s $\textbf{\color{#d91a1a}-7.83\%}$
test_step_mdp_speed[False-False-False-True-True] 0.1149ms 35.4792μs 28.1855 KOps/s 30.7505 KOps/s $\textbf{\color{#d91a1a}-8.34\%}$
test_step_mdp_speed[False-False-False-True-False] 73.3270μs 23.9393μs 41.7723 KOps/s 45.6247 KOps/s $\textbf{\color{#d91a1a}-8.44\%}$
test_step_mdp_speed[False-False-False-False-True] 50.8340μs 22.9468μs 43.5791 KOps/s 47.9909 KOps/s $\textbf{\color{#d91a1a}-9.19\%}$
test_step_mdp_speed[False-False-False-False-False] 61.5640μs 15.1386μs 66.0562 KOps/s 72.4845 KOps/s $\textbf{\color{#d91a1a}-8.87\%}$
test_values[generalized_advantage_estimate-True-True] 11.3122ms 9.7065ms 103.0234 Ops/s 107.0931 Ops/s $\color{#d91a1a}-3.80\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.0594ms 33.5650ms 29.7929 Ops/s 29.9204 Ops/s $\color{#d91a1a}-0.43\%$
test_values[td0_return_estimate-False-False] 0.3307ms 0.1777ms 5.6280 KOps/s 5.6436 KOps/s $\color{#d91a1a}-0.28\%$
test_values[td1_return_estimate-False-False] 24.4988ms 24.2387ms 41.2563 Ops/s 42.4150 Ops/s $\color{#d91a1a}-2.73\%$
test_values[vec_td1_return_estimate-False-False] 35.5186ms 33.6332ms 29.7325 Ops/s 29.6905 Ops/s $\color{#35bf28}+0.14\%$
test_values[td_lambda_return_estimate-True-False] 38.4840ms 34.7657ms 28.7639 Ops/s 29.6300 Ops/s $\color{#d91a1a}-2.92\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.3604ms 33.5937ms 29.7674 Ops/s 29.3354 Ops/s $\color{#35bf28}+1.47\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 15.3820ms 8.4888ms 117.8029 Ops/s 122.9659 Ops/s $\color{#d91a1a}-4.20\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.9459ms 1.7876ms 559.4165 Ops/s 498.2694 Ops/s $\textbf{\color{#35bf28}+12.27\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5102ms 0.3569ms 2.8018 KOps/s 2.8518 KOps/s $\color{#d91a1a}-1.76\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.8106ms 45.2841ms 22.0828 Ops/s 21.6091 Ops/s $\color{#35bf28}+2.19\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.1612ms 3.0367ms 329.3043 Ops/s 328.9068 Ops/s $\color{#35bf28}+0.12\%$
test_dqn_speed 5.8843ms 1.3318ms 750.8644 Ops/s 768.6857 Ops/s $\color{#d91a1a}-2.32\%$
test_ddpg_speed 3.1639ms 2.7747ms 360.3941 Ops/s 368.7180 Ops/s $\color{#d91a1a}-2.26\%$
test_sac_speed 9.3241ms 8.1284ms 123.0251 Ops/s 123.3836 Ops/s $\color{#d91a1a}-0.29\%$
test_redq_speed 13.2604ms 12.8407ms 77.8776 Ops/s 78.4941 Ops/s $\color{#d91a1a}-0.79\%$
test_redq_deprec_speed 15.3318ms 13.1130ms 76.2603 Ops/s 76.6577 Ops/s $\color{#d91a1a}-0.52\%$
test_td3_speed 8.2677ms 8.0296ms 124.5389 Ops/s 127.0511 Ops/s $\color{#d91a1a}-1.98\%$
test_cql_speed 38.5927ms 35.8804ms 27.8704 Ops/s 25.8014 Ops/s $\textbf{\color{#35bf28}+8.02\%}$
test_a2c_speed 8.7831ms 7.3455ms 136.1373 Ops/s 135.4323 Ops/s $\color{#35bf28}+0.52\%$
test_ppo_speed 8.7672ms 7.5640ms 132.2058 Ops/s 130.2841 Ops/s $\color{#35bf28}+1.48\%$
test_reinforce_speed 7.3849ms 6.4380ms 155.3266 Ops/s 152.9130 Ops/s $\color{#35bf28}+1.58\%$
test_iql_speed 33.6915ms 32.1354ms 31.1183 Ops/s 31.1540 Ops/s $\color{#d91a1a}-0.11\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.1700ms 5.1391ms 194.5880 Ops/s 201.8850 Ops/s $\color{#d91a1a}-3.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.6669ms 0.4887ms 2.0461 KOps/s 2.0626 KOps/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7214ms 0.4583ms 2.1820 KOps/s 2.1758 KOps/s $\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.8811ms 5.0994ms 196.1017 Ops/s 205.0081 Ops/s $\color{#d91a1a}-4.34\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2751ms 0.4760ms 2.1009 KOps/s 2.0937 KOps/s $\color{#35bf28}+0.34\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6279ms 0.4568ms 2.1890 KOps/s 2.1928 KOps/s $\color{#d91a1a}-0.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.2854ms 1.7109ms 584.4978 Ops/s 600.7764 Ops/s $\color{#d91a1a}-2.71\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.1179ms 1.6159ms 618.8637 Ops/s 632.3460 Ops/s $\color{#d91a1a}-2.13\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0333ms 5.1911ms 192.6372 Ops/s 190.4227 Ops/s $\color{#35bf28}+1.16\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9761ms 0.6236ms 1.6035 KOps/s 1.5897 KOps/s $\color{#35bf28}+0.87\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8842ms 0.5934ms 1.6851 KOps/s 1.6931 KOps/s $\color{#d91a1a}-0.47\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.2118ms 5.1374ms 194.6524 Ops/s 201.4050 Ops/s $\color{#d91a1a}-3.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.3122ms 0.4909ms 2.0370 KOps/s 2.0368 KOps/s $\color{#35bf28}+0.01\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6608ms 0.4608ms 2.1700 KOps/s 1.9817 KOps/s $\textbf{\color{#35bf28}+9.50\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.6487ms 5.0688ms 197.2841 Ops/s 203.9958 Ops/s $\color{#d91a1a}-3.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6893ms 0.4785ms 2.0897 KOps/s 2.0987 KOps/s $\color{#d91a1a}-0.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6281ms 0.4568ms 2.1892 KOps/s 2.1741 KOps/s $\color{#35bf28}+0.70\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.3925ms 5.1991ms 192.3415 Ops/s 196.4752 Ops/s $\color{#d91a1a}-2.10\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0150ms 0.6233ms 1.6043 KOps/s 1.6267 KOps/s $\color{#d91a1a}-1.38\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8463ms 0.5943ms 1.6828 KOps/s 1.6648 KOps/s $\color{#35bf28}+1.08\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1305s 8.7781ms 113.9202 Ops/s 166.4427 Ops/s $\textbf{\color{#d91a1a}-31.56\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.4560ms 13.9035ms 71.9245 Ops/s 77.9672 Ops/s $\textbf{\color{#d91a1a}-7.75\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.6621ms 1.3696ms 730.1155 Ops/s 804.5547 Ops/s $\textbf{\color{#d91a1a}-9.25\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1096s 6.2133ms 160.9455 Ops/s 120.6603 Ops/s $\textbf{\color{#35bf28}+33.39\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.4541ms 13.9342ms 71.7659 Ops/s 76.3972 Ops/s $\textbf{\color{#d91a1a}-6.06\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.8842ms 1.2871ms 776.9679 Ops/s 775.6883 Ops/s $\color{#35bf28}+0.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1074s 6.3212ms 158.1978 Ops/s 164.1798 Ops/s $\color{#d91a1a}-3.64\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1194s 16.1317ms 61.9899 Ops/s 76.7691 Ops/s $\textbf{\color{#d91a1a}-19.25\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.1344ms 1.6033ms 623.6954 Ops/s 748.5576 Ops/s $\textbf{\color{#d91a1a}-16.68\%}$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1075s 0.1071s 9.3362 Ops/s 9.3168 Ops/s $\color{#35bf28}+0.21\%$
test_sync 95.2770ms 91.5951ms 10.9176 Ops/s 10.8536 Ops/s $\color{#35bf28}+0.59\%$
test_async 0.2535s 89.6095ms 11.1595 Ops/s 11.5101 Ops/s $\color{#d91a1a}-3.05\%$
test_single_pixels 0.1176s 0.1174s 8.5195 Ops/s 8.5188 Ops/s $+0.01\%$
test_sync_pixels 76.8925ms 76.2087ms 13.1219 Ops/s 13.2265 Ops/s $\color{#d91a1a}-0.79\%$
test_async_pixels 0.1414s 70.8328ms 14.1178 Ops/s 14.2553 Ops/s $\color{#d91a1a}-0.96\%$
test_simple 0.8579s 0.7856s 1.2729 Ops/s 1.2698 Ops/s $\color{#35bf28}+0.25\%$
test_transformed 1.0871s 1.0193s 0.9811 Ops/s 1.0013 Ops/s $\color{#d91a1a}-2.02\%$
test_serial 2.2709s 2.2016s 0.4542 Ops/s 0.4630 Ops/s $\color{#d91a1a}-1.90\%$
test_parallel 1.9522s 1.8905s 0.5289 Ops/s 0.5294 Ops/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-True-True-True-True] 88.0120μs 37.6917μs 26.5311 KOps/s 26.4774 KOps/s $\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-True-True-True-False] 39.9700μs 21.3061μs 46.9350 KOps/s 47.3230 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-True-True-False-True] 42.1810μs 20.9535μs 47.7246 KOps/s 47.2045 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-True-True-False-False] 27.3800μs 12.1014μs 82.6352 KOps/s 83.0236 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-True-False-True-True] 63.7710μs 39.6483μs 25.2218 KOps/s 24.8597 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[True-True-False-True-False] 50.5600μs 23.5490μs 42.4646 KOps/s 42.4886 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-True-False-False-True] 51.7810μs 23.4758μs 42.5970 KOps/s 42.2379 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[True-True-False-False-False] 33.4610μs 14.5041μs 68.9462 KOps/s 68.9864 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-False-True-True-True] 66.3710μs 42.1471μs 23.7264 KOps/s 23.4967 KOps/s $\color{#35bf28}+0.98\%$
test_step_mdp_speed[True-False-True-True-False] 53.1900μs 26.2592μs 38.0819 KOps/s 38.4143 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[True-False-True-False-True] 72.8210μs 23.3668μs 42.7958 KOps/s 42.7764 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-False-True-False-False] 33.6410μs 14.4382μs 69.2608 KOps/s 69.5715 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[True-False-False-True-True] 71.4310μs 44.5902μs 22.4265 KOps/s 22.6654 KOps/s $\color{#d91a1a}-1.05\%$
test_step_mdp_speed[True-False-False-True-False] 46.2010μs 28.1562μs 35.5162 KOps/s 35.4190 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-False-False-False-True] 46.8710μs 25.3794μs 39.4021 KOps/s 38.8062 KOps/s $\color{#35bf28}+1.54\%$
test_step_mdp_speed[True-False-False-False-False] 39.0000μs 16.6772μs 59.9620 KOps/s 60.0624 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[False-True-True-True-True] 70.2410μs 41.9739μs 23.8243 KOps/s 23.5180 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[False-True-True-True-False] 47.4310μs 25.8539μs 38.6789 KOps/s 38.8111 KOps/s $\color{#d91a1a}-0.34\%$
test_step_mdp_speed[False-True-True-False-True] 45.9620μs 28.3300μs 35.2982 KOps/s 35.2955 KOps/s $+0.01\%$
test_step_mdp_speed[False-True-True-False-False] 38.6610μs 16.2830μs 61.4138 KOps/s 61.8032 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-True-False-True-True] 61.2500μs 44.2256μs 22.6113 KOps/s 22.5958 KOps/s $\color{#35bf28}+0.07\%$
test_step_mdp_speed[False-True-False-True-False] 53.4210μs 28.2490μs 35.3995 KOps/s 35.9516 KOps/s $\color{#d91a1a}-1.54\%$
test_step_mdp_speed[False-True-False-False-True] 53.4710μs 30.8653μs 32.3988 KOps/s 33.4874 KOps/s $\color{#d91a1a}-3.25\%$
test_step_mdp_speed[False-True-False-False-False] 33.2010μs 18.5942μs 53.7804 KOps/s 54.4114 KOps/s $\color{#d91a1a}-1.16\%$
test_step_mdp_speed[False-False-True-True-True] 4.4898ms 46.8484μs 21.3454 KOps/s 21.1925 KOps/s $\color{#35bf28}+0.72\%$
test_step_mdp_speed[False-False-True-True-False] 48.6100μs 30.7642μs 32.5053 KOps/s 32.6370 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[False-False-True-False-True] 56.3200μs 30.3353μs 32.9649 KOps/s 33.1021 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-False-True-False-False] 44.1400μs 18.5473μs 53.9161 KOps/s 54.0054 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[False-False-False-True-True] 82.8820μs 48.4060μs 20.6586 KOps/s 20.6720 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[False-False-False-True-False] 54.4510μs 32.8919μs 30.4026 KOps/s 30.4280 KOps/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[False-False-False-False-True] 47.5110μs 32.6349μs 30.6421 KOps/s 31.1910 KOps/s $\color{#d91a1a}-1.76\%$
test_step_mdp_speed[False-False-False-False-False] 47.4100μs 20.3619μs 49.1113 KOps/s 48.4999 KOps/s $\color{#35bf28}+1.26\%$
test_values[generalized_advantage_estimate-True-True] 25.3137ms 24.8218ms 40.2871 Ops/s 39.5992 Ops/s $\color{#35bf28}+1.74\%$
test_values[vec_generalized_advantage_estimate-True-True] 97.5350ms 2.8560ms 350.1461 Ops/s 347.3733 Ops/s $\color{#35bf28}+0.80\%$
test_values[td0_return_estimate-False-False] 96.5520μs 69.5587μs 14.3763 KOps/s 14.7794 KOps/s $\color{#d91a1a}-2.73\%$
test_values[td1_return_estimate-False-False] 57.0431ms 55.8104ms 17.9178 Ops/s 17.5615 Ops/s $\color{#35bf28}+2.03\%$
test_values[vec_td1_return_estimate-False-False] 1.4251ms 1.0934ms 914.6129 Ops/s 916.1643 Ops/s $\color{#d91a1a}-0.17\%$
test_values[td_lambda_return_estimate-True-False] 89.2534ms 88.6041ms 11.2862 Ops/s 11.1178 Ops/s $\color{#35bf28}+1.51\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4282ms 1.0971ms 911.4928 Ops/s 901.2426 Ops/s $\color{#35bf28}+1.14\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.6407ms 25.0024ms 39.9961 Ops/s 39.2135 Ops/s $\color{#35bf28}+2.00\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9901ms 0.7408ms 1.3498 KOps/s 1.3295 KOps/s $\color{#35bf28}+1.53\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7726ms 0.6777ms 1.4756 KOps/s 1.4262 KOps/s $\color{#35bf28}+3.46\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5964ms 1.4819ms 674.7951 Ops/s 677.5590 Ops/s $\color{#d91a1a}-0.41\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.8430ms 0.7063ms 1.4158 KOps/s 1.4007 KOps/s $\color{#35bf28}+1.08\%$
test_dqn_speed 94.1565ms 1.5205ms 657.6671 Ops/s 716.7772 Ops/s $\textbf{\color{#d91a1a}-8.25\%}$
test_ddpg_speed 3.1237ms 2.8125ms 355.5520 Ops/s 355.6643 Ops/s $\color{#d91a1a}-0.03\%$
test_sac_speed 8.9474ms 8.0999ms 123.4582 Ops/s 124.9258 Ops/s $\color{#d91a1a}-1.17\%$
test_redq_speed 10.5748ms 10.1736ms 98.2938 Ops/s 96.7398 Ops/s $\color{#35bf28}+1.61\%$
test_redq_deprec_speed 11.7802ms 11.1740ms 89.4935 Ops/s 89.0235 Ops/s $\color{#35bf28}+0.53\%$
test_td3_speed 8.4105ms 8.0020ms 124.9686 Ops/s 125.0659 Ops/s $\color{#d91a1a}-0.08\%$
test_cql_speed 26.3586ms 25.4366ms 39.3135 Ops/s 39.6128 Ops/s $\color{#d91a1a}-0.76\%$
test_a2c_speed 5.8929ms 5.5416ms 180.4520 Ops/s 177.4446 Ops/s $\color{#35bf28}+1.69\%$
test_ppo_speed 6.6076ms 5.9504ms 168.0550 Ops/s 166.8158 Ops/s $\color{#35bf28}+0.74\%$
test_reinforce_speed 4.6997ms 4.4875ms 222.8427 Ops/s 222.1174 Ops/s $\color{#35bf28}+0.33\%$
test_iql_speed 20.3717ms 19.5915ms 51.0426 Ops/s 51.0306 Ops/s $\color{#35bf28}+0.02\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.8186ms 6.6580ms 150.1942 Ops/s 149.4176 Ops/s $\color{#35bf28}+0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1119s 0.6015ms 1.6625 KOps/s 1.9294 KOps/s $\textbf{\color{#d91a1a}-13.83\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6587ms 0.4945ms 2.0222 KOps/s 2.0215 KOps/s $\color{#35bf28}+0.04\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.8154ms 6.5432ms 152.8314 Ops/s 151.8677 Ops/s $\color{#35bf28}+0.63\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7196ms 0.5106ms 1.9586 KOps/s 1.9583 KOps/s $\color{#35bf28}+0.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6567ms 0.4914ms 2.0351 KOps/s 2.0505 KOps/s $\color{#d91a1a}-0.75\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 3.0907ms 2.0989ms 476.4387 Ops/s 508.7050 Ops/s $\textbf{\color{#d91a1a}-6.34\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.0874ms 1.8823ms 531.2658 Ops/s 509.9831 Ops/s $\color{#35bf28}+4.17\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.9781ms 6.7474ms 148.2050 Ops/s 146.4317 Ops/s $\color{#35bf28}+1.21\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1344s 0.7976ms 1.2538 KOps/s 1.4864 KOps/s $\textbf{\color{#d91a1a}-15.65\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8283ms 0.6588ms 1.5179 KOps/s 1.5461 KOps/s $\color{#d91a1a}-1.82\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.7832ms 6.6708ms 149.9062 Ops/s 150.4207 Ops/s $\color{#d91a1a}-0.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.8872ms 0.5206ms 1.9210 KOps/s 1.9326 KOps/s $\color{#d91a1a}-0.60\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6830ms 0.4975ms 2.0101 KOps/s 2.0171 KOps/s $\color{#d91a1a}-0.35\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.7484ms 6.5230ms 153.3026 Ops/s 151.7238 Ops/s $\color{#35bf28}+1.04\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9592ms 0.5156ms 1.9394 KOps/s 1.9397 KOps/s $\color{#d91a1a}-0.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6235ms 0.4909ms 2.0369 KOps/s 2.0418 KOps/s $\color{#d91a1a}-0.24\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.9710ms 6.8260ms 146.4977 Ops/s 146.8258 Ops/s $\color{#d91a1a}-0.22\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.7988ms 0.6806ms 1.4693 KOps/s 1.5019 KOps/s $\color{#d91a1a}-2.18\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8511ms 0.6503ms 1.5378 KOps/s 1.5587 KOps/s $\color{#d91a1a}-1.34\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1492s 8.3202ms 120.1891 Ops/s 122.3122 Ops/s $\color{#d91a1a}-1.74\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 19.1201ms 16.4161ms 60.9159 Ops/s 52.5866 Ops/s $\textbf{\color{#35bf28}+15.84\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.5555ms 1.4409ms 694.0308 Ops/s 660.7182 Ops/s $\textbf{\color{#35bf28}+5.04\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1274s 10.3913ms 96.2343 Ops/s 128.2545 Ops/s $\textbf{\color{#d91a1a}-24.97\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 19.1207ms 16.4939ms 60.6283 Ops/s 60.2723 Ops/s $\color{#35bf28}+0.59\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.9309ms 1.5503ms 645.0531 Ops/s 665.1222 Ops/s $\color{#d91a1a}-3.02\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1287s 8.1481ms 122.7274 Ops/s 124.5814 Ops/s $\color{#d91a1a}-1.49\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 19.3727ms 16.5364ms 60.4725 Ops/s 60.0649 Ops/s $\color{#35bf28}+0.68\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.1458ms 1.6455ms 607.7118 Ops/s 681.9892 Ops/s $\textbf{\color{#d91a1a}-10.89\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot