Skip to content

[CI] Remove x86 OSX jobs #2112

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Apr 25, 2024
Merged

[CI] Remove x86 OSX jobs #2112

merged 1 commit into from
Apr 25, 2024

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Apr 25, 2024

No description provided.

@pytorch-bot
Copy link

pytorch-bot bot commented Apr 25, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2112

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 4 Unrelated Failures

As of commit 56fc2f2 with merge base 36e1309 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 25, 2024
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Apr 25, 2024
@vmoens vmoens merged commit 8e0357f into main Apr 25, 2024
@vmoens vmoens deleted the remove-osx-x86 branch April 25, 2024 10:37
@github-actions
Copy link

github-actions bot commented Apr 25, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 54.7422ms 53.7959ms 18.5888 Ops/s 19.1143 Ops/s $\color{#d91a1a}-2.75\%$
test_sync 35.4954ms 29.4356ms 33.9724 Ops/s 34.4511 Ops/s $\color{#d91a1a}-1.39\%$
test_async 65.5846ms 27.4076ms 36.4863 Ops/s 37.3460 Ops/s $\color{#d91a1a}-2.30\%$
test_simple 0.3958s 0.3500s 2.8573 Ops/s 3.0501 Ops/s $\textbf{\color{#d91a1a}-6.32\%}$
test_transformed 0.4828s 0.4808s 2.0798 Ops/s 2.0631 Ops/s $\color{#35bf28}+0.81\%$
test_serial 1.2448s 1.2022s 0.8318 Ops/s 0.8489 Ops/s $\color{#d91a1a}-2.02\%$
test_parallel 1.0591s 1.0174s 0.9829 Ops/s 0.9980 Ops/s $\color{#d91a1a}-1.51\%$
test_step_mdp_speed[True-True-True-True-True] 0.1133ms 21.6537μs 46.1815 KOps/s 45.6588 KOps/s $\color{#35bf28}+1.14\%$
test_step_mdp_speed[True-True-True-True-False] 41.5270μs 13.2495μs 75.4746 KOps/s 75.3709 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-True-True-False-True] 0.1513ms 12.9903μs 76.9805 KOps/s 77.8754 KOps/s $\color{#d91a1a}-1.15\%$
test_step_mdp_speed[True-True-True-False-False] 29.5950μs 7.7498μs 129.0360 KOps/s 128.1691 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-True-False-True-True] 57.6480μs 23.0060μs 43.4669 KOps/s 42.6509 KOps/s $\color{#35bf28}+1.91\%$
test_step_mdp_speed[True-True-False-True-False] 38.1210μs 14.6395μs 68.3083 KOps/s 68.7611 KOps/s $\color{#d91a1a}-0.66\%$
test_step_mdp_speed[True-True-False-False-True] 38.3920μs 13.9980μs 71.4389 KOps/s 70.1492 KOps/s $\color{#35bf28}+1.84\%$
test_step_mdp_speed[True-True-False-False-False] 27.7120μs 9.1901μs 108.8131 KOps/s 111.4269 KOps/s $\color{#d91a1a}-2.35\%$
test_step_mdp_speed[True-False-True-True-True] 0.2468ms 24.6149μs 40.6259 KOps/s 40.2014 KOps/s $\color{#35bf28}+1.06\%$
test_step_mdp_speed[True-False-True-True-False] 41.6580μs 16.0161μs 62.4370 KOps/s 62.5190 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-False-True-False-True] 37.9910μs 13.9306μs 71.7846 KOps/s 70.6656 KOps/s $\color{#35bf28}+1.58\%$
test_step_mdp_speed[True-False-True-False-False] 33.2420μs 9.0155μs 110.9196 KOps/s 109.3230 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[True-False-False-True-True] 75.1500μs 25.7012μs 38.9087 KOps/s 38.4649 KOps/s $\color{#35bf28}+1.15\%$
test_step_mdp_speed[True-False-False-True-False] 98.8240μs 17.1302μs 58.3764 KOps/s 57.8862 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[True-False-False-False-True] 45.6850μs 15.1026μs 66.2139 KOps/s 65.0264 KOps/s $\color{#35bf28}+1.83\%$
test_step_mdp_speed[True-False-False-False-False] 37.7100μs 10.2405μs 97.6513 KOps/s 97.8862 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-True-True-True-True] 89.9780μs 24.6548μs 40.5601 KOps/s 40.8458 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[False-True-True-True-False] 39.0430μs 16.0127μs 62.4506 KOps/s 63.2472 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[False-True-True-False-True] 35.8170μs 16.3189μs 61.2787 KOps/s 61.1491 KOps/s $\color{#35bf28}+0.21\%$
test_step_mdp_speed[False-True-True-False-False] 38.6620μs 10.1860μs 98.1744 KOps/s 99.3132 KOps/s $\color{#d91a1a}-1.15\%$
test_step_mdp_speed[False-True-False-True-True] 36.7790μs 26.0098μs 38.4471 KOps/s 38.1696 KOps/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[False-True-False-True-False] 47.2280μs 17.1739μs 58.2279 KOps/s 58.2380 KOps/s $\color{#d91a1a}-0.02\%$
test_step_mdp_speed[False-True-False-False-True] 49.9530μs 17.6543μs 56.6435 KOps/s 56.7478 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[False-True-False-False-False] 38.9030μs 11.4280μs 87.5040 KOps/s 86.5332 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-False-True-True-True] 57.7380μs 26.7844μs 37.3351 KOps/s 36.3834 KOps/s $\color{#35bf28}+2.62\%$
test_step_mdp_speed[False-False-True-True-False] 53.0790μs 18.5419μs 53.9318 KOps/s 54.1652 KOps/s $\color{#d91a1a}-0.43\%$
test_step_mdp_speed[False-False-True-False-True] 40.6460μs 17.5784μs 56.8879 KOps/s 56.6399 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-False-True-False-False] 29.0640μs 11.5240μs 86.7755 KOps/s 86.6391 KOps/s $\color{#35bf28}+0.16\%$
test_step_mdp_speed[False-False-False-True-True] 64.3500μs 28.1455μs 35.5297 KOps/s 35.3546 KOps/s $\color{#35bf28}+0.50\%$
test_step_mdp_speed[False-False-False-True-False] 43.2210μs 19.6785μs 50.8168 KOps/s 51.5798 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-False-False-False-True] 47.1580μs 18.5748μs 53.8364 KOps/s 53.3908 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[False-False-False-False-False] 37.7910μs 12.6551μs 79.0193 KOps/s 78.7052 KOps/s $\color{#35bf28}+0.40\%$
test_values[generalized_advantage_estimate-True-True] 9.7433ms 9.4541ms 105.7743 Ops/s 106.4775 Ops/s $\color{#d91a1a}-0.66\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.4813ms 35.0826ms 28.5042 Ops/s 28.3477 Ops/s $\color{#35bf28}+0.55\%$
test_values[td0_return_estimate-False-False] 0.2298ms 0.1621ms 6.1679 KOps/s 6.1364 KOps/s $\color{#35bf28}+0.51\%$
test_values[td1_return_estimate-False-False] 23.8320ms 23.4840ms 42.5822 Ops/s 43.3704 Ops/s $\color{#d91a1a}-1.82\%$
test_values[vec_td1_return_estimate-False-False] 52.1935ms 35.7008ms 28.0106 Ops/s 27.8800 Ops/s $\color{#35bf28}+0.47\%$
test_values[td_lambda_return_estimate-True-False] 36.6696ms 33.7898ms 29.5947 Ops/s 30.0087 Ops/s $\color{#d91a1a}-1.38\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.2419ms 35.1405ms 28.4572 Ops/s 28.3918 Ops/s $\color{#35bf28}+0.23\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.4847ms 8.3115ms 120.3159 Ops/s 121.0109 Ops/s $\color{#d91a1a}-0.57\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.0557ms 1.8063ms 553.6117 Ops/s 490.1568 Ops/s $\textbf{\color{#35bf28}+12.95\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4106ms 0.3491ms 2.8642 KOps/s 2.8895 KOps/s $\color{#d91a1a}-0.87\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 49.5163ms 47.6475ms 20.9875 Ops/s 21.1656 Ops/s $\color{#d91a1a}-0.84\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.5112ms 3.0106ms 332.1584 Ops/s 326.1230 Ops/s $\color{#35bf28}+1.85\%$
test_dqn_speed 6.6948ms 1.3584ms 736.1709 Ops/s 751.7839 Ops/s $\color{#d91a1a}-2.08\%$
test_ddpg_speed 3.2397ms 2.8683ms 348.6410 Ops/s 353.5304 Ops/s $\color{#d91a1a}-1.38\%$
test_sac_speed 10.1613ms 8.4720ms 118.0362 Ops/s 120.0847 Ops/s $\color{#d91a1a}-1.71\%$
test_redq_speed 89.3975ms 14.0677ms 71.0849 Ops/s 77.1503 Ops/s $\textbf{\color{#d91a1a}-7.86\%}$
test_redq_deprec_speed 14.2059ms 13.2734ms 75.3384 Ops/s 76.9907 Ops/s $\color{#d91a1a}-2.15\%$
test_td3_speed 9.0037ms 8.3783ms 119.3565 Ops/s 121.1324 Ops/s $\color{#d91a1a}-1.47\%$
test_cql_speed 38.5291ms 37.1120ms 26.9454 Ops/s 27.1604 Ops/s $\color{#d91a1a}-0.79\%$
test_a2c_speed 8.5681ms 7.4408ms 134.3933 Ops/s 135.3864 Ops/s $\color{#d91a1a}-0.73\%$
test_ppo_speed 8.9468ms 7.6554ms 130.6261 Ops/s 125.2393 Ops/s $\color{#35bf28}+4.30\%$
test_reinforce_speed 7.5986ms 6.6255ms 150.9329 Ops/s 142.0197 Ops/s $\textbf{\color{#35bf28}+6.28\%}$
test_iql_speed 34.3270ms 32.8372ms 30.4533 Ops/s 30.6217 Ops/s $\color{#d91a1a}-0.55\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.2513ms 1.9898ms 502.5738 Ops/s 493.9897 Ops/s $\color{#35bf28}+1.74\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9551ms 0.4878ms 2.0499 KOps/s 2.0537 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7206ms 0.4629ms 2.1601 KOps/s 2.1674 KOps/s $\color{#d91a1a}-0.34\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9983ms 1.9566ms 511.0823 Ops/s 510.6145 Ops/s $\color{#35bf28}+0.09\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0887ms 0.4776ms 2.0940 KOps/s 2.0869 KOps/s $\color{#35bf28}+0.34\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6893ms 0.4567ms 2.1897 KOps/s 2.1992 KOps/s $\color{#d91a1a}-0.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8581ms 1.2405ms 806.1272 Ops/s 823.7958 Ops/s $\color{#d91a1a}-2.14\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5747ms 1.1686ms 855.7474 Ops/s 862.7849 Ops/s $\color{#d91a1a}-0.82\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1085ms 2.1098ms 473.9709 Ops/s 475.2204 Ops/s $\color{#d91a1a}-0.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1102ms 0.6044ms 1.6545 KOps/s 1.6586 KOps/s $\color{#d91a1a}-0.25\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7251ms 0.5753ms 1.7382 KOps/s 1.7366 KOps/s $\color{#35bf28}+0.09\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0883ms 1.9943ms 501.4186 Ops/s 503.0758 Ops/s $\color{#d91a1a}-0.33\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0579ms 0.4893ms 2.0438 KOps/s 2.0476 KOps/s $\color{#d91a1a}-0.19\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6166ms 0.4618ms 2.1653 KOps/s 2.1715 KOps/s $\color{#d91a1a}-0.29\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1364ms 1.9927ms 501.8235 Ops/s 503.5785 Ops/s $\color{#d91a1a}-0.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6060ms 0.4779ms 2.0926 KOps/s 2.0788 KOps/s $\color{#35bf28}+0.67\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.6516ms 0.4658ms 2.1467 KOps/s 2.2010 KOps/s $\color{#d91a1a}-2.47\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.3461ms 2.1080ms 474.3726 Ops/s 484.1581 Ops/s $\color{#d91a1a}-2.02\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7043ms 0.6024ms 1.6600 KOps/s 1.6711 KOps/s $\color{#d91a1a}-0.66\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9015ms 0.5827ms 1.7161 KOps/s 1.7225 KOps/s $\color{#d91a1a}-0.37\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1004s 7.3928ms 135.2675 Ops/s 132.4103 Ops/s $\color{#35bf28}+2.16\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.2434ms 12.0582ms 82.9310 Ops/s 83.5400 Ops/s $\color{#d91a1a}-0.73\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.0944ms 1.0344ms 966.7374 Ops/s 976.2874 Ops/s $\color{#d91a1a}-0.98\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 94.9490ms 5.4678ms 182.8886 Ops/s 134.2863 Ops/s $\textbf{\color{#35bf28}+36.19\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.1622ms 12.1854ms 82.0658 Ops/s 83.9574 Ops/s $\color{#d91a1a}-2.25\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.5884ms 1.0831ms 923.3062 Ops/s 976.4270 Ops/s $\textbf{\color{#d91a1a}-5.44\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 97.7012ms 7.6863ms 130.1016 Ops/s 168.2825 Ops/s $\textbf{\color{#d91a1a}-22.69\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 14.1707ms 12.3204ms 81.1664 Ops/s 80.9886 Ops/s $\color{#35bf28}+0.22\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.9312ms 1.3829ms 723.0929 Ops/s 745.8706 Ops/s $\color{#d91a1a}-3.05\%$

@github-actions
Copy link

github-actions bot commented Apr 25, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1000s 99.6359ms 10.0365 Ops/s 10.0893 Ops/s $\color{#d91a1a}-0.52\%$
test_sync 88.3128ms 87.3265ms 11.4513 Ops/s 11.2085 Ops/s $\color{#35bf28}+2.17\%$
test_async 0.1600s 70.0583ms 14.2738 Ops/s 14.0613 Ops/s $\color{#35bf28}+1.51\%$
test_single_pixels 0.1109s 0.1106s 9.0405 Ops/s 9.0711 Ops/s $\color{#d91a1a}-0.34\%$
test_sync_pixels 68.1739ms 66.0690ms 15.1357 Ops/s 15.1722 Ops/s $\color{#d91a1a}-0.24\%$
test_async_pixels 0.1126s 61.4022ms 16.2861 Ops/s 16.3198 Ops/s $\color{#d91a1a}-0.21\%$
test_simple 0.6643s 0.6636s 1.5068 Ops/s 1.4425 Ops/s $\color{#35bf28}+4.46\%$
test_transformed 0.8896s 0.8848s 1.1302 Ops/s 1.1127 Ops/s $\color{#35bf28}+1.57\%$
test_serial 2.1194s 2.0642s 0.4844 Ops/s 0.4740 Ops/s $\color{#35bf28}+2.21\%$
test_parallel 1.8688s 1.8041s 0.5543 Ops/s 0.5611 Ops/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-True-True-True-True] 85.2610μs 33.1581μs 30.1586 KOps/s 30.8592 KOps/s $\color{#d91a1a}-2.27\%$
test_step_mdp_speed[True-True-True-True-False] 41.8100μs 19.3665μs 51.6354 KOps/s 51.2063 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[True-True-True-False-True] 34.9610μs 18.8228μs 53.1269 KOps/s 53.5589 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[True-True-True-False-False] 31.1800μs 11.1306μs 89.8426 KOps/s 89.3800 KOps/s $\color{#35bf28}+0.52\%$
test_step_mdp_speed[True-True-False-True-True] 69.3110μs 34.7755μs 28.7559 KOps/s 29.0790 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[True-True-False-True-False] 41.8200μs 21.6320μs 46.2278 KOps/s 46.8340 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[True-True-False-False-True] 42.9610μs 20.7679μs 48.1513 KOps/s 48.4747 KOps/s $\color{#d91a1a}-0.67\%$
test_step_mdp_speed[True-True-False-False-False] 34.6700μs 13.2403μs 75.5272 KOps/s 76.1756 KOps/s $\color{#d91a1a}-0.85\%$
test_step_mdp_speed[True-False-True-True-True] 69.6210μs 36.9625μs 27.0545 KOps/s 27.5395 KOps/s $\color{#d91a1a}-1.76\%$
test_step_mdp_speed[True-False-True-True-False] 50.5610μs 23.4370μs 42.6675 KOps/s 42.2963 KOps/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[True-False-True-False-True] 49.4210μs 20.8100μs 48.0537 KOps/s 48.2820 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-False-True-False-False] 30.6900μs 13.1308μs 76.1566 KOps/s 76.2680 KOps/s $\color{#d91a1a}-0.15\%$
test_step_mdp_speed[True-False-False-True-True] 68.7710μs 38.8238μs 25.7574 KOps/s 26.3916 KOps/s $\color{#d91a1a}-2.40\%$
test_step_mdp_speed[True-False-False-True-False] 57.8410μs 25.4573μs 39.2814 KOps/s 39.8164 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[True-False-False-False-True] 43.1700μs 22.6901μs 44.0721 KOps/s 44.9018 KOps/s $\color{#d91a1a}-1.85\%$
test_step_mdp_speed[True-False-False-False-False] 46.8500μs 15.0549μs 66.4235 KOps/s 67.9328 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[False-True-True-True-True] 61.9210μs 37.6436μs 26.5649 KOps/s 27.3120 KOps/s $\color{#d91a1a}-2.74\%$
test_step_mdp_speed[False-True-True-True-False] 41.4500μs 23.8824μs 41.8718 KOps/s 42.8814 KOps/s $\color{#d91a1a}-2.35\%$
test_step_mdp_speed[False-True-True-False-True] 44.2000μs 25.4998μs 39.2159 KOps/s 40.0568 KOps/s $\color{#d91a1a}-2.10\%$
test_step_mdp_speed[False-True-True-False-False] 32.5610μs 15.4649μs 64.6627 KOps/s 66.6577 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[False-True-False-True-True] 55.0600μs 39.2652μs 25.4679 KOps/s 25.7411 KOps/s $\color{#d91a1a}-1.06\%$
test_step_mdp_speed[False-True-False-True-False] 49.4200μs 25.5941μs 39.0715 KOps/s 39.3114 KOps/s $\color{#d91a1a}-0.61\%$
test_step_mdp_speed[False-True-False-False-True] 58.7900μs 27.4318μs 36.4540 KOps/s 38.9708 KOps/s $\textbf{\color{#d91a1a}-6.46\%}$
test_step_mdp_speed[False-True-False-False-False] 35.1200μs 17.2495μs 57.9726 KOps/s 60.8901 KOps/s $\color{#d91a1a}-4.79\%$
test_step_mdp_speed[False-False-True-True-True] 0.1175ms 41.8250μs 23.9092 KOps/s 25.3150 KOps/s $\textbf{\color{#d91a1a}-5.55\%}$
test_step_mdp_speed[False-False-True-True-False] 47.3610μs 27.3617μs 36.5474 KOps/s 37.2201 KOps/s $\color{#d91a1a}-1.81\%$
test_step_mdp_speed[False-False-True-False-True] 46.3710μs 26.8819μs 37.1998 KOps/s 37.7468 KOps/s $\color{#d91a1a}-1.45\%$
test_step_mdp_speed[False-False-True-False-False] 0.1118ms 16.8825μs 59.2330 KOps/s 59.3882 KOps/s $\color{#d91a1a}-0.26\%$
test_step_mdp_speed[False-False-False-True-True] 67.4700μs 42.5561μs 23.4984 KOps/s 23.8269 KOps/s $\color{#d91a1a}-1.38\%$
test_step_mdp_speed[False-False-False-True-False] 54.1410μs 29.2147μs 34.2293 KOps/s 34.7549 KOps/s $\color{#d91a1a}-1.51\%$
test_step_mdp_speed[False-False-False-False-True] 51.0810μs 29.1257μs 34.3339 KOps/s 35.9354 KOps/s $\color{#d91a1a}-4.46\%$
test_step_mdp_speed[False-False-False-False-False] 41.0310μs 18.8255μs 53.1193 KOps/s 54.7124 KOps/s $\color{#d91a1a}-2.91\%$
test_values[generalized_advantage_estimate-True-True] 25.3411ms 23.9240ms 41.7990 Ops/s 42.1440 Ops/s $\color{#d91a1a}-0.82\%$
test_values[vec_generalized_advantage_estimate-True-True] 87.9252ms 3.3137ms 301.7730 Ops/s 306.8690 Ops/s $\color{#d91a1a}-1.66\%$
test_values[td0_return_estimate-False-False] 90.1710μs 62.7533μs 15.9354 KOps/s 15.9142 KOps/s $\color{#35bf28}+0.13\%$
test_values[td1_return_estimate-False-False] 51.3708ms 50.9877ms 19.6126 Ops/s 19.5153 Ops/s $\color{#35bf28}+0.50\%$
test_values[vec_td1_return_estimate-False-False] 1.9123ms 1.7456ms 572.8539 Ops/s 573.8628 Ops/s $\color{#d91a1a}-0.18\%$
test_values[td_lambda_return_estimate-True-False] 86.3473ms 84.7076ms 11.8053 Ops/s 12.2214 Ops/s $\color{#d91a1a}-3.40\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0364ms 1.7461ms 572.6981 Ops/s 575.3405 Ops/s $\color{#d91a1a}-0.46\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.6152ms 24.1386ms 41.4275 Ops/s 43.9642 Ops/s $\textbf{\color{#d91a1a}-5.77\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8427ms 0.6828ms 1.4646 KOps/s 1.4628 KOps/s $\color{#35bf28}+0.12\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6876ms 0.6348ms 1.5752 KOps/s 1.5678 KOps/s $\color{#35bf28}+0.47\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5927ms 1.4386ms 695.1040 Ops/s 695.5858 Ops/s $\color{#d91a1a}-0.07\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9580ms 0.6733ms 1.4853 KOps/s 1.5369 KOps/s $\color{#d91a1a}-3.35\%$
test_dqn_speed 7.9265ms 1.4881ms 672.0201 Ops/s 680.3776 Ops/s $\color{#d91a1a}-1.23\%$
test_ddpg_speed 3.4591ms 2.9708ms 336.6141 Ops/s 336.9936 Ops/s $\color{#d91a1a}-0.11\%$
test_sac_speed 9.0983ms 8.5820ms 116.5234 Ops/s 117.2194 Ops/s $\color{#d91a1a}-0.59\%$
test_redq_speed 13.3630ms 10.5564ms 94.7295 Ops/s 97.1446 Ops/s $\color{#d91a1a}-2.49\%$
test_redq_deprec_speed 14.6423ms 11.7213ms 85.3146 Ops/s 87.3306 Ops/s $\color{#d91a1a}-2.31\%$
test_td3_speed 17.5074ms 8.5910ms 116.4012 Ops/s 119.1822 Ops/s $\color{#d91a1a}-2.33\%$
test_cql_speed 27.6674ms 26.4225ms 37.8465 Ops/s 38.3187 Ops/s $\color{#d91a1a}-1.23\%$
test_a2c_speed 6.0153ms 5.7907ms 172.6915 Ops/s 175.3923 Ops/s $\color{#d91a1a}-1.54\%$
test_ppo_speed 7.1439ms 6.0126ms 166.3185 Ops/s 166.1627 Ops/s $\color{#35bf28}+0.09\%$
test_reinforce_speed 4.9544ms 4.7129ms 212.1853 Ops/s 212.9973 Ops/s $\color{#d91a1a}-0.38\%$
test_iql_speed 21.1687ms 20.3977ms 49.0252 Ops/s 50.5896 Ops/s $\color{#d91a1a}-3.09\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9332ms 2.7960ms 357.6601 Ops/s 360.6350 Ops/s $\color{#d91a1a}-0.82\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6679ms 0.5386ms 1.8566 KOps/s 1.8683 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.1014s 0.5884ms 1.6995 KOps/s 1.9360 KOps/s $\textbf{\color{#d91a1a}-12.22\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0539ms 2.8204ms 354.5614 Ops/s 359.1742 Ops/s $\color{#d91a1a}-1.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6840ms 0.5344ms 1.8711 KOps/s 1.8886 KOps/s $\color{#d91a1a}-0.93\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.4033ms 0.5160ms 1.9380 KOps/s 1.9720 KOps/s $\color{#d91a1a}-1.72\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5767ms 1.4579ms 685.9408 Ops/s 702.2211 Ops/s $\color{#d91a1a}-2.32\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 5.0050ms 1.4018ms 713.3590 Ops/s 731.8061 Ops/s $\color{#d91a1a}-2.52\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0888ms 2.9380ms 340.3640 Ops/s 346.5095 Ops/s $\color{#d91a1a}-1.77\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4425ms 0.6725ms 1.4871 KOps/s 1.5196 KOps/s $\color{#d91a1a}-2.14\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7798ms 0.6568ms 1.5225 KOps/s 1.5562 KOps/s $\color{#d91a1a}-2.16\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0956ms 2.8338ms 352.8833 Ops/s 365.1953 Ops/s $\color{#d91a1a}-3.37\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.2660ms 0.5440ms 1.8382 KOps/s 1.8654 KOps/s $\color{#d91a1a}-1.46\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6658ms 0.5217ms 1.9169 KOps/s 1.9199 KOps/s $\color{#d91a1a}-0.16\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0458ms 2.8421ms 351.8569 Ops/s 360.7856 Ops/s $\color{#d91a1a}-2.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6846ms 0.5367ms 1.8631 KOps/s 1.8846 KOps/s $\color{#d91a1a}-1.14\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.3003ms 0.5238ms 1.9092 KOps/s 1.9675 KOps/s $\color{#d91a1a}-2.96\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1525ms 2.9542ms 338.4985 Ops/s 348.0607 Ops/s $\color{#d91a1a}-2.75\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4993ms 0.6749ms 1.4817 KOps/s 1.4984 KOps/s $\color{#d91a1a}-1.12\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7918ms 0.6509ms 1.5364 KOps/s 1.5144 KOps/s $\color{#35bf28}+1.45\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1352s 9.7831ms 102.2170 Ops/s 103.0461 Ops/s $\color{#d91a1a}-0.80\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.3755ms 14.8989ms 67.1191 Ops/s 69.7041 Ops/s $\color{#d91a1a}-3.71\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.4068ms 1.2440ms 803.8827 Ops/s 887.2746 Ops/s $\textbf{\color{#d91a1a}-9.40\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1159s 7.1670ms 139.5290 Ops/s 137.6975 Ops/s $\color{#35bf28}+1.33\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.1211ms 15.0048ms 66.6453 Ops/s 68.8384 Ops/s $\color{#d91a1a}-3.19\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.5381ms 1.3499ms 740.8179 Ops/s 891.8393 Ops/s $\textbf{\color{#d91a1a}-16.93\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1185s 7.5821ms 131.8896 Ops/s 133.0051 Ops/s $\color{#d91a1a}-0.84\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.2526ms 14.8593ms 67.2977 Ops/s 58.5600 Ops/s $\textbf{\color{#35bf28}+14.92\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.8534ms 1.6881ms 592.3934 Ops/s 692.3697 Ops/s $\textbf{\color{#d91a1a}-14.44\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@vmoens @facebook-github-bot