[CI] Windows build fix

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2335

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Unrelated Failure

As of commit ae32ecc with merge base 8fb55ef ():

NEW FAILURE - The following job has failed:

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 76e156a535ddcd6652076ba245a8a9ec88ac45b559da9a5c0c16564f6aa01045 /exec failed with exit code 139

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Unit-tests on Windows / unittests-cpu / windows-job (gh) (trunk failure)
  test/test_transforms.py::TestActionDiscretizer::test_trans_parallel_env_check[False]

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}20$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	61.3388ms	60.6242ms	16.4951 Ops/s	17.1716 Ops/s	$\color{#d91a1a}-3.94\%$
test_sync	47.4121ms	33.9449ms	29.4595 Ops/s	30.7818 Ops/s	$\color{#d91a1a}-4.30\%$
test_async	60.7238ms	31.0379ms	32.2186 Ops/s	32.4720 Ops/s	$\color{#d91a1a}-0.78\%$
test_simple	0.4953s	0.4187s	2.3882 Ops/s	2.5101 Ops/s	$\color{#d91a1a}-4.86\%$
test_transformed	0.6492s	0.5859s	1.7069 Ops/s	1.7120 Ops/s	$\color{#d91a1a}-0.30\%$
test_serial	1.3298s	1.2631s	0.7917 Ops/s	0.7925 Ops/s	$\color{#d91a1a}-0.09\%$
test_parallel	1.2088s	1.1134s	0.8981 Ops/s	0.8922 Ops/s	$\color{#35bf28}+0.66\%$
test_step_mdp_speed[True-True-True-True-True]	0.1671ms	24.9166μs	40.1340 KOps/s	41.6151 KOps/s	$\color{#d91a1a}-3.56\%$
test_step_mdp_speed[True-True-True-True-False]	63.4160μs	14.5738μs	68.6162 KOps/s	70.6863 KOps/s	$\color{#d91a1a}-2.93\%$
test_step_mdp_speed[True-True-True-False-True]	46.2770μs	14.3651μs	69.6133 KOps/s	72.3008 KOps/s	$\color{#d91a1a}-3.72\%$
test_step_mdp_speed[True-True-True-False-False]	0.1459ms	8.4433μs	118.4375 KOps/s	123.2846 KOps/s	$\color{#d91a1a}-3.93\%$
test_step_mdp_speed[True-True-False-True-True]	0.1074ms	26.2763μs	38.0571 KOps/s	39.3858 KOps/s	$\color{#d91a1a}-3.37\%$
test_step_mdp_speed[True-True-False-True-False]	59.2510μs	16.1838μs	61.7902 KOps/s	64.3998 KOps/s	$\color{#d91a1a}-4.05\%$
test_step_mdp_speed[True-True-False-False-True]	44.2030μs	15.8205μs	63.2091 KOps/s	65.4095 KOps/s	$\color{#d91a1a}-3.36\%$
test_step_mdp_speed[True-True-False-False-False]	65.3220μs	9.9330μs	100.6742 KOps/s	103.8470 KOps/s	$\color{#d91a1a}-3.06\%$
test_step_mdp_speed[True-False-True-True-True]	63.7390μs	28.3122μs	35.3205 KOps/s	36.3147 KOps/s	$\color{#d91a1a}-2.74\%$
test_step_mdp_speed[True-False-True-True-False]	85.3890μs	17.4506μs	57.3047 KOps/s	57.6088 KOps/s	$\color{#d91a1a}-0.53\%$
test_step_mdp_speed[True-False-True-False-True]	42.6400μs	15.8523μs	63.0822 KOps/s	61.7947 KOps/s	$\color{#35bf28}+2.08\%$
test_step_mdp_speed[True-False-True-False-False]	60.6330μs	9.8826μs	101.1883 KOps/s	105.7728 KOps/s	$\color{#d91a1a}-4.33\%$
test_step_mdp_speed[True-False-False-True-True]	73.3470μs	29.1838μs	34.2656 KOps/s	35.2774 KOps/s	$\color{#d91a1a}-2.87\%$
test_step_mdp_speed[True-False-False-True-False]	61.1340μs	18.9482μs	52.7754 KOps/s	54.4318 KOps/s	$\color{#d91a1a}-3.04\%$
test_step_mdp_speed[True-False-False-False-True]	76.4930μs	17.0663μs	58.5951 KOps/s	60.9684 KOps/s	$\color{#d91a1a}-3.89\%$
test_step_mdp_speed[True-False-False-False-False]	47.6790μs	11.2999μs	88.4963 KOps/s	91.1928 KOps/s	$\color{#d91a1a}-2.96\%$
test_step_mdp_speed[False-True-True-True-True]	79.9490μs	27.9217μs	35.8144 KOps/s	37.0598 KOps/s	$\color{#d91a1a}-3.36\%$
test_step_mdp_speed[False-True-True-True-False]	60.7640μs	17.6854μs	56.5438 KOps/s	58.3396 KOps/s	$\color{#d91a1a}-3.08\%$
test_step_mdp_speed[False-True-True-False-True]	46.0350μs	18.3071μs	54.6237 KOps/s	56.7398 KOps/s	$\color{#d91a1a}-3.73\%$
test_step_mdp_speed[False-True-True-False-False]	69.4200μs	11.3425μs	88.1641 KOps/s	93.3329 KOps/s	$\textbf{\color{#d91a1a}-5.54\%}$
test_step_mdp_speed[False-True-False-True-True]	87.6140μs	29.5642μs	33.8247 KOps/s	35.1853 KOps/s	$\color{#d91a1a}-3.87\%$
test_step_mdp_speed[False-True-False-True-False]	0.2667ms	19.8781μs	50.3066 KOps/s	54.2067 KOps/s	$\textbf{\color{#d91a1a}-7.19\%}$
test_step_mdp_speed[False-True-False-False-True]	48.2910μs	19.9604μs	50.0992 KOps/s	52.9419 KOps/s	$\textbf{\color{#d91a1a}-5.37\%}$
test_step_mdp_speed[False-True-False-False-False]	63.5790μs	12.6612μs	78.9813 KOps/s	82.5505 KOps/s	$\color{#d91a1a}-4.32\%$
test_step_mdp_speed[False-False-True-True-True]	3.4728ms	31.1777μs	32.0742 KOps/s	33.5765 KOps/s	$\color{#d91a1a}-4.47\%$
test_step_mdp_speed[False-False-True-True-False]	60.4420μs	20.5309μs	48.7071 KOps/s	50.3641 KOps/s	$\color{#d91a1a}-3.29\%$
test_step_mdp_speed[False-False-True-False-True]	75.4810μs	19.9567μs	50.1084 KOps/s	52.5030 KOps/s	$\color{#d91a1a}-4.56\%$
test_step_mdp_speed[False-False-True-False-False]	49.2020μs	12.5905μs	79.4252 KOps/s	82.5206 KOps/s	$\color{#d91a1a}-3.75\%$
test_step_mdp_speed[False-False-False-True-True]	84.1370μs	32.1434μs	31.1106 KOps/s	32.4813 KOps/s	$\color{#d91a1a}-4.22\%$
test_step_mdp_speed[False-False-False-True-False]	66.0640μs	22.0607μs	45.3296 KOps/s	47.4854 KOps/s	$\color{#d91a1a}-4.54\%$
test_step_mdp_speed[False-False-False-False-True]	68.1370μs	21.1877μs	47.1971 KOps/s	49.5527 KOps/s	$\color{#d91a1a}-4.75\%$
test_step_mdp_speed[False-False-False-False-False]	64.8210μs	13.8479μs	72.2131 KOps/s	74.7506 KOps/s	$\color{#d91a1a}-3.39\%$
test_values[generalized_advantage_estimate-True-True]	13.1420ms	9.4346ms	105.9931 Ops/s	101.6070 Ops/s	$\color{#35bf28}+4.32\%$
test_values[vec_generalized_advantage_estimate-True-True]	39.1115ms	34.0916ms	29.3327 Ops/s	27.6928 Ops/s	$\textbf{\color{#35bf28}+5.92\%}$
test_values[td0_return_estimate-False-False]	0.2625ms	0.1724ms	5.8001 KOps/s	5.3526 KOps/s	$\textbf{\color{#35bf28}+8.36\%}$
test_values[td1_return_estimate-False-False]	25.2616ms	23.2472ms	43.0159 Ops/s	41.0231 Ops/s	$\color{#35bf28}+4.86\%$
test_values[vec_td1_return_estimate-False-False]	37.6983ms	33.7935ms	29.5915 Ops/s	27.4688 Ops/s	$\textbf{\color{#35bf28}+7.73\%}$
test_values[td_lambda_return_estimate-True-False]	38.3014ms	33.5394ms	29.8157 Ops/s	28.3400 Ops/s	$\textbf{\color{#35bf28}+5.21\%}$
test_values[vec_td_lambda_return_estimate-True-False]	36.1433ms	33.7364ms	29.6416 Ops/s	27.7786 Ops/s	$\textbf{\color{#35bf28}+6.71\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.4555ms	8.2015ms	121.9295 Ops/s	118.2000 Ops/s	$\color{#35bf28}+3.16\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.1326ms	1.7931ms	557.6975 Ops/s	479.4080 Ops/s	$\textbf{\color{#35bf28}+16.33\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.6317ms	0.3631ms	2.7544 KOps/s	2.7450 KOps/s	$\color{#35bf28}+0.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	45.3551ms	43.4806ms	22.9988 Ops/s	22.0236 Ops/s	$\color{#35bf28}+4.43\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.9080ms	3.0576ms	327.0494 Ops/s	325.9718 Ops/s	$\color{#35bf28}+0.33\%$
test_dqn_speed	6.2751ms	1.3170ms	759.2768 Ops/s	756.9368 Ops/s	$\color{#35bf28}+0.31\%$
test_ddpg_speed	3.5051ms	2.7135ms	368.5296 Ops/s	362.2025 Ops/s	$\color{#35bf28}+1.75\%$
test_sac_speed	8.3750ms	8.0120ms	124.8121 Ops/s	119.9520 Ops/s	$\color{#35bf28}+4.05\%$
test_redq_speed	14.5976ms	12.7778ms	78.2607 Ops/s	75.9217 Ops/s	$\color{#35bf28}+3.08\%$
test_redq_deprec_speed	14.8677ms	12.9184ms	77.4090 Ops/s	72.7786 Ops/s	$\textbf{\color{#35bf28}+6.36\%}$
test_td3_speed	8.6282ms	8.0226ms	124.6480 Ops/s	120.7077 Ops/s	$\color{#35bf28}+3.26\%$
test_cql_speed	37.8811ms	35.4511ms	28.2078 Ops/s	26.8561 Ops/s	$\textbf{\color{#35bf28}+5.03\%}$
test_a2c_speed	8.8747ms	7.2588ms	137.7642 Ops/s	131.0662 Ops/s	$\textbf{\color{#35bf28}+5.11\%}$
test_ppo_speed	8.3388ms	7.5468ms	132.5066 Ops/s	124.7461 Ops/s	$\textbf{\color{#35bf28}+6.22\%}$
test_reinforce_speed	8.5181ms	6.4582ms	154.8426 Ops/s	149.3924 Ops/s	$\color{#35bf28}+3.65\%$
test_iql_speed	34.5743ms	32.4930ms	30.7759 Ops/s	30.0518 Ops/s	$\color{#35bf28}+2.41\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	7.0085ms	4.9329ms	202.7189 Ops/s	195.7711 Ops/s	$\color{#35bf28}+3.55\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.5606ms	0.4748ms	2.1061 KOps/s	2.0237 KOps/s	$\color{#35bf28}+4.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6027ms	0.4499ms	2.2228 KOps/s	2.1359 KOps/s	$\color{#35bf28}+4.07\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.5110ms	4.8062ms	208.0628 Ops/s	198.6367 Ops/s	$\color{#35bf28}+4.75\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.2824ms	0.4674ms	2.1396 KOps/s	2.0451 KOps/s	$\color{#35bf28}+4.62\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6807ms	0.4486ms	2.2291 KOps/s	2.1251 KOps/s	$\color{#35bf28}+4.89\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.1766ms	1.6656ms	600.3676 Ops/s	587.0563 Ops/s	$\color{#35bf28}+2.27\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.7612ms	1.5756ms	634.6904 Ops/s	623.9374 Ops/s	$\color{#35bf28}+1.72\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	5.3580ms	5.1539ms	194.0280 Ops/s	191.0208 Ops/s	$\color{#35bf28}+1.57\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.9480ms	0.6084ms	1.6436 KOps/s	1.5684 KOps/s	$\color{#35bf28}+4.79\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9215ms	0.5863ms	1.7055 KOps/s	1.6554 KOps/s	$\color{#35bf28}+3.03\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.1573ms	4.8314ms	206.9779 Ops/s	193.4712 Ops/s	$\textbf{\color{#35bf28}+6.98\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.2031ms	0.4780ms	2.0921 KOps/s	1.4349 KOps/s	$\textbf{\color{#35bf28}+45.80\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6192ms	0.4523ms	2.2108 KOps/s	2.0813 KOps/s	$\textbf{\color{#35bf28}+6.22\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	7.6920ms	4.7906ms	208.7404 Ops/s	195.9019 Ops/s	$\textbf{\color{#35bf28}+6.55\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.5762ms	0.4704ms	2.1259 KOps/s	1.8830 KOps/s	$\textbf{\color{#35bf28}+12.90\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	7.3402ms	0.4584ms	2.1814 KOps/s	2.0556 KOps/s	$\textbf{\color{#35bf28}+6.12\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	7.1720ms	5.0627ms	197.5226 Ops/s	190.4975 Ops/s	$\color{#35bf28}+3.69\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0295ms	0.6375ms	1.5687 KOps/s	1.5665 KOps/s	$\color{#35bf28}+0.14\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8403ms	0.5915ms	1.6905 KOps/s	1.5299 KOps/s	$\textbf{\color{#35bf28}+10.50\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1257s	8.2691ms	120.9318 Ops/s	153.7929 Ops/s	$\textbf{\color{#d91a1a}-21.37\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	17.4068ms	12.9416ms	77.2700 Ops/s	73.8543 Ops/s	$\color{#35bf28}+4.62\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.8136ms	1.1423ms	875.4640 Ops/s	809.4882 Ops/s	$\textbf{\color{#35bf28}+8.15\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1076s	5.7983ms	172.4643 Ops/s	161.1406 Ops/s	$\textbf{\color{#35bf28}+7.03\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	17.2869ms	12.7997ms	78.1270 Ops/s	74.7278 Ops/s	$\color{#35bf28}+4.55\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	6.3418ms	1.2409ms	805.8653 Ops/s	777.6527 Ops/s	$\color{#35bf28}+3.63\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1122s	6.0469ms	165.3737 Ops/s	113.4118 Ops/s	$\textbf{\color{#35bf28}+45.82\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	17.2026ms	12.9260ms	77.3632 Ops/s	73.8223 Ops/s	$\color{#35bf28}+4.80\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	6.3292ms	1.3739ms	727.8315 Ops/s	756.1542 Ops/s	$\color{#d91a1a}-3.75\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1124s	0.1114s	8.9794 Ops/s	8.6256 Ops/s	$\color{#35bf28}+4.10\%$
test_sync	94.6639ms	92.5596ms	10.8039 Ops/s	10.4998 Ops/s	$\color{#35bf28}+2.90\%$
test_async	0.1711s	89.4896ms	11.1745 Ops/s	11.0330 Ops/s	$\color{#35bf28}+1.28\%$
test_single_pixels	0.1193s	0.1192s	8.3887 Ops/s	8.6129 Ops/s	$\color{#d91a1a}-2.60\%$
test_sync_pixels	76.4528ms	73.7785ms	13.5541 Ops/s	13.2225 Ops/s	$\color{#35bf28}+2.51\%$
test_async_pixels	0.1428s	69.1525ms	14.4608 Ops/s	14.2936 Ops/s	$\color{#35bf28}+1.17\%$
test_simple	0.8923s	0.8081s	1.2375 Ops/s	1.2813 Ops/s	$\color{#d91a1a}-3.42\%$
test_transformed	1.1191s	1.0434s	0.9585 Ops/s	1.0115 Ops/s	$\textbf{\color{#d91a1a}-5.24\%}$
test_serial	2.3616s	2.2836s	0.4379 Ops/s	0.4577 Ops/s	$\color{#d91a1a}-4.32\%$
test_parallel	1.9505s	1.9418s	0.5150 Ops/s	0.5154 Ops/s	$\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-True-True-True-True]	0.1242ms	35.5900μs	28.0978 KOps/s	28.3526 KOps/s	$\color{#d91a1a}-0.90\%$
test_step_mdp_speed[True-True-True-True-False]	46.1420μs	20.1053μs	49.7381 KOps/s	49.8381 KOps/s	$\color{#d91a1a}-0.20\%$
test_step_mdp_speed[True-True-True-False-True]	0.1263ms	20.3096μs	49.2377 KOps/s	49.5866 KOps/s	$\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-True-True-False-False]	33.3420μs	11.5339μs	86.7011 KOps/s	87.5871 KOps/s	$\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-True-False-True-True]	70.5040μs	37.5130μs	26.6574 KOps/s	26.8829 KOps/s	$\color{#d91a1a}-0.84\%$
test_step_mdp_speed[True-True-False-True-False]	46.7430μs	22.1287μs	45.1902 KOps/s	45.2519 KOps/s	$\color{#d91a1a}-0.14\%$
test_step_mdp_speed[True-True-False-False-True]	60.3430μs	22.1542μs	45.1382 KOps/s	45.9811 KOps/s	$\color{#d91a1a}-1.83\%$
test_step_mdp_speed[True-True-False-False-False]	79.8550μs	13.5470μs	73.8171 KOps/s	74.0420 KOps/s	$\color{#d91a1a}-0.30\%$
test_step_mdp_speed[True-False-True-True-True]	71.0840μs	39.8736μs	25.0793 KOps/s	25.4215 KOps/s	$\color{#d91a1a}-1.35\%$
test_step_mdp_speed[True-False-True-True-False]	48.4430μs	24.3147μs	41.1275 KOps/s	41.2683 KOps/s	$\color{#d91a1a}-0.34\%$
test_step_mdp_speed[True-False-True-False-True]	0.2003ms	22.6676μs	44.1159 KOps/s	45.9168 KOps/s	$\color{#d91a1a}-3.92\%$
test_step_mdp_speed[True-False-True-False-False]	34.7920μs	13.6360μs	73.3354 KOps/s	74.2232 KOps/s	$\color{#d91a1a}-1.20\%$
test_step_mdp_speed[True-False-False-True-True]	0.1954ms	41.5938μs	24.0421 KOps/s	24.2970 KOps/s	$\color{#d91a1a}-1.05\%$
test_step_mdp_speed[True-False-False-True-False]	0.1637ms	26.1342μs	38.2640 KOps/s	37.7290 KOps/s	$\color{#35bf28}+1.42\%$
test_step_mdp_speed[True-False-False-False-True]	51.8730μs	24.4812μs	40.8476 KOps/s	41.1336 KOps/s	$\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-False-False-False-False]	37.8220μs	15.5787μs	64.1904 KOps/s	63.8569 KOps/s	$\color{#35bf28}+0.52\%$
test_step_mdp_speed[False-True-True-True-True]	76.4740μs	39.0123μs	25.6330 KOps/s	25.3203 KOps/s	$\color{#35bf28}+1.23\%$
test_step_mdp_speed[False-True-True-True-False]	48.8540μs	24.3194μs	41.1194 KOps/s	40.9482 KOps/s	$\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-True-True-False-True]	65.4240μs	26.0459μs	38.3938 KOps/s	38.2131 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-True-True-False-False]	37.9420μs	15.4748μs	64.6214 KOps/s	64.8945 KOps/s	$\color{#d91a1a}-0.42\%$
test_step_mdp_speed[False-True-False-True-True]	73.5940μs	41.1306μs	24.3128 KOps/s	23.7963 KOps/s	$\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-True-False-True-False]	52.5930μs	26.1559μs	38.2323 KOps/s	37.8279 KOps/s	$\color{#35bf28}+1.07\%$
test_step_mdp_speed[False-True-False-False-True]	67.2640μs	27.9506μs	35.7774 KOps/s	35.6908 KOps/s	$\color{#35bf28}+0.24\%$
test_step_mdp_speed[False-True-False-False-False]	40.5520μs	17.4881μs	57.1819 KOps/s	55.8244 KOps/s	$\color{#35bf28}+2.43\%$
test_step_mdp_speed[False-False-True-True-True]	4.3067ms	43.7889μs	22.8369 KOps/s	22.5189 KOps/s	$\color{#35bf28}+1.41\%$
test_step_mdp_speed[False-False-True-True-False]	0.2098ms	28.3535μs	35.2690 KOps/s	34.5825 KOps/s	$\color{#35bf28}+1.99\%$
test_step_mdp_speed[False-False-True-False-True]	0.2256ms	28.3211μs	35.3094 KOps/s	35.2424 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-False-True-False-False]	45.1930μs	17.3434μs	57.6589 KOps/s	56.3483 KOps/s	$\color{#35bf28}+2.33\%$
test_step_mdp_speed[False-False-False-True-True]	0.1677ms	45.1574μs	22.1447 KOps/s	21.8057 KOps/s	$\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-False-False-True-False]	57.4330μs	30.3724μs	32.9247 KOps/s	32.6099 KOps/s	$\color{#35bf28}+0.97\%$
test_step_mdp_speed[False-False-False-False-True]	57.4430μs	29.9799μs	33.3556 KOps/s	33.4410 KOps/s	$\color{#d91a1a}-0.26\%$
test_step_mdp_speed[False-False-False-False-False]	42.5220μs	19.1296μs	52.2750 KOps/s	51.5512 KOps/s	$\color{#35bf28}+1.40\%$
test_values[generalized_advantage_estimate-True-True]	24.7928ms	24.1371ms	41.4300 Ops/s	42.5759 Ops/s	$\color{#d91a1a}-2.69\%$
test_values[vec_generalized_advantage_estimate-True-True]	97.8477ms	2.8444ms	351.5740 Ops/s	367.6558 Ops/s	$\color{#d91a1a}-4.37\%$
test_values[td0_return_estimate-False-False]	97.0950μs	65.4869μs	15.2702 KOps/s	15.7065 KOps/s	$\color{#d91a1a}-2.78\%$
test_values[td1_return_estimate-False-False]	54.2980ms	53.8093ms	18.5842 Ops/s	18.8142 Ops/s	$\color{#d91a1a}-1.22\%$
test_values[vec_td1_return_estimate-False-False]	1.3847ms	1.0752ms	930.0280 Ops/s	926.9736 Ops/s	$\color{#35bf28}+0.33\%$
test_values[td_lambda_return_estimate-True-False]	86.0055ms	85.6463ms	11.6759 Ops/s	11.8914 Ops/s	$\color{#d91a1a}-1.81\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.2008ms	1.0723ms	932.6164 Ops/s	929.6870 Ops/s	$\color{#35bf28}+0.32\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	24.3892ms	24.0984ms	41.4965 Ops/s	42.1816 Ops/s	$\color{#d91a1a}-1.62\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9976ms	0.7117ms	1.4051 KOps/s	1.4213 KOps/s	$\color{#d91a1a}-1.14\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.8097ms	0.6629ms	1.5085 KOps/s	1.5180 KOps/s	$\color{#d91a1a}-0.63\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.6193ms	1.4630ms	683.5453 Ops/s	685.8882 Ops/s	$\color{#d91a1a}-0.34\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.8829ms	0.6743ms	1.4830 KOps/s	1.4877 KOps/s	$\color{#d91a1a}-0.31\%$
test_dqn_speed	7.6927ms	1.4256ms	701.4353 Ops/s	721.4850 Ops/s	$\color{#d91a1a}-2.78\%$
test_ddpg_speed	3.2114ms	2.8623ms	349.3723 Ops/s	364.4935 Ops/s	$\color{#d91a1a}-4.15\%$
test_sac_speed	8.5077ms	8.1565ms	122.6016 Ops/s	125.4542 Ops/s	$\color{#d91a1a}-2.27\%$
test_redq_speed	11.9997ms	10.6343ms	94.0354 Ops/s	97.1595 Ops/s	$\color{#d91a1a}-3.22\%$
test_redq_deprec_speed	12.6516ms	11.1476ms	89.7053 Ops/s	91.1726 Ops/s	$\color{#d91a1a}-1.61\%$
test_td3_speed	8.1242ms	8.0657ms	123.9812 Ops/s	126.5211 Ops/s	$\color{#d91a1a}-2.01\%$
test_cql_speed	27.1993ms	26.2062ms	38.1589 Ops/s	38.9849 Ops/s	$\color{#d91a1a}-2.12\%$
test_a2c_speed	6.1353ms	5.8174ms	171.8976 Ops/s	175.5494 Ops/s	$\color{#d91a1a}-2.08\%$
test_ppo_speed	6.7814ms	6.1664ms	162.1696 Ops/s	165.3435 Ops/s	$\color{#d91a1a}-1.92\%$
test_reinforce_speed	5.4646ms	4.7471ms	210.6565 Ops/s	219.3989 Ops/s	$\color{#d91a1a}-3.98\%$
test_iql_speed	20.9342ms	20.2059ms	49.4906 Ops/s	50.0176 Ops/s	$\color{#d91a1a}-1.05\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	7.0339ms	6.7327ms	148.5281 Ops/s	151.1834 Ops/s	$\color{#d91a1a}-1.76\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.8907ms	0.5321ms	1.8793 KOps/s	1.9263 KOps/s	$\color{#d91a1a}-2.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7522ms	0.5111ms	1.9566 KOps/s	1.9928 KOps/s	$\color{#d91a1a}-1.82\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	7.1204ms	6.6912ms	149.4510 Ops/s	154.6439 Ops/s	$\color{#d91a1a}-3.36\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.0069ms	0.5275ms	1.8956 KOps/s	1.9504 KOps/s	$\color{#d91a1a}-2.81\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6888ms	0.5071ms	1.9720 KOps/s	2.0213 KOps/s	$\color{#d91a1a}-2.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.4656ms	2.0399ms	490.2265 Ops/s	515.3262 Ops/s	$\color{#d91a1a}-4.87\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	2.1950ms	1.9476ms	513.4602 Ops/s	513.2251 Ops/s	$\color{#35bf28}+0.05\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	7.2163ms	6.8623ms	145.7234 Ops/s	148.5049 Ops/s	$\color{#d91a1a}-1.87\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0269ms	0.6865ms	1.4566 KOps/s	1.4992 KOps/s	$\color{#d91a1a}-2.84\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.1390s	0.7833ms	1.2766 KOps/s	1.5522 KOps/s	$\textbf{\color{#d91a1a}-17.75\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	7.0012ms	6.7272ms	148.6505 Ops/s	151.7625 Ops/s	$\color{#d91a1a}-2.05\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.1385ms	0.5363ms	1.8647 KOps/s	1.9233 KOps/s	$\color{#d91a1a}-3.05\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7334ms	0.5154ms	1.9403 KOps/s	1.9915 KOps/s	$\color{#d91a1a}-2.57\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	7.1005ms	6.6642ms	150.0564 Ops/s	152.7412 Ops/s	$\color{#d91a1a}-1.76\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.1360s	0.7125ms	1.4035 KOps/s	1.9520 KOps/s	$\textbf{\color{#d91a1a}-28.10\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7367ms	0.5007ms	1.9971 KOps/s	1.9911 KOps/s	$\color{#35bf28}+0.30\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	7.1687ms	6.8855ms	145.2337 Ops/s	148.3659 Ops/s	$\color{#d91a1a}-2.11\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.9127ms	0.6859ms	1.4580 KOps/s	1.1636 KOps/s	$\textbf{\color{#35bf28}+25.31\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8880ms	0.6672ms	1.4989 KOps/s	1.5124 KOps/s	$\color{#d91a1a}-0.89\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1403s	8.0407ms	124.3669 Ops/s	127.1561 Ops/s	$\color{#d91a1a}-2.19\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	19.6807ms	16.0800ms	62.1890 Ops/s	64.8611 Ops/s	$\color{#d91a1a}-4.12\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	7.3929ms	1.3840ms	722.5236 Ops/s	787.5646 Ops/s	$\textbf{\color{#d91a1a}-8.26\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1373s	10.5359ms	94.9137 Ops/s	128.7330 Ops/s	$\textbf{\color{#d91a1a}-26.27\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	18.4122ms	15.9855ms	62.5566 Ops/s	63.6884 Ops/s	$\color{#d91a1a}-1.78\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	2.2429ms	1.2106ms	826.0292 Ops/s	784.6455 Ops/s	$\textbf{\color{#35bf28}+5.27\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1374s	8.1849ms	122.1765 Ops/s	126.1415 Ops/s	$\color{#d91a1a}-3.14\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	18.6381ms	16.2474ms	61.5483 Ops/s	63.9021 Ops/s	$\color{#d91a1a}-3.68\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	7.0719ms	1.5259ms	655.3381 Ops/s	705.4073 Ops/s	$\textbf{\color{#d91a1a}-7.10\%}$