[Doc,BugFix] Fix doc and collectors

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3250

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}13$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_tensor_to_bytestream_speed[pickle]	82.4390μs	81.7722μs	12.2291 KOps/s	12.1894 KOps/s	$\color{#35bf28}+0.33\%$
test_tensor_to_bytestream_speed[torch.save]	0.1450ms	0.1432ms	6.9848 KOps/s	7.1499 KOps/s	$\color{#d91a1a}-2.31\%$
test_tensor_to_bytestream_speed[untyped_storage]	0.1201s	0.1196s	8.3599 Ops/s	8.0095 Ops/s	$\color{#35bf28}+4.37\%$
test_tensor_to_bytestream_speed[numpy]	2.8972μs	2.8877μs	346.2979 KOps/s	360.7426 KOps/s	$\color{#d91a1a}-4.00\%$
test_tensor_to_bytestream_speed[safetensors]	40.3462μs	39.9464μs	25.0335 KOps/s	25.8664 KOps/s	$\color{#d91a1a}-3.22\%$
test_simple	0.5546s	0.5533s	1.8072 Ops/s	1.7197 Ops/s	$\textbf{\color{#35bf28}+5.09\%}$
test_transformed	1.2514s	1.1574s	0.8640 Ops/s	0.8577 Ops/s	$\color{#35bf28}+0.73\%$
test_serial	1.6872s	1.6838s	0.5939 Ops/s	0.5820 Ops/s	$\color{#35bf28}+2.05\%$
test_parallel	1.1790s	1.1070s	0.9034 Ops/s	0.9004 Ops/s	$\color{#35bf28}+0.33\%$
test_step_mdp_speed[True-True-True-True-True]	0.1908ms	43.3981μs	23.0425 KOps/s	22.2909 KOps/s	$\color{#35bf28}+3.37\%$
test_step_mdp_speed[True-True-True-True-False]	59.6410μs	25.2703μs	39.5721 KOps/s	39.1064 KOps/s	$\color{#35bf28}+1.19\%$
test_step_mdp_speed[True-True-True-False-True]	70.3510μs	25.3938μs	39.3797 KOps/s	39.5585 KOps/s	$\color{#d91a1a}-0.45\%$
test_step_mdp_speed[True-True-True-False-False]	42.0410μs	13.8674μs	72.1118 KOps/s	72.1508 KOps/s	$\color{#d91a1a}-0.05\%$
test_step_mdp_speed[True-True-False-True-True]	84.1320μs	47.8429μs	20.9017 KOps/s	20.6732 KOps/s	$\color{#35bf28}+1.11\%$
test_step_mdp_speed[True-True-False-True-False]	60.8320μs	28.0410μs	35.6621 KOps/s	35.7531 KOps/s	$\color{#d91a1a}-0.25\%$
test_step_mdp_speed[True-True-False-False-True]	66.0410μs	28.4324μs	35.1712 KOps/s	35.7633 KOps/s	$\color{#d91a1a}-1.66\%$
test_step_mdp_speed[True-True-False-False-False]	46.5510μs	16.6473μs	60.0700 KOps/s	59.6479 KOps/s	$\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-False-True-True-True]	98.6810μs	50.7888μs	19.6894 KOps/s	19.4453 KOps/s	$\color{#35bf28}+1.26\%$
test_step_mdp_speed[True-False-True-True-False]	68.2710μs	30.2894μs	33.0149 KOps/s	32.0286 KOps/s	$\color{#35bf28}+3.08\%$
test_step_mdp_speed[True-False-True-False-True]	60.7510μs	27.5537μs	36.2928 KOps/s	35.6441 KOps/s	$\color{#35bf28}+1.82\%$
test_step_mdp_speed[True-False-True-False-False]	44.5110μs	16.3659μs	61.1028 KOps/s	59.7245 KOps/s	$\color{#35bf28}+2.31\%$
test_step_mdp_speed[True-False-False-True-True]	87.7110μs	52.3768μs	19.0924 KOps/s	18.8288 KOps/s	$\color{#35bf28}+1.40\%$
test_step_mdp_speed[True-False-False-True-False]	67.3810μs	32.8307μs	30.4593 KOps/s	29.8288 KOps/s	$\color{#35bf28}+2.11\%$
test_step_mdp_speed[True-False-False-False-True]	63.4610μs	29.8239μs	33.5302 KOps/s	32.7787 KOps/s	$\color{#35bf28}+2.29\%$
test_step_mdp_speed[True-False-False-False-False]	45.8710μs	19.1994μs	52.0851 KOps/s	51.2307 KOps/s	$\color{#35bf28}+1.67\%$
test_step_mdp_speed[False-True-True-True-True]	95.1820μs	51.0137μs	19.6026 KOps/s	19.8047 KOps/s	$\color{#d91a1a}-1.02\%$
test_step_mdp_speed[False-True-True-True-False]	64.8620μs	30.6406μs	32.6364 KOps/s	32.8068 KOps/s	$\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-True-True-False-True]	2.3811ms	32.5275μs	30.7432 KOps/s	31.0649 KOps/s	$\color{#d91a1a}-1.04\%$
test_step_mdp_speed[False-True-True-False-False]	48.6610μs	18.3263μs	54.5665 KOps/s	53.9938 KOps/s	$\color{#35bf28}+1.06\%$
test_step_mdp_speed[False-True-False-True-True]	90.4420μs	53.1148μs	18.8272 KOps/s	18.7401 KOps/s	$\color{#35bf28}+0.46\%$
test_step_mdp_speed[False-True-False-True-False]	68.0520μs	33.4954μs	29.8548 KOps/s	29.5125 KOps/s	$\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-True-False-False-True]	62.6610μs	33.7533μs	29.6267 KOps/s	29.0983 KOps/s	$\color{#35bf28}+1.82\%$
test_step_mdp_speed[False-True-False-False-False]	56.1510μs	20.8441μs	47.9753 KOps/s	47.3766 KOps/s	$\color{#35bf28}+1.26\%$
test_step_mdp_speed[False-False-True-True-True]	88.4820μs	55.1919μs	18.1186 KOps/s	17.7612 KOps/s	$\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-False-True-True-False]	70.5920μs	35.6011μs	28.0890 KOps/s	27.5713 KOps/s	$\color{#35bf28}+1.88\%$
test_step_mdp_speed[False-False-True-False-True]	73.4520μs	33.8799μs	29.5160 KOps/s	29.1790 KOps/s	$\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-False-True-False-False]	60.2910μs	20.9704μs	47.6862 KOps/s	47.3989 KOps/s	$\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-False-True-True]	95.2920μs	57.7283μs	17.3225 KOps/s	17.0485 KOps/s	$\color{#35bf28}+1.61\%$
test_step_mdp_speed[False-False-False-True-False]	69.5710μs	38.2278μs	26.1590 KOps/s	25.5047 KOps/s	$\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-False-False-True]	74.8620μs	35.9327μs	27.8298 KOps/s	27.3668 KOps/s	$\color{#35bf28}+1.69\%$
test_step_mdp_speed[False-False-False-False-False]	78.0320μs	23.6437μs	42.2945 KOps/s	42.4988 KOps/s	$\color{#d91a1a}-0.48\%$
test_values[generalized_advantage_estimate-True-True]	10.6562ms	10.5330ms	94.9401 Ops/s	93.7905 Ops/s	$\color{#35bf28}+1.23\%$
test_values[vec_generalized_advantage_estimate-True-True]	19.7480ms	17.7975ms	56.1878 Ops/s	56.6354 Ops/s	$\color{#d91a1a}-0.79\%$
test_values[td0_return_estimate-False-False]	0.2368ms	0.1323ms	7.5598 KOps/s	7.6151 KOps/s	$\color{#d91a1a}-0.73\%$
test_values[td1_return_estimate-False-False]	28.8905ms	28.5829ms	34.9860 Ops/s	35.0045 Ops/s	$\color{#d91a1a}-0.05\%$
test_values[vec_td1_return_estimate-False-False]	19.2774ms	17.9609ms	55.6765 Ops/s	55.9639 Ops/s	$\color{#d91a1a}-0.51\%$
test_values[td_lambda_return_estimate-True-False]	42.9274ms	42.3354ms	23.6209 Ops/s	23.6738 Ops/s	$\color{#d91a1a}-0.22\%$
test_values[vec_td_lambda_return_estimate-True-False]	18.4571ms	17.8721ms	55.9531 Ops/s	56.2173 Ops/s	$\color{#d91a1a}-0.47\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	9.4506ms	9.3209ms	107.2853 Ops/s	107.0047 Ops/s	$\color{#35bf28}+0.26\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.6883ms	1.4903ms	670.9873 Ops/s	673.5607 Ops/s	$\color{#d91a1a}-0.38\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4982ms	0.4261ms	2.3471 KOps/s	2.3644 KOps/s	$\color{#d91a1a}-0.73\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	34.5481ms	33.9574ms	29.4487 Ops/s	34.4812 Ops/s	$\textbf{\color{#d91a1a}-14.60\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	1.9209ms	1.7467ms	572.5118 Ops/s	569.1042 Ops/s	$\color{#35bf28}+0.60\%$
test_dqn_speed[False-None]	6.3943ms	1.4314ms	698.6231 Ops/s	702.8420 Ops/s	$\color{#d91a1a}-0.60\%$
test_dqn_speed[False-backward]	2.3218ms	1.9328ms	517.3924 Ops/s	519.2243 Ops/s	$\color{#d91a1a}-0.35\%$
test_dqn_speed[True-None]	0.9037ms	0.5166ms	1.9356 KOps/s	1.8991 KOps/s	$\color{#35bf28}+1.92\%$
test_dqn_speed[True-backward]	1.0149ms	0.9660ms	1.0352 KOps/s	1.0327 KOps/s	$\color{#35bf28}+0.25\%$
test_dqn_speed[reduce-overhead-None]	0.9070ms	0.5090ms	1.9648 KOps/s	1.8904 KOps/s	$\color{#35bf28}+3.93\%$
test_dqn_speed[reduce-overhead-backward]	0.9958ms	0.9522ms	1.0502 KOps/s	1.0408 KOps/s	$\color{#35bf28}+0.90\%$
test_ddpg_speed[False-None]	3.6086ms	2.8727ms	348.1069 Ops/s	349.2930 Ops/s	$\color{#d91a1a}-0.34\%$
test_ddpg_speed[False-backward]	4.1657ms	4.0985ms	243.9943 Ops/s	245.5702 Ops/s	$\color{#d91a1a}-0.64\%$
test_ddpg_speed[True-None]	1.7228ms	1.3677ms	731.1645 Ops/s	707.8914 Ops/s	$\color{#35bf28}+3.29\%$
test_ddpg_speed[True-backward]	2.4015ms	2.3475ms	425.9937 Ops/s	382.9686 Ops/s	$\textbf{\color{#35bf28}+11.23\%}$
test_ddpg_speed[reduce-overhead-None]	1.7391ms	1.3589ms	735.8962 Ops/s	733.5577 Ops/s	$\color{#35bf28}+0.32\%$
test_ddpg_speed[reduce-overhead-backward]	2.3722ms	2.3296ms	429.2596 Ops/s	427.8588 Ops/s	$\color{#35bf28}+0.33\%$
test_sac_speed[False-None]	9.3007ms	8.0386ms	124.3999 Ops/s	124.7646 Ops/s	$\color{#d91a1a}-0.29\%$
test_sac_speed[False-backward]	11.4714ms	11.2315ms	89.0351 Ops/s	88.9171 Ops/s	$\color{#35bf28}+0.13\%$
test_sac_speed[True-None]	2.4953ms	2.0994ms	476.3176 Ops/s	464.5657 Ops/s	$\color{#35bf28}+2.53\%$
test_sac_speed[True-backward]	4.3309ms	3.9771ms	251.4391 Ops/s	236.1488 Ops/s	$\textbf{\color{#35bf28}+6.47\%}$
test_sac_speed[reduce-overhead-None]	2.2747ms	2.0862ms	479.3366 Ops/s	475.4679 Ops/s	$\color{#35bf28}+0.81\%$
test_sac_speed[reduce-overhead-backward]	4.0825ms	3.9724ms	251.7389 Ops/s	251.6121 Ops/s	$\color{#35bf28}+0.05\%$
test_redq_speed[False-None]	15.4621ms	10.4667ms	95.5407 Ops/s	95.7382 Ops/s	$\color{#d91a1a}-0.21\%$
test_redq_speed[False-backward]	22.9591ms	18.1890ms	54.9783 Ops/s	57.9359 Ops/s	$\textbf{\color{#d91a1a}-5.10\%}$
test_redq_speed[True-None]	4.5023ms	4.2931ms	232.9304 Ops/s	236.2050 Ops/s	$\color{#d91a1a}-1.39\%$
test_redq_speed[True-backward]	9.9694ms	9.5738ms	104.4517 Ops/s	105.4243 Ops/s	$\color{#d91a1a}-0.92\%$
test_redq_speed[reduce-overhead-None]	4.7082ms	4.3032ms	232.3833 Ops/s	237.5012 Ops/s	$\color{#d91a1a}-2.15\%$
test_redq_speed[reduce-overhead-backward]	10.0923ms	9.7548ms	102.5142 Ops/s	105.7475 Ops/s	$\color{#d91a1a}-3.06\%$
test_redq_deprec_speed[False-None]	13.6914ms	11.0746ms	90.2965 Ops/s	89.8863 Ops/s	$\color{#35bf28}+0.46\%$
test_redq_deprec_speed[False-backward]	16.3205ms	15.7076ms	63.6636 Ops/s	63.2467 Ops/s	$\color{#35bf28}+0.66\%$
test_redq_deprec_speed[True-None]	3.7099ms	3.5449ms	282.0958 Ops/s	276.4831 Ops/s	$\color{#35bf28}+2.03\%$
test_redq_deprec_speed[True-backward]	7.6447ms	7.4388ms	134.4302 Ops/s	137.8824 Ops/s	$\color{#d91a1a}-2.50\%$
test_redq_deprec_speed[reduce-overhead-None]	3.8910ms	3.5317ms	283.1516 Ops/s	265.2641 Ops/s	$\textbf{\color{#35bf28}+6.74\%}$
test_redq_deprec_speed[reduce-overhead-backward]	7.9740ms	7.4832ms	133.6330 Ops/s	130.7064 Ops/s	$\color{#35bf28}+2.24\%$
test_td3_speed[False-None]	8.2260ms	8.0459ms	124.2863 Ops/s	122.8331 Ops/s	$\color{#35bf28}+1.18\%$
test_td3_speed[False-backward]	11.4237ms	10.9348ms	91.4514 Ops/s	91.9153 Ops/s	$\color{#d91a1a}-0.50\%$
test_td3_speed[True-None]	1.8571ms	1.8000ms	555.5472 Ops/s	554.8790 Ops/s	$\color{#35bf28}+0.12\%$
test_td3_speed[True-backward]	3.8553ms	3.5801ms	279.3235 Ops/s	269.0743 Ops/s	$\color{#35bf28}+3.81\%$
test_td3_speed[reduce-overhead-None]	1.7998ms	1.7539ms	570.1446 Ops/s	561.4799 Ops/s	$\color{#35bf28}+1.54\%$
test_td3_speed[reduce-overhead-backward]	3.7378ms	3.6197ms	276.2628 Ops/s	251.9953 Ops/s	$\textbf{\color{#35bf28}+9.63\%}$
test_cql_speed[False-None]	28.0914ms	25.9722ms	38.5027 Ops/s	37.8787 Ops/s	$\color{#35bf28}+1.65\%$
test_cql_speed[False-backward]	38.4344ms	35.1097ms	28.4822 Ops/s	28.4307 Ops/s	$\color{#35bf28}+0.18\%$
test_cql_speed[True-None]	12.8091ms	12.2167ms	81.8554 Ops/s	82.7810 Ops/s	$\color{#d91a1a}-1.12\%$
test_cql_speed[True-backward]	18.9623ms	18.1278ms	55.1640 Ops/s	57.1874 Ops/s	$\color{#d91a1a}-3.54\%$
test_cql_speed[reduce-overhead-None]	12.5744ms	12.2471ms	81.6520 Ops/s	82.1173 Ops/s	$\color{#d91a1a}-0.57\%$
test_cql_speed[reduce-overhead-backward]	18.4904ms	18.1220ms	55.1817 Ops/s	54.1306 Ops/s	$\color{#35bf28}+1.94\%$
test_a2c_speed[False-None]	5.5746ms	5.4060ms	184.9808 Ops/s	184.4846 Ops/s	$\color{#35bf28}+0.27\%$
test_a2c_speed[False-backward]	12.0883ms	11.7803ms	84.8875 Ops/s	84.8932 Ops/s	$-0.01\%$
test_a2c_speed[True-None]	4.0477ms	3.6970ms	270.4916 Ops/s	272.9186 Ops/s	$\color{#d91a1a}-0.89\%$
test_a2c_speed[True-backward]	9.5845ms	8.4949ms	117.7174 Ops/s	115.7172 Ops/s	$\color{#35bf28}+1.73\%$
test_a2c_speed[reduce-overhead-None]	4.0919ms	3.6762ms	272.0228 Ops/s	274.5364 Ops/s	$\color{#d91a1a}-0.92\%$
test_a2c_speed[reduce-overhead-backward]	8.6928ms	8.5073ms	117.5468 Ops/s	113.9614 Ops/s	$\color{#35bf28}+3.15\%$
test_ppo_speed[False-None]	6.2828ms	5.8695ms	170.3709 Ops/s	169.0890 Ops/s	$\color{#35bf28}+0.76\%$
test_ppo_speed[False-backward]	12.7249ms	12.3090ms	81.2417 Ops/s	81.1595 Ops/s	$\color{#35bf28}+0.10\%$
test_ppo_speed[True-None]	3.9650ms	3.5653ms	280.4775 Ops/s	276.4206 Ops/s	$\color{#35bf28}+1.47\%$
test_ppo_speed[True-backward]	8.6313ms	8.3466ms	119.8090 Ops/s	120.8529 Ops/s	$\color{#d91a1a}-0.86\%$
test_ppo_speed[reduce-overhead-None]	4.3564ms	3.5293ms	283.3415 Ops/s	283.6536 Ops/s	$\color{#d91a1a}-0.11\%$
test_ppo_speed[reduce-overhead-backward]	8.7813ms	8.5622ms	116.7929 Ops/s	111.8645 Ops/s	$\color{#35bf28}+4.41\%$
test_reinforce_speed[False-None]	6.8839ms	4.5294ms	220.7819 Ops/s	218.6330 Ops/s	$\color{#35bf28}+0.98\%$
test_reinforce_speed[False-backward]	7.4605ms	7.2267ms	138.3757 Ops/s	135.3251 Ops/s	$\color{#35bf28}+2.25\%$
test_reinforce_speed[True-None]	3.2024ms	2.8126ms	355.5374 Ops/s	359.2368 Ops/s	$\color{#d91a1a}-1.03\%$
test_reinforce_speed[True-backward]	7.8427ms	7.6183ms	131.2628 Ops/s	130.9095 Ops/s	$\color{#35bf28}+0.27\%$
test_reinforce_speed[reduce-overhead-None]	3.7152ms	2.8207ms	354.5275 Ops/s	394.0848 Ops/s	$\textbf{\color{#d91a1a}-10.04\%}$
test_reinforce_speed[reduce-overhead-backward]	8.3215ms	7.8383ms	127.5787 Ops/s	117.9441 Ops/s	$\textbf{\color{#35bf28}+8.17\%}$
test_iql_speed[False-None]	25.4643ms	20.1681ms	49.5833 Ops/s	51.9646 Ops/s	$\color{#d91a1a}-4.58\%$
test_iql_speed[False-backward]	31.1934ms	30.2969ms	33.0066 Ops/s	33.8690 Ops/s	$\color{#d91a1a}-2.55\%$
test_iql_speed[True-None]	9.6762ms	8.4448ms	118.4164 Ops/s	119.9676 Ops/s	$\color{#d91a1a}-1.29\%$
test_iql_speed[True-backward]	16.9705ms	16.6378ms	60.1040 Ops/s	63.5946 Ops/s	$\textbf{\color{#d91a1a}-5.49\%}$
test_iql_speed[reduce-overhead-None]	8.7138ms	8.4701ms	118.0617 Ops/s	115.8005 Ops/s	$\color{#35bf28}+1.95\%$
test_iql_speed[reduce-overhead-backward]	17.4534ms	17.0141ms	58.7749 Ops/s	59.6824 Ops/s	$\color{#d91a1a}-1.52\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.2729ms	6.0795ms	164.4874 Ops/s	166.1722 Ops/s	$\color{#d91a1a}-1.01\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9065ms	0.3194ms	3.1309 KOps/s	3.0636 KOps/s	$\color{#35bf28}+2.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5480ms	0.2994ms	3.3395 KOps/s	3.7118 KOps/s	$\textbf{\color{#d91a1a}-10.03\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.0460ms	5.7641ms	173.4881 Ops/s	172.7201 Ops/s	$\color{#35bf28}+0.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.2571ms	0.3321ms	3.0109 KOps/s	2.7859 KOps/s	$\textbf{\color{#35bf28}+8.08\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.5513ms	0.3171ms	3.1541 KOps/s	2.9687 KOps/s	$\textbf{\color{#35bf28}+6.24\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.7811ms	1.4158ms	706.3331 Ops/s	687.5403 Ops/s	$\color{#35bf28}+2.73\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.6250ms	1.3337ms	749.7663 Ops/s	747.4922 Ops/s	$\color{#35bf28}+0.30\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.1530ms	5.9762ms	167.3316 Ops/s	166.8734 Ops/s	$\color{#35bf28}+0.27\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	2.0624ms	0.5151ms	1.9414 KOps/s	2.1243 KOps/s	$\textbf{\color{#d91a1a}-8.61\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8095ms	0.5023ms	1.9908 KOps/s	2.1698 KOps/s	$\textbf{\color{#d91a1a}-8.25\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.0358ms	5.8430ms	171.1454 Ops/s	170.3548 Ops/s	$\color{#35bf28}+0.46\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.9975ms	0.3699ms	2.7032 KOps/s	2.7348 KOps/s	$\color{#d91a1a}-1.16\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5500ms	0.3499ms	2.8577 KOps/s	2.9423 KOps/s	$\color{#d91a1a}-2.87\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.1778ms	5.8208ms	171.7972 Ops/s	170.3565 Ops/s	$\color{#35bf28}+0.85\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.7603ms	0.3181ms	3.1436 KOps/s	2.7429 KOps/s	$\textbf{\color{#35bf28}+14.61\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6703ms	0.2844ms	3.5158 KOps/s	3.1901 KOps/s	$\textbf{\color{#35bf28}+10.21\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.1851ms	6.0337ms	165.7344 Ops/s	167.4280 Ops/s	$\color{#d91a1a}-1.01\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0367ms	0.5200ms	1.9232 KOps/s	2.1104 KOps/s	$\textbf{\color{#d91a1a}-8.87\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.6378ms	0.4330ms	2.3093 KOps/s	2.2794 KOps/s	$\color{#35bf28}+1.31\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.5409s	15.8635ms	63.0377 Ops/s	58.4122 Ops/s	$\textbf{\color{#35bf28}+7.92\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	11.1892ms	2.1393ms	467.4351 Ops/s	562.3008 Ops/s	$\textbf{\color{#d91a1a}-16.87\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	2.0655ms	1.1002ms	908.9552 Ops/s	821.4613 Ops/s	$\textbf{\color{#35bf28}+10.65\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	8.6957ms	5.2028ms	192.2041 Ops/s	193.8105 Ops/s	$\color{#d91a1a}-0.83\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	6.3420ms	2.0476ms	488.3749 Ops/s	484.2647 Ops/s	$\color{#35bf28}+0.85\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	8.9178ms	1.2171ms	821.6114 Ops/s	817.7479 Ops/s	$\color{#35bf28}+0.47\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	8.5693ms	5.3595ms	186.5836 Ops/s	61.1341 Ops/s	$\textbf{\color{#35bf28}+205.20\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	9.3279ms	2.2975ms	435.2493 Ops/s	471.9256 Ops/s	$\textbf{\color{#d91a1a}-7.77\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	8.6275ms	1.4002ms	714.2078 Ops/s	1.0001 KOps/s	$\textbf{\color{#d91a1a}-28.58\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	39.1229ms	33.5355ms	29.8192 Ops/s	29.6841 Ops/s	$\color{#35bf28}+0.46\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	19.7092ms	17.9862ms	55.5983 Ops/s	56.8429 Ops/s	$\color{#d91a1a}-2.19\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	36.8033ms	34.3960ms	29.0732 Ops/s	28.6871 Ops/s	$\color{#35bf28}+1.35\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	20.0337ms	18.0980ms	55.2548 Ops/s	55.6716 Ops/s	$\color{#d91a1a}-0.75\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	42.1163ms	36.2067ms	27.6192 Ops/s	27.2973 Ops/s	$\color{#35bf28}+1.18\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	21.2045ms	19.6419ms	50.9116 Ops/s	51.9134 Ops/s	$\color{#d91a1a}-1.93\%$