[Performance] Preallocate collector rollout writes

[vmoens]

Stack from ghstack (oldest at bottom):

• Revert "[Performance] Preallocate collector rollout writes" #3732
• -> [Performance] Preallocate collector rollout writes #3731
• [Performance] Add Isaac collector policy profiling modes #3730

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3731

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 8 New Failures, 1 Unrelated Failure

As of commit 30243d4 with merge base e0ca5d0 ():

NEW FAILURES - The following jobs have failed:

• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  test/test_collectors.py::TestCollectorsNonTensor::test_async[True]
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  test/test_collectors.py::TestCollectorsNonTensor::test_async[True]
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  test/test_collectors.py::TestCollectorsNonTensor::test_async[True]
• Unit-tests on Linux / tests-cpu (3.13) / linux-job (gh)
  test/test_collectors.py::TestCollectorsNonTensor::test_async[True]
• Unit-tests on Linux / tests-cpu (3.14) / linux-job (gh)
  test/test_modules.py::TestMultiAgent::test_multiagent_reset_mlp[True-False-3]
• Unit-tests on Linux / tests-gpu-distributed (3.12, 13.0) / linux-job (gh)
  test/test_distributed.py::TestRayCollector::test_distributed_collector_updatepolicy[True-True-MultiAsyncCollector]
• Unit-tests on Linux / tests-olddeps (3.10, 11.8) / linux-job (gh)
  test/test_tensordictmodules.py::TestGRUModule::test_gru_scan_prototype
• Unit-tests on Windows / unittests-cpu (3.10, windows.4xlarge, cpu) / windows-job (gh)
  test/test_tensordictmodules.py::TestGRUModule::test_gru_scan_prototype

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Unit-tests on Linux / tests-stable-gpu-distributed (3.12, 13.0) / linux-job (gh) (trunk failure)
  test/test_distributed.py::TestRayCollector::test_distributed_collector_updatepolicy[True-True-MultiAsyncCollector]

This comment was automatically generated by Dr. CI and updates every 15 minutes.