[Feature] Collectors - Weight Sync Scheme Integration

[vmoens]

Stack from ghstack (oldest at bottom):

• [Feature] Documentation #3192
• [Feature] SAC Trainer #3191
• [Feature] PPO Trainer Updates #3190
• [Feature] Trainer Algorithms - Configuration System #3189
• [Feature] Trainer Infrastructure - Timing and Utilities #3188
• -> [Feature] Collectors - Weight Sync Scheme Integration #3187
• [Feature] vLLM Weight Synchronization Schemes #3186
• [Feature] Weight Synchronization Schemes - Core Infrastructure #3185
• [Feature] Transform Module - ModuleTransform and Ray Service Refactor #3184
• [Feature] Storage Shared Initialization for Multiprocessing #3183

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3187

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 34 Pending

As of commit 8ca087b with merge base 2f4c919 ():

NEW FAILURES - The following jobs have failed:

• Push Binary Nightly / test-wheel-unix (linux, ubuntu-22.04, 3.9, cp39-cp39, cpu, cpu) (gh)
  TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'
• Push Binary Nightly / test-wheel-unix (macos, macos-latest, 3.9, cp39-cp39, cpu, cpu) (gh)
  TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'

This comment was automatically generated by Dr. CI and updates every 15 minutes.