where is the code for synchronizing the weights from training to inference in asynchronous training and inference?

[4grass]

Is it here? But I looked through this code, and it only updates the actor itself.

[michaelzhiluo]

The code here uses the weights from FSDP to update the rollout workers (i.e. vllm/sglang)