Skip to content

fix(multi-agent): preserve rollout logprobs - #1995

Merged
zhuzilin merged 1 commit into
THUDM:mainfrom
Jiang020609:fix/multi-agent-rollout-logprobs
Jun 1, 2026
Merged

fix(multi-agent): preserve rollout logprobs#1995
zhuzilin merged 1 commit into
THUDM:mainfrom
Jiang020609:fix/multi-agent-rollout-logprobs

Conversation

@Jiang020609

Copy link
Copy Markdown
Contributor

Summary

  • preserve token-level rollout logprobs in the multi-agent example when SGLang returns output_token_logprobs
  • enable --use-rollout-logprobs in the multi-agent GRPO script so training can consume the saved rollout logprobs

Fixes #1976

Validation

  • python -m ruff check examples/multi_agent/agent_system.py
  • pre-commit run --files examples/multi_agent/agent_system.py examples/multi_agent/run-qwen3-30B-A3B-multi-agent.sh

@zhuzilin
zhuzilin merged commit d719f03 into THUDM:main Jun 1, 2026
32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] examples/multi_agent can crash with NoneType in GRPO advantage computation because old logprobs are missing

2 participants