Release v0.1.2
What's Changed
This release mainly contains bug fixes.
Features
- feat(algo): add
--no_whitenraw-returns advantage and independent critic knobs by @hijkzzz in e5f7647 - feat(recipe): make
rl_qwen3_6_35bPPO-configurable by @hijkzzz in a016f4e - feat(observability): log adaptive KL coefficient to status by @k21993 in #14
Fixes
- fix(critic): initialize value head with proper
initializer_rangeto avoid vanishing gradients by @hijkzzz in 1796697 - fix(agents): isolate tokenize on a dedicated thread pool to prevent deadlocks by @hijkzzz in c2ac1aa
- Revert "fix(rollout): keep in-flight routing across refit (pause clear_cache=False)" to fix KV cache inconsistency and training drift by @hijkzzz in 546d9bc
Refactors
- refactor(loss): dispatch policy surrogates via a registry (mirrors advantage estimators) by @hijkzzz in #13
Tests
- test(gae): restore temporary sys.modules stubs to fix order-dependent collection by @k21993 in #6
- test(advantage): add coverage for group estimators (grpo, dr_grpo, reinforce_baseline, rloo) by @k21993 in #8
CI / Chore / Docs
- chore(ci): add Claude code review workflow by @svcnemo-autobot in #9
- chore(docker): bump vLLM from 0.24.0 to 0.25.1 by @hijkzzz in df44869
- docs(readme): improve installation flow and recommend Docker setup by @hijkzzz in 21c1b89
Other
- CISPO loss by @Athe-kunal in #12
New Contributors
- @k21993 made their first contribution in #6
- @svcnemo-autobot made their first contribution in #9
- @Athe-kunal made their first contribution in #12
- @hijkzzz made their first contribution in #13
- @fus3r made their first contribution in #15
Full Changelog: v0.1.1...v0.1.2