Skip to content

Release v0.1.2

Choose a tag to compare

@hijkzzz hijkzzz released this 17 Jul 12:21
6c99eaa

What's Changed

This release mainly contains bug fixes.

Features

  • feat(algo): add --no_whiten raw-returns advantage and independent critic knobs by @hijkzzz in e5f7647
  • feat(recipe): make rl_qwen3_6_35b PPO-configurable by @hijkzzz in a016f4e
  • feat(observability): log adaptive KL coefficient to status by @k21993 in #14

Fixes

  • fix(critic): initialize value head with proper initializer_range to avoid vanishing gradients by @hijkzzz in 1796697
  • fix(agents): isolate tokenize on a dedicated thread pool to prevent deadlocks by @hijkzzz in c2ac1aa
  • Revert "fix(rollout): keep in-flight routing across refit (pause clear_cache=False)" to fix KV cache inconsistency and training drift by @hijkzzz in 546d9bc

Refactors

  • refactor(loss): dispatch policy surrogates via a registry (mirrors advantage estimators) by @hijkzzz in #13

Tests

  • test(gae): restore temporary sys.modules stubs to fix order-dependent collection by @k21993 in #6
  • test(advantage): add coverage for group estimators (grpo, dr_grpo, reinforce_baseline, rloo) by @k21993 in #8

CI / Chore / Docs

Other

New Contributors

Full Changelog: v0.1.1...v0.1.2