Skip to content

v2.40.0: log sampled rollout completions during training

Choose a tag to compare

@github-actions github-actions released this 30 Sep 13:50
· 31 commits to main since this release

Features

  • log sampled rollout completions during training

    train_llm_rollout takes a new completion_logging=CompletionLoggingConfig(...) argument. When set, each iteration samples prompt groups from the rollout batch and decodes prompt, completion, reward, turn count and completion-token count. Every interval iterations the samples from every population member go in one write to the console (verbose), a W&B completions table (wb) and an optional JSONL file (jsonl_path). Text fields are capped at max_chars, keeping head and tail. The latest samples are also logged at error level if training raises.

    The building blocks (CompletionLogger, CompletionRecord, build_completion_record and the writers) live in agilerl.training.llm.completion_logging for custom training loops.

Other

  • bump GitHub Actions off Node 20 and CodeQL Action v3

    Put the CodeQL job steps in .github/workflows/codeql.yml so that file has
    on.push (CI still calls it as a merge gate; push to main and the weekly
    schedule still feed the Security tab). Use actions/checkout@v5 and
    github/codeql-action v4.

Full Changelog: v2.39.0...v2.40.0