Repository navigation
Highlights
OpenRL now lives at openrl-dev/openrl. The repository moved from gke-labs/open-rl to the openrl-dev organization (#434). This is the first release published from the new home. Images now publish to ghcr.io/openrl-dev/openrl/<name>:<tag>; the bundles, image defaults, agent skill and docs point at the new paths. The old ghcr.io/gke-labs/open-rl images stay available but get no new tags.
A time-sliced trainer's turn takes in requests that queue during it (#437). An optim_step that arrived during the turn no longer waits for a turn of its own. The trainer keeps taking queued requests for up to OPEN_RL_TURN_DRAIN_SECONDS (default 5; 0 turns it off). On a 20-job sweep on 8 H100s, lone optim_step turns went from about a third of all turns to none.
Harvey LAB recipe (#431, #432, #433):
- Agent Substrate is a third sandbox backend next to Podman and Agent Sandbox. Idle sandboxes suspend and resume with files and processes intact.
- Each turn's budget comes from what remains of the context window. An empty judge verdict is a reward error, not a zero.
- Gemma 4 E4B trains at its full 131k window on the Automodel trainer.
- The README and the GKE guide are rewritten around the current recipe.
CNCF onboarding
- The Developer Certificate of Origin replaces the Google CLA (#444). Commit with
git commit -s. - The project adopts the CNCF Code of Conduct (#445).
- Documentation is licensed under CC BY 4.0; code stays Apache 2.0 (#448).
- The site footer carries the LF Projects copyright line and the CNCF sandbox notice (#446).
- The sampler sets
VLLM_NO_USAGE_STATS=1, so vLLM no longer reports to stats.vllm.ai (#447). Set it to0to opt back in.
What's Changed
- Point repo, image, and module paths at openrl-dev/openrl by @hodaaaaaaaaaa in #434
- harvey_labs: fair grading, and Gemma 4 E4B at full context on Automodel by @ShubyM in #431
- harvey_labs: Agent Substrate sandbox backend with idle suspend by @ShubyM in #432
- harvey_labs: rewrite the recipe README and GKE guide by @ShubyM in #433
- Replace the Google CLA with the DCO in the contributing guide by @hodaaaaaaaaaa in #444
- Add the CC BY 4.0 license for documentation by @hodaaaaaaaaaa in #448
- Disable vLLM usage reporting in the sampler by @hodaaaaaaaaaa in #447
- Adopt the CNCF Code of Conduct by @hodaaaaaaaaaa in #445
- site: add the LF footer and CNCF sandbox notice by @hodaaaaaaaaaa in #446
- training: improve training batch construction by @droot in #437
Full Changelog: v0.0.8...v0.0.9