Skip to content

rLLM: v0.3.0-pre

Latest
Latest

Choose a tag to compare

View all tags
@jeffreysijuntan jeffreysijuntan released this 30 Apr 07:22
· 130 commits to main since this release
v0.3.0-pre
0956764
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • [feature] add support for on policy distillation by @kylemontgomery1 in #356
  • [Bugfix] Make sure the tracking logger is now explicitly finished by trainers by @listar2000 in #358
  • Add Geo3K Tinker training example with VLM support by @BrianChen26 in #357
  • Support custom metric for SDK by @thwu1 in #362
  • fix: typo in bibtex by @tongyx361 in #363
  • Fireworks API returns raw token ids to avoid re-tokenization by @1stprinciple in #301
  • overlong_filter in stepwise RL by @LianShuQuan in #365
  • Verifiers and Prime Intellect Environment Integration & Example by @alt-glitch in #367
  • Add test_train.sh for docs build by @alt-glitch in #374
  • Resolve Tinker error in advantage computation by @listar2000 in #375
  • Merge nightly branch into main by @listar2000 in #377
  • [Fix] Add a few patches to unified trainer by @listar2000 in #383
  • [Doc improvements] Add the missing multi-GPU configuration options to the evaluation scripts in the quick-start documentation. by @SyncLionPaw in #384
  • [Fix] Further enhancements to the Unified Trainer by @listar2000 in #385
  • [Experimental] Fixing Tinker rollout prompt ids by @listar2000 in #390
  • Reset workflow with task and uid before workflow execution by @JasonWei05 in #389
  • Fully Async Trainer by @thwu1 in #394
  • Add LLM-in-Sandbox to awesome projects by @cdxeve in #395
  • 【Fix】All content in examples/search were empty by @Fulin-Gao in #396
  • [Feat] Important updates to the experimental unified trainer by @listar2000 in #398
  • FinQA Release by @mananroongta in #393
  • Refactor unified trainer async flow and add precomputed-advantage + Tinker rollout fixes by @listar2000 in #401
  • feat(tracking): integrate changes need for the rllm-ui by @Chanbinski in #402
  • Fixed the qwen parser to handle case when model is non-thinking but user put disable_thinking=false as config by @jeewoo-lee in #405
  • Enable TrajectorygGoup's role specific RL advantage estimator via unified trainer hook by @listar2000 in #408
  • Move Tinker backend to rllm.trainer.tinker and deprecate legacy trainer APIs under rllm.trainer.deprecated by @listar2000 in #409
  • Refactor RL advantage estimators and add REINFORCE++ baseline/RLOO support by @listar2000 in #410
  • Extend On-Policy Distillation support with unified trainer example by @BrianChen26 in #406
  • [Doc] Unified trainer docs by @listar2000 in #414
  • [Fix] Put doc images into assets by @listar2000 in #415
  • [Fix] Hot-fix advantage calcuilation unpacking issue by @listar2000 in #416
  • Add deprecation notices in docs by @listar2000 in #417
  • feat(tracking): UILogger with non-blocking background worker by @Chanbinski in #419
  • feat(rllm-model-gateway): add standalone proxy server for rLLM by @luyuzhe111 in #412
  • added modal deploy script and training code by @jeewoo-lee in #421
  • Add Claude Code GitHub Workflow by @jeffreysijuntan in #423
  • feat(cli): port non-blocking UILogger, simplify --ui flag, and support eval UI logging by @Chanbinski in #424
  • Add PR and issue templates by @listar2000 in #427
  • Fix ChatTemplateParser import in SFT trainer by @listar2000 in #428
  • feat(cli): add rllm login command for UI authentication by @Chanbinski in #425
  • Add unified trainer OPD docs page and training curve asset by @BrianChen26 in #430
  • fix(openai): respect custom ChatTemplateParser from AgentExecutionEngine by @rajatbeladiya in #420
  • fix(rewards): add sympy timeout to prevent Ray stalls by @rajatbeladiya in #433
  • fix(ray): auto-attach to existing cluster to avoid missing actors by @rajatbeladiya in #436
  • feat(model-gateway): separate worker base URL from API path prefix by @luyuzhe111 in #429
  • feat(ui): progressive batched uploads, session URL, and registration nudge by @Chanbinski in #440
  • [Feature]: rLLM CLI, AgentFlow Framework, Model Gateway & Plugin System by @jeffreysijuntan in #438
  • fix(metrics): include dropped workflow episodes in denominators by @rajatbeladiya in #442
  • docs: sync rllm-ui.md with latest README content by @Chanbinski in #444
  • [feature]: @rllm.rollout and @rllm.evaluator decorators + cookbook examples by @jeffreysijuntan in #445
  • add steps[i].chat_completions; token_warning_threshold from agent_args by @LianShuQuan in #446
  • feat(engine): replace TinkerBackendServer with in-process local handler by @luyuzhe111 in #448
  • Dev rllm telemetry by @boredbichon67 in #449
  • Pydantic Error by @avinashreddydev in #450
  • feat(tinker): add tool-use support for renderer path and fix checkpoint auto-resume by @luyuzhe111 in #451
  • Upgrade MiniMax provider to M2.7 models by @octo-patch in #452
  • feat: add cross-episode Store for sharing state across workflow instances by @listar2000 in #453
  • fix: replace bare except with except Exception in taco.py by @harshadkhetpal in #455
  • Add Vision-DeepResearch to awesome projects by @Osilly in #456
  • Verl 0.7.1 upgrade by @listar2000 in #457
  • feat(engine): add RemoteAgentFlowEngine for remote agent runtimes by @luyuzhe111 in #441
  • Further fixes to ensure compatibility with Verl 0.7.1 by @listar2000 in #462
  • Fix multiprocessing.Manager() server process leak in code reward evaluation by @dubin555 in #411
  • feat(verl): add megatron-compatible batch padding and agentcore + verl math example by @luyuzhe111 in #463
  • fix: verl transform robustness + NCCL dynamic batch sync patch by @listar2000 in #466
  • feat(verl): propagate rollout log probs through transform pipeline by @luyuzhe111 in #467
  • chore: add megatron dependency install script by @luyuzhe111 in #472
  • fix: support verl 0.7.1 EngineWorker in agent_workflow_trainer by @yifannnwu in #474
  • Fix: make sure agent import in init is lazy by @listar2000 in #479
  • Fix #447: norm_adv_by_std_in_grpo should be from rllm.algorithm.norm_... by @JiwaniZakir in #471
  • fix: update verl import paths for verl 0.7.1+ compatibility by @Lidang-Jiang in #480
  • Support multiple MCP servers in MCPEnvironment by @taivu1998 in #476
  • fix: migrate VerlBackend to new EngineWorker path (verl 0.7.1) by @listar2000 in #483
  • fix: handle signal.signal ValueError in non-main threads by @yifannnwu in #484
  • fix(trainer): supplement dfed770 by adding missing update_weights in … by @MarkJoson in #469
  • feat: add hf_template tokenize_and_mask method + verl SFTTrainer compat for RLLMSFTDataset by @yifannnwu in #485
  • fix: resolve CI failures — E501 lint, tinker test deps, disable Claude actions by @listar2000 in #486
  • style: auto-format 21 files to fix ruff-format pre-commit failures by @listar2000 in #487
  • Integrate fully async training to UnifiedTrainer by @kylemontgomery1 in #481
  • fix(verl): disable vllm compile cache to work around corruption bug by @luyuzhe111 in #490
  • Fix: Misc fixes for verl 0.7.1 by @kylemontgomery1 in #496
  • fix(verl): move legacy worker override to launcher before worker class selection by @luyuzhe111 in #499
  • chore(scripts): simplify and pin megatron dependencies by @luyuzhe111 in #498
  • fix(gateway): Retry TCP connection if a TCP connection failure happens because pooled TCP sockets go stale by @lyzustc in #505
  • fix(parser): Qwen3.5 chat template support + simple_math example by @JinyanSu1 in #504
  • feature: harbor remote runtime by @kylemontgomery1 in #495
  • feat: Fix sync agent flow event loop blocking by @jeffreysijuntan in #494
  • feat(gateway): clean up sessions and improve trace store robustness by @JasonWei05 in #500
  • fix(verl): pad multi-turn batch to lcm of dp_size and ppo mini-batch by @luyuzhe111 in #506
  • fix(verl): zero response_mask on padded rows to keep loss magnitude stable by @luyuzhe111 in #508
  • refactor(verl): document EngineWorker mesh names and drop dead branches by @luyuzhe111 in #509
  • Fix rollout_probs_diff masking to respect response_mask in Verl trainers by @taivu1998 in #503
  • [feat] Fix training collapse for AgentFlow with verl backend by @jeffreysijuntan in #511
  • fix(examples): use seq-mean-token-sum loss aggregation for agentcore math verl example by @luyuzhe111 in #513
  • [feat] Collapse multi-turn trajectory steps into a single row (verl) + unified merge metrics by @jeffreysijuntan in #512
  • docs: replace legacy MkDocs with in-repo Mintlify docs by @listar2000 in #515
  • [feat] Unified Task / Runner / Harness — AgentFlow eval stack refactor by @jeffreysijuntan in #514
  • fix(config): various config fixes for unified trainer by @kylemontgomery1 in #518
  • feat: Let AgentFlow use is_validation and preserve TerminationReason in metrics by @JasonWei05 in #523

New Contributors

Full Changelog: v0.2.1.post1...v0.3.0-pre

Contributors

1stprinciple, dubin555, and 29 other contributors
Assets 2
Loading