Skip to content

v0.2.0.post1

Choose a tag to compare

@zhuzilin zhuzilin released this 01 Dec 04:17
· 706 commits to main since this release
763f18d

Fix critical bug mentioned in #958.

What's Changed

  • extract mla update weight logic out by @zhuzilin in #960
  • support do all evals together by @zhuzilin in #959
  • Add --rollout-sample-filter-path by @zhuzilin in #961
  • [FSDP] Optimize FSDP2 Model Loading with Rank-0 Broadcast by @Hecate0821 in #915
  • Add sample.remove_sample by @zhuzilin in #977
  • add --eval-max-prompt-len by @zhuzilin in #978
  • Add args check for max_context_len by @zhuzilin in #979
  • Remove hard coded balance_abs_threshold by @zhuzilin in #981
  • Tiny fix fp8_cast_bf16 not copying chat template by @fzyzcjy in #964
  • Super tiny install dnsutils in dockerfile by @fzyzcjy in #965
  • Super tiny sanity check checkpoint dir by @fzyzcjy in #966
  • Fix convert_hf_to_torch_dist OOM by @fzyzcjy in #967
  • Tiny support using environment variables in addition to arguments for all scripts by @fzyzcjy in #968
  • Super tiny increase default timeout sec by @fzyzcjy in #969
  • Fix random port in use error even though already have free port detection by @fzyzcjy in #970
  • Super tiny enable draft-weights-cpu-backup to avoid MTP acc len issue by @fzyzcjy in #971
  • Add generation function for benchmarking purpose by @fzyzcjy in #972
  • Support zero host or device memory waste for weight update by @fzyzcjy in #973
  • Add fp8 kv cache and tis in qwen3 30b a3b script by @fzyzcjy in #974
  • Add GB200, MTP, benchmark, fp8 rollout mode to glm script by @fzyzcjy in #975
  • [FSDP] Add private func indicator for better usage by @PopSoda2002 in #982
  • [Bugfix] Rename save model by @PopSoda2002 in #983
  • Fix: resolve variable shadowing bug in setup_model_and_optimizer by @fangzhensheng in #963

New Contributors

Full Changelog: v0.2.0...v0.2.0.post1