Skip to content

NVIDIA Megatron-Bridge 0.3.1

Choose a tag to compare

@svcnvidia-nemo-ci svcnvidia-nemo-ci released this 20 Mar 22:35
Changelog Details

Performance & Model Configs

  • CP SFT performance improvements (#2527)
  • Nemotron 3 Nano perf config updates (#2560, #2681)
  • Onboard LLaMA3 70B LoRA to B300 and B200 chips (#2588)
  • Update Qwen3 235B B300 configs to match B200 configs (#2706, #2720)
  • Update DeepSeek-V3 B300 config (#2723)
  • DeepSeek-V3: set no_non_det_algo for deterministic training (#2673)
  • Add MoE Sequential MLP mappings in HF Bridges (#2589)

Bug Fixes

  • [training] Cap lr_warmup_steps to be strictly less than lr_decay_steps (#2858)
  • [training] Fix DistillationProvider.to_cfg_dict to save missing keys in run_config (#2594)
  • [training] Fix StopIteration error in MBridge (#2762)
  • [checkpoint] Fix local checkpoint integration (#2709)
  • [checkpoint] Log warning when HuggingFace Hub download fails silently (#2493)
  • [checkpoint] Low-memory save: use AutoBridge directly in distill_llama32_3b-1b to load HF weights (#2860)
  • [inference] Use config.hidden_size directly for Qwen3VL inference wrapper (#2855)
  • [misc] Improve compare.py robustness for multi-GPU and vocab-padded models (#2647)
  • [misc] Fix BOS token mismatch in compare_text_generation (#2889)
  • [misc] Guard eod_id access in compare_text_generation for HF tokenizers (#2853)
  • [misc] Guard missing kubernetes deps (#2871)
  • [example] Fix example scripts and recipe names in release branch (#2862, #2863)

Documentation

  • Add ModelOpt pruning docs (#2629)