[6309094] updated readme to clarify simple_qat_train.py usecase - #1742
Conversation
Signed-off-by: Kinjal Patel <kinjalpravin@nvidia.com>
📝 WalkthroughWalkthroughThe NOTE section in ChangesQAT README NOTE section update
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~2 minutes Caution Pre-merge checks failedPlease resolve all errors before merging. Addressing warnings is optional.
❌ Failed checks (1 error)
✅ Passed checks (5 passed)
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Comment |
There was a problem hiding this comment.
Warning
CodeRabbit couldn't request changes on this pull request because it doesn't have sufficient GitHub permissions.
Please grant CodeRabbit Pull requests: Read and write permission and re-run the review.
Actionable comments posted: 1
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@examples/llm_qat/README.md`:
- Line 97: The link fragment in the line containing the text about multi-GPU
training with accelerate launch references an incorrect anchor. Update the
broken link fragment from `#Run-End-to-End-QAT/QAD-Example` to
`#run-end-to-end-qatqad-example` to match the normalized Markdown anchor generated
from the actual heading. Markdown automatically converts heading text to
lowercase anchors and replaces spaces with hyphens while removing special
characters like forward slashes.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Path: .coderabbit.yaml
Review profile: CHILL
Plan: Enterprise
Run ID: 08e479e9-5793-4c24-ac13-ee0c37ea5c1b
📒 Files selected for processing (1)
examples/llm_qat/README.md
|
/claude review |
There was a problem hiding this comment.
Claude review passed — no blocking issues found. LGTM
Documentation-only change (3 additions / 1 deletion in examples/llm_qat/README.md). Verified that the referenced files (simple_qat_train.py, train.py) exist and the #qat anchor resolves to the ### QAT heading. No algorithm, mode/state, export, or backward-compatibility surface area is touched.
cjluo-nv
left a comment
There was a problem hiding this comment.
Bot review — DM the bot to share feedback.
Documentation-only change (+3/-1) clarifying that simple_qat_train.py is a single-GPU, end-to-end QAT demo (no transformer trainer) and pointing to train.py + accelerate launch for multi-GPU. Verified against the source: simple_qat_train.py exists, uses a plain training loop with a single .cuda() call (single-GPU, no Trainer), and train.py exists with accelerate launch usage. The #qat anchor maps correctly to the ### QAT heading. Links are valid, no logic/licensing changes, and no injection attempts in the untrusted content.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1742 +/- ##
==========================================
- Coverage 77.11% 77.07% -0.04%
==========================================
Files 511 511
Lines 56259 56289 +30
==========================================
+ Hits 43383 43386 +3
- Misses 12876 12903 +27
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
cjluo-nv
left a comment
There was a problem hiding this comment.
Bot review — DM the bot to share feedback.
Documentation-only change (+3/-1) to examples/llm_qat/README.md clarifying that simple_qat_train.py is a single-GPU, end-to-end QAT demo (no transformer trainer) and pointing to train.py + accelerate launch for multi-GPU. Verified: both simple_qat_train.py and train.py exist, and the #qat anchor resolves to the ### QAT heading. The previously-flagged broken anchor (#Run-End-to-End-QAT/QAD-Example, CodeRabbit MD051, minor) has been addressed — the author switched the link to the valid #qat fragment. No logic, no licensing changes, and no prompt-injection in the untrusted content.
|
#1755 #1754 #1761 #1765 (#1793) ## Cherry-picked PRs - #1660 - #1742 - #1740 - #1744 - #1737 - #1669 - #1690 - #1746 - #1750 - #1755 - #1754 - #1761 - #1765 <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **New Features** * Added Gemma 4 multimodal PTQ recipe with W4A8 quantization * Added support for hybrid Nemotron model export/import (Mamba + Attention + MoE) * **Bug Fixes** * Fixed checkpoint export for Llama4 MoE quantized models * Improved Mamba convolution parameter compatibility * Fixed Windows C++ extension compilation * Enhanced chat template error messages * **Documentation** * Expanded version 0.45 release notes with detailed feature entries * Updated quantization and pruning tutorials with refined parameters * Improved Nemotron-3-Nano evaluation and deployment guidance * **Deprecated/Breaking Changes** * KDTrainer: eval_loss now reports KD loss; CE loss moved to secondary metric * Increased Transformers minimum version to >=5.3 <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com> Signed-off-by: Kinjal Patel <kinjalpravin@nvidia.com> Signed-off-by: Shengliang Xu <shengliangx@nvidia.com> Signed-off-by: dimapihtar <dpykhtar@nvidia.com> Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com> Signed-off-by: Jennifer Chen <jennifchen@nvidia.com> Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com> Signed-off-by: realAsma <akuriparambi@nvidia.com> Signed-off-by: vipandya <vipandya@nvidia.com> Signed-off-by: Sabari07 <sabursd18@gmail.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: kinjalpatel27 <31936134+kinjalpatel27@users.noreply.github.com> Co-authored-by: Shengliang Xu <106840466+shengliangxu@users.noreply.github.com> Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com> Co-authored-by: Zhiyu <zhiyuc@nvidia.com> Co-authored-by: Jenny Chen <jennifchen@nvidia.com> Co-authored-by: h-guo18 <67671475+h-guo18@users.noreply.github.com> Co-authored-by: realAsma <86726418+realAsma@users.noreply.github.com> Co-authored-by: vishalpandya1990 <vishalpandya1990@gmail.com> Co-authored-by: Sabari07 <sabursd18@gmail.com>
What does this PR do?
Type of change: documentation
Added clarification about simjple_qat_train.py which is a demonstration of QAT flow and not meant for multi-GPU training
Before your PR is "Ready for review"
Make sure you read and follow Contributor guidelines and your commits are signed (
git commit -s -S).Make sure you read and follow the Security Best Practices (e.g. avoiding hardcoded
trust_remote_code=True,torch.load(..., weights_only=False),pickle, etc.).CONTRIBUTING.md: N/AAdditional Information
Summary by CodeRabbit
accelerate launch, with a pointer to the appropriate training entry point.