Skip to content

Conversation

@lkk12014402
Copy link
Contributor

Type of Change

add mxfp8 qat example

Description

mxfp8 qat

@chensuyue chensuyue added this to the 3.6 milestone Oct 16, 2025
@lkk12014402 lkk12014402 requested a review from Copilot October 16, 2025 06:41
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds a new example for MXFP8 Quantization Aware Training (QAT) for large language models using Hugging Face transformers. The example demonstrates how to perform QAT on LLMs with the Neural Compressor library.

  • Provides a complete QAT workflow with utilities for data processing and model quantization
  • Implements training pipeline with MXFP8 quantization scheme integration
  • Includes comprehensive documentation and configuration files for distributed training

Reviewed Changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
utils.py Data processing utilities for the Daring-Anteater dataset and metrics calculation
requirements.txt Dependencies for the QAT example including neural-compressor and transformers
main.py Main training script with quantization integration and model export functionality
accelerate_config/fsdp1.yaml FSDP configuration for distributed training
accelerate_config/ddp.yaml DDP configuration for multi-GPU training
README.md Documentation with step-by-step QAT workflow instructions

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

lkk12014402 and others added 3 commits October 16, 2025 15:53
…tization/llm_qat/main.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…tization/llm_qat/main.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…tization/llm_qat/utils.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@chensuyue chensuyue merged commit c099ad5 into intel:master Oct 17, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants