Skip to content

Conversation

@xiaowangintel
Copy link
Collaborator

@xiaowangintel xiaowangintel commented Oct 16, 2025

Summary:
We validated the SmoothQuant on Intel GPU and refine the test script to support the XPU.

The perplexity of meta-llama/Llama-2-7b-chat-hf is 7.05 on PPL.

@pytorch-bot
Copy link

pytorch-bot bot commented Oct 16, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3185

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 5fe4f34 with merge base a9694a5 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 16, 2025
@liangan1 liangan1 added the ciflow/xpu label used to trigger xpu CI jobs label Oct 16, 2025
@liangan1
Copy link
Collaborator

@xiaowangintel can you paste the accuracy result?

@liangan1 liangan1 added the xpu Intel XPU related features label Oct 16, 2025
@Xia-Weiwen
Copy link
Collaborator

Looks like this PR enables UT on XPU. The title looks ambiguous...

@liangan1 liangan1 changed the title Enable SmoothQuant on Intel GPU SmoothQuant on Intel GPU Oct 16, 2025
@liangan1
Copy link
Collaborator

Looks like this PR enables UT on XPU. The title looks ambiguous...

You are right. Title has been changed.

@liangan1 liangan1 added the topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories) label Oct 16, 2025
Copy link
Contributor

@jerryzh168 jerryzh168 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah title should be changed to something like Enable SmothQuant Test on Intel GPU I think

@jerryzh168 jerryzh168 added topic: not user facing Use this tag if you don't want this PR to show up in release notes and removed topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories) labels Oct 16, 2025
@liangan1 liangan1 changed the title SmoothQuant on Intel GPU Enable SmoothQuant Test on Intel GPU Oct 17, 2025
@liangan1 liangan1 merged commit bb3f03b into pytorch:main Oct 17, 2025
21 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/xpu label used to trigger xpu CI jobs CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: not user facing Use this tag if you don't want this PR to show up in release notes xpu Intel XPU related features

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants