Skip to content

Conversation

@MekkCyber
Copy link

When loading a model quantized on cpu using Int4CPULayout i have the error :

ValueError: Failed to find class Int4CPULayout in any of the allowed modules: torchao.quantization, torchao.sparsity.sparse_api

This PR simply adds the torchao.dtypes to the list of ALLOWED_AO_MODULES. I'm not sure if this was intended or not

@pytorch-bot
Copy link

pytorch-bot bot commented Apr 14, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2050

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 59d00da with merge base 37d161e (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 14, 2025
@jerryzh168 jerryzh168 added bug Something isn't working topic: bug fix Use this tag for PRs that fix bugs and removed bug Something isn't working labels Apr 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: bug fix Use this tag for PRs that fix bugs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants