Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add transformers gptq support #963

Merged
merged 1 commit into from
Sep 7, 2023
Merged

add transformers gptq support #963

merged 1 commit into from
Sep 7, 2023

Conversation

flozi00
Copy link
Contributor

@flozi00 flozi00 commented Aug 31, 2023 •
edited
Loading

Proposal to fix #962

@flozi00
Copy link
Contributor Author

flozi00 commented Aug 31, 2023

@Narsil
I have No idea about code style.
The actual version is not clean with double try except but no idea how to check in clean way if it's transformers version or autogptq

@mallorbc
Copy link

mallorbc commented Sep 6, 2023

This seems to work for me.

Narsil
Narsil approved these changes Sep 7, 2023
View reviewed changes
Copy link
Collaborator

@Narsil Narsil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@Narsil Narsil merged commit b03d262 into huggingface:main Sep 7, 2023
@flozi00 flozi00 deleted the patch-1 branch September 7, 2023 08:24
@flozi00 flozi00 mentioned this pull request Nov 22, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Narsil Narsil Narsil approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Transformers based GPTQ Models missing bits weight
3 participants
@flozi00 @mallorbc @Narsil