Skip to content

quanto: activations sledgehammer#1014

Merged
bghira merged 3 commits intomainfrom
feature/quanto-activations
Oct 1, 2024
Merged

quanto: activations sledgehammer#1014
bghira merged 3 commits intomainfrom
feature/quanto-activations

Conversation

@bghira
Copy link
Owner

@bghira bghira commented Oct 1, 2024

an experiment to test the impact of activation quantising on a 4090:
image

@bghira bghira marked this pull request as ready for review October 1, 2024 20:18
@bghira bghira merged commit fec2827 into main Oct 1, 2024
@bghira bghira deleted the feature/quanto-activations branch October 2, 2024 19:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant