Skip to content

Repository files navigation

LLM Quantization Tool

Run:

accelerate launch --num_processes=4 python quantize_tui.py

Development environment setup:

make venv

About

LLM Quantization Tool

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages