Repository navigation
0.14.0
This version adds support for the Qwen 3 family of models, including 0.6B, 1.7B, 8B, and 14B. MOE models from the Qwen 3 series are not supported yet.
You can use the launch.py script to download models:
python launch.py qwen3_0.6b_q40
python launch.py qwen3_1.7b_q40
python launch.py qwen3_8b_q40
python launch.py qwen3_14b_q40