Repository navigation
v0.5.0
- Add support for downloading and inferencing with Gemma 3 4B 3-bit quantization model
- Simplify LLM static accessors by removing duplicate most duplicate accessors (e.g.,
gemma2_2Bandgemma2_9Bare combined intogemma2)
gemma2_2B and gemma2_9B are combined into gemma2)