Skip to content

v0.5.0

Choose a tag to compare

@atdrendel atdrendel released this 29 Jul 20:16
· 20 commits to main since this release
0811eb0
  • Add support for downloading and inferencing with Gemma 3 4B 3-bit quantization model
  • Simplify LLM static accessors by removing duplicate most duplicate accessors (e.g., gemma2_2B and gemma2_9B are combined into gemma2)