Repository navigation
Initial release of Millie Runtime, built on llama.cpp, supporting Millie’s custom quantization formats, text and image input, and low-memory inference on Apple Metal.
Includes macOS Apple Silicon and Linux x86_64 builds. The Mac build is signed and notarized by LLMs For All, Inc. Model weights are downloaded separately.