llamafile

Scripts for creating llamafiles for Llama LLMs and other models in GGUF format.

Usage

Check the Makefile for what version of Llamafile and what model will be used, and adjust to your liking.

To create a llamafile:

make build/$MODEL_NAME

To run the Llamafile:

make start

Made with ✨sparkles✨ by maragu.