Distribute and run llamafile/LLMs with a single docker image.

A simple github actions script to build a llamafile and uploads to huggingface

Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge bases in one click, without complex configuration.

The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!

AI Toolkit for Node.js (LLM, Image Generation, Embeddings, Vector Search)

This repository demonstrates LLM execution on CPUs using packages like llamafile, emphasizing low-latency, high-throughput, and cost-effective benefits for inference and serving.

llama.cpp downloader that selects the latest and best available binaries for your system hardware (CPU & GPU).

Create an IRC chat bot powered by AI, using llamafile, in minutes.

Find the best LLM tools to run models locally for full privacy.

An over-engineered discord bot that relies too much on OpenAI's JSON mode + a free-to-run version based on llamacpp and stable diffusion

离线的一键式LLM文本隐写加密程序，无需安装或任何额外配置。Offline one-click LLM text steganography program without installation or any additional configuration.

Training materials on how to deploy generative AI models locally on your laptop or workstation.

Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda

API Proxy for AI models, rate limiting, management and more!

Gathering insights from Common Crawl using Apache Spark and LLMs.

Containerized LLamaFile RAG template for use at research labs

llama.cpp downloader that selects the best available binaries for your system hardware (CPU & GPU).

This repository is hosting blog pages