Repository navigation
v0.1.0
The first public release of am2Strata: run AI models on your own PC, behind a web app and OpenAI-, Anthropic- and
Responses-compatible APIs. One download for Linux, Windows or macOS. No Python, no Docker, no CUDA toolkit.
Install
Linux (x86_64) and macOS (Apple Silicon):
curl -fsSL https://github.com/abhaymin/am2strata/releases/latest/download/install.sh | shWindows (x64), in PowerShell:
irm https://github.com/abhaymin/am2strata/releases/latest/download/install.ps1 | iexThen:
am2strata pull mistralai/Ministral-3-3B-Instruct-2512-GGUF Q4_K_M
am2strata # open http://127.0.0.1:8000Each installer checks the download's SHA-256 and needs no admin rights. To get the files by hand instead, take the
archive for your system below; QUICKSTART.md inside takes a few minutes.
In this download
- A local server with OpenAI
/v1/chat/completionsand/v1/responses, Anthropic/v1/messages, streaming and
tool calls. Existing clients and SDKs work by changing the base URL. - A web app: several chats, a canvas (HTML previews, Mermaid flows, a whiteboard), a monitor and settings.
- A Rust inference engine for GGUF models: Llama and Mistral, Qwen3 and Qwen3-MoE, Qwen3.5-MoE, DeepSeek-V2-style
MoE and Nemotron-H. It runs on the CPU, and on any GPU through--devices(wgpu; new and less tested). - A Hugging Face downloader:
am2strata pull <repo>lists the quantizations, andpull <repo> <quant>
downloads one, checks it and writes its run config. - Tools the model can use, when you switch them on:
- web search and page reading;
- a browser: a headless one, or your own Chrome with your logins;
- memory across chats;
- MCP servers;
- PDFs as text and page images. Windows carries Poppler; on Linux and macOS,
install.sh --pdfsets it up.
What to expect
- Speed: the CPU engine suits small models. A 3B model answers at a readable pace; a 35B MoE runs at a few tokens a
second on a desktop CPU. - Fast on NVIDIA: building from source on Linux with PolyStrata's CUDA engines runs large MoE models at 60-160
tokens a second on one RTX 5060 Ti 16 GB. Image generation and editing, video and voice need that build too. See
docs/DEPLOYMENT.md. - Safety: by default the server answers only this PC. Set an API key before using
--host 0.0.0.0. - Unsigned binaries: Windows SmartScreen or macOS may warn about a file downloaded in a browser. The installers
avoid the macOS warning.
Each model has its own licence, which is yours to read. am2Strata itself is MIT.
Problems and ideas: issues.
Full Changelog: https://github.com/abhaymin/am2strata/commits/v0.1.0