Skip to content

v0.1.0

Choose a tag to compare

@github-actions github-actions released this 07 Nov 17:29
· 320 commits to main since this release

The first public release of am2Strata: run AI models on your own PC, behind a web app and OpenAI-, Anthropic- and
Responses-compatible APIs. One download for Linux, Windows or macOS. No Python, no Docker, no CUDA toolkit.

Install

Linux (x86_64) and macOS (Apple Silicon):

curl -fsSL https://github.com/abhaymin/am2strata/releases/latest/download/install.sh | sh

Windows (x64), in PowerShell:

irm https://github.com/abhaymin/am2strata/releases/latest/download/install.ps1 | iex

Then:

am2strata pull mistralai/Ministral-3-3B-Instruct-2512-GGUF Q4_K_M
am2strata                      # open http://127.0.0.1:8000

Each installer checks the download's SHA-256 and needs no admin rights. To get the files by hand instead, take the
archive for your system below; QUICKSTART.md inside takes a few minutes.

In this download

  • A local server with OpenAI /v1/chat/completions and /v1/responses, Anthropic /v1/messages, streaming and
    tool calls. Existing clients and SDKs work by changing the base URL.
  • A web app: several chats, a canvas (HTML previews, Mermaid flows, a whiteboard), a monitor and settings.
  • A Rust inference engine for GGUF models: Llama and Mistral, Qwen3 and Qwen3-MoE, Qwen3.5-MoE, DeepSeek-V2-style
    MoE and Nemotron-H. It runs on the CPU, and on any GPU through --devices (wgpu; new and less tested).
  • A Hugging Face downloader: am2strata pull <repo> lists the quantizations, and pull <repo> <quant>
    downloads one, checks it and writes its run config.
  • Tools the model can use, when you switch them on:
    • web search and page reading;
    • a browser: a headless one, or your own Chrome with your logins;
    • memory across chats;
    • MCP servers;
    • PDFs as text and page images. Windows carries Poppler; on Linux and macOS, install.sh --pdf sets it up.

What to expect

  • Speed: the CPU engine suits small models. A 3B model answers at a readable pace; a 35B MoE runs at a few tokens a
    second on a desktop CPU.
  • Fast on NVIDIA: building from source on Linux with PolyStrata's CUDA engines runs large MoE models at 60-160
    tokens a second on one RTX 5060 Ti 16 GB. Image generation and editing, video and voice need that build too. See
    docs/DEPLOYMENT.md.
  • Safety: by default the server answers only this PC. Set an API key before using --host 0.0.0.0.
  • Unsigned binaries: Windows SmartScreen or macOS may warn about a file downloaded in a browser. The installers
    avoid the macOS warning.

Each model has its own licence, which is yours to read. am2Strata itself is MIT.

Problems and ideas: issues.

Full Changelog: https://github.com/abhaymin/am2strata/commits/v0.1.0