0.2.0

Windows only. Both packages are built from 3203c39 on main. Installation and troubleshooting: see README.md inside each package.

What's Changed

• Edge0 145B and Edge0 120B. Two latent-MoE models for a single NVIDIA GPU, run by edge0-strata.
• New inference engine, edge0-infer. A single on-device MoE engine in C++ on GGML, with one native API, replaces the Python framework and the four separate platform apps. It includes a CLI (run, chat, bench, serve, info), an OpenAI-compatible local server and the Edge0 Chat desktop app. This release supports Edge0 35B; Edge0 8B follows in a later release.
• Anthropic Messages API. The local server also answers POST /v1/messages and POST /v1/messages/count_tokens for native models, and LAN authentication accepts x-api-key. (#180)

Windows x64

edge0-chat-0.2.0-windows-x64.zip

• Edge0 35B runs on the CPU (AVX2) or on a GPU through Vulkan.
• Edge0 145B and Edge0 120B run on an NVIDIA GPU (CUDA) of compute capability 7.5 or newer (RTX 20 / 30 / 40 / 50) with at least 16 GiB of GPU memory, 20 GiB of system memory, and the NVIDIA CUDA Toolkit 13 installed.

SHA256: c7146b76d51c7986723b81a3643893e1ccbb09ce4f365a5090dc99e476bb31b9

Windows Arm64

edge0-chat-0.2.0-windows-arm64.zip

• Edge0 35B runs on the CPU or on a GPU through Vulkan.
• Edge0 145B and Edge0 120B run on an NVIDIA GPU (CUDA) of compute capability 12.1, such as the NVIDIA RTX Spark N1X, with at least 16 GiB of GPU memory, 20 GiB of system memory, and the NVIDIA CUDA Toolkit 13 for Windows Arm64 installed. The CUDA code is built for sm_121 only.

SHA256: f64accb2c963058bc4ff1c9b064ccb35dc62ccdf8881b9a797d1ddab136f500a

Models

Model weights are not included in the packages.

• Edge0 145B: Edge0-145B-NVFP4, Edge0-145B-q3k
• Edge0 120B: Edge0-120B-NVFP4, Edge0-120B-q3k

Full Changelog: v0.1.1...v0.2.0