Skip to content

Releases: BEKO2210/alia

Release list

Alia v0.1.0

Choose a tag to compare

@BEKO2210 BEKO2210 released this 15 Oct 09:22
b8a2b7f

First public release of Alia — a fully local coding agent for the GPU you already own.

alia detects your NVIDIA GPU, VRAM and RAM, picks the best measured hardware profile, starts llama-server on loopback and opens a branded Qwen Code terminal (or alia web for the browser). No API key, no cloud.

Measured on an RTX 3070 8 GB · Ryzen 7 5800X · 16 GB RAM (launch configuration)

Profile Model 4K 32K 60K
rtx8gb-16gb-qwen36-35b (default, 64K context) Qwen3.6 35B-A3B UD-IQ3_XXS + MTP 46.5 tok/s 35.2 tok/s 38.2 tok/s*
rtx8gb-qwen35-9b-fast (32K context) Qwen3.5 9B Q4_K_M 66.1 tok/s 57.7 tok/s —

* 60K from an earlier run with the same flags except --jinja. Long-context speed of the 35B profile depends on free RAM: under memory pressure it fell to 24.6 tok/s at 32K and 9.7 at 60K. 32 GB RAM is recommended for long contexts. Raw data: bench/results/.

Highlights

  • Hardware-aware profiles with provenance for every number
  • Safe server lifecycle: loopback only, PID + start-time identity, start lock, never kills foreign processes
  • Expert offload + MTP speculative decoding for a 35B MoE on an 8 GB card
  • English and German, following the system language
  • Benchmark harness and raw JSONL results

Requirements

Linux, NVIDIA GPU, Python 3.12+, Qwen Code 0.25.1, llama.cpp ≥ a0e6dc7 built with CUDA. See the README.

Reviewed by CodeRabbit, the Codex connector and GitHub Copilot over four rounds; 47 unit tests, CodeQL clean.