Skip to content

aither-adk 2.29.0 — on-device WebGPU inference

Choose a tag to compare

@wizzense wizzense released this 19 Jul 00:07

Adds on-device WebGPU inference to the default local GUI: an "⚡ On-device" backend that runs Gemma-4-E2B 100% in the browser on the user's GPU — no server, no API cost, private. One-time ~900MB cached download with a consent gate + progress, streaming, Stop, multi-turn history, and a graceful WebGPU-absent fallback.