From idle silicon to an open Linux laboratory
This release is a public handoff. It began with a Ryzen 7 PRO 7840U whose XDNA1 NPU was visible under Linux but easy to leave unused. It now gives XDNA1 owners, Strix Point XDNA2 owners, and future-device experimenters a freely reusable path to make small, honest, CPU-checked local-AI building blocks—and to publish successes, failures, and new ideas for the next person.
Anyone may use, copy, modify, fork, publish, redistribute, teach with, or ship the repository's MIT-licensed work commercially. Preserve the license notice; upstream code and model assets retain their own licenses.
New in v1.1.0
- Open NPU Lab: a 15-minute/day/week/research ladder, honest evidence labels, hybrid CPU+iGPU+NPU designs, practical projects, real XDNA1/XDNA2 GIFs, and an explicit invitation to fork the work.
- Primary-source research map: official hardware/kernel/compiler sources plus published XDNA1/XDNA2 LLM work, with each generation, baseline, and evidence type separated.
- Local RAG sidecar: deterministic CPU text features → persistent 256×256 bf16 NPU score matrix → complete CPU oracle and exact top-k gate → optional model endpoint.
- Open experiment intake: the new issue form welcomes hardware passes, compile-only probes, useful failures, latency/energy measurements, and application ideas on any generation.
- Five-language core guides now distinguish this repository's pinned evidence, moving upstream AMD IRON capability, published research, and still-open work.
Final Strix Point evidence
On RyzenAI-npu4, the release candidate rebuilt its toolchain-keyed bf16 VMFB and matched all 65,536 splat outputs exactly. Three semantic RAG queries, each repeated seven times through one persistent context, checked all 65,536 outputs per call, stayed finite, passed a 5% normalized-maximum error gate, and preserved exact CPU top-3 parity. Worst errors were 0.138%, 0.149%, and 0.115%.
The hardware-free suite contains 19 corpus, oracle, endpoint, timeout, secret-handling, and cache-boundary tests. The release commit passed GitHub Actions on both the PR and merged main.
XDNA1 is the reason this remains open
The original Phoenix/7840U hardware results and demos remain first-class evidence and usable source. This release also points to current upstream Phoenix operator coverage and published hybrid LLM research showing that first-generation silicon still has meaningful work to do. It does not pretend that an arbitrary LLM already runs wholly on XDNA1: the exact current-lock full sidecar rerun on XDNA1 is still requested and clearly labelled.
Start with the support matrix, run the read-only check, reproduce one CPU-reference contract, and then change one small piece. An NPU that runs one honest, useful job is no longer decoration.
See the full changelog.
