Skip to content

OMP NInfer v0.3.0 — first public release

Choose a tag to compare

View all tags
@alphastorm alphastorm released this 30 Aug 14:31
· 50 commits to main since this release
Immutable release. Only release title and notes can be modified.
v0.3.0
865cc45
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

The first public release. If you use Oh My Pi and own an RTX 5090, 4090, or 3090, OMP NInfer keeps Qwen3.8 27B and your session's continuation state on your GPU — as an explicit, durable primitive, not a lucky prefix-cache hit. (A live server's prefix cache already covers the append-only case; what ships here is transactional lineage plus native-lane checkpoints that survive process restarts.) Start here: Quickstart.

Three qualified lanes, one manifest

Lane Decode Highlights
RTX 5090 · container 240.30 tok/s Freshly requalified on the identical published bytes; 2,199.41 tok/s prefill at 130,048 tokens (exact retrieval); warm follow-up 0.191 s (retained state) vs 36.651 s cold (fresh process, no cache) at an 89,022-token session — qualification-bound
RTX 4090 · native Windows 52.330 tok/s 102,075-token restored continuation after process replacement; DirectStorage-backed durable checkpoints
RTX 3090 · native Windows 90.17 tok/s New in v0.3.0: full public install authority — 15/15 protocol, exact 64,512-token retrieval, durable restart, bidirectional rollback, 299.8 W peak at a 300 W cap

Durable session checkpoints ship on both native Windows lanes (DirectStorage) — a process restart resumes from restored state instead of re-prefilling. The RTX 5090 container keeps live-process warm continuation with OMP transcript replay as its recovery path; per-lane semantics are explicit in the receipts.

Verify everything

git clone --branch v0.3.0 --depth 1 https://github.com/alphastorm/omp-ninfer.git
cd omp-ninfer
python3 scripts/verify_release.py --require-ready

Model by SHA-256, runtime image by OCI digest with SPDX SBOM, clients by checksum, native packages by SHA-256 — one manifest binds them all, and the attached qualification receipts carry every number quoted anywhere. Benchmarks with charts · Architecture · Security model

Support boundary

0.x series: the latest published release and its exact manifest/profile receive fixes. One owner-operated machine per lane; one active request per profile; loopback-only, bearer-authenticated, fail-closed — an unreachable GPU errors, it never silently answers from a cloud model. Community project; not affiliated with or endorsed by Oh My Pi, Qwen, or NVIDIA.

Assets 17
Loading