Skip to content

OMP NInfer v0.3.1 — qualified RTX 4090 MTP3 lane

Choose a tag to compare

View all tags
@alphastorm alphastorm released this 30 Aug 17:18
· 44 commits to main since this release
Immutable release. Only release title and notes can be modified.
v0.3.1
ae6ef29
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

The RTX 4090 lane now ships its qualified MTP3 speculative profile. Identical released engine binary and model bytes — only the speculative configuration changed (a +4-byte deterministic package) — promoted by the recorded two-arm MTP0-versus-MTP3 comparison: complete Golden-equivalent wall time 5.663 s → 4.698 s (+17.04%), decode 93.2–97.7 tok/s (vs the 52.330 tok/s MTP0 baseline), 107,851-token restored continuation after process replacement, every deterministic, persistence, and protocol gate green on both arms. An exploratory depth sweep measured draft-3 > draft-4 > draft-5 on the fixed decode workload — the first datapoint for the roadmap's MTP depth-and-corpus ablation.

Start here: Quickstart. RTX 5090 and 3090 lanes are unchanged from v0.3.0.

Component release: ninfer@v0.3.1-qwen38-4090-mtp3.2 (immutable, SHA256SUMS-bound). Every number above is receipt-bound in the attached evidence set; qualification tooling defects found during the campaign are disclosed in the qualification sidecar.

Assets 14
Loading