Skip to content

v0.1.1

Choose a tag to compare

@github-actions github-actions released this 11 Nov 18:37
· 2 commits to main since this release

v0.1.1

Security and robustness hotfix, a faster image VAE, an opt-in Flash disk prefix store, and ready-made binaries built by CI.

Fixed (from an independent code review of v0.1.0; every fix has a model-free test that fails on
v0.1.0 and passes here):

  • oxe-server access control: no wildcard CORS headers; 403 for a non-loopback Host, a
    non-loopback Origin (including null) and Sec-Fetch-Site: cross-site. Optional key
    (--api-key-file / OXE_API_KEY_FILE, llama-server format, or --api-key): with a key every
    route needs Authorization: Bearer or X-Api-Key, compared in constant time.
  • Sampler and request checks: a request with min_p > 1 could abort the server. sample() is
    now total; min_p / top_p / typical_p outside 0..1, non-finite temperature and out-of-range
    penalties get 400; n_probs capped; token ids above u32 no longer wrap.
  • GGUF reader: checked element/byte sizes, offsets and counts; a crafted model file can no
    longer cause out-of-bounds reads or writes (fuzz-style test: 20k mutated headers).
  • A streaming client that stops reading no longer holds the worker (stall timeout, default 30 s,
    cancels like a disconnect).
  • Flash cache preference 20/18 takes the swap-tolerant rule only when free swap covers what
    must leave RAM.
  • Exact routes (no trailing-slash aliases); Pool::run refuses concurrent use and aborts on a
    job panic in every profile.
  • kernels-sys library test linked only by luck of archive order.
    Installed and qualified on the test laptop with the lab's controller: all three models
    13/13 independent protected-task checks, security checks, five-case regressions PASS, no waiver.
    Receipts: v011-hotfix

Faster images: oxi's VAE no longer runs on one core. Pool::new pinned the calling thread to
cpu 0, and oxi kept that pool alive through the VAE, so the VAE's threads inherited a one-CPU mask.
The creator's CPU mask is now restored before the VAE runs.
Studio 512 px after the fix: 30.9-31.1 s per cold request in the VAE-1 qualification screen (was 51.53 s, not a matched comparison); installed live smoke 24.89 s.
Receipts: VAE-1

Opt-in Flash disk prefix store: reuse a long chat prefix across unload/reload, with
identical greedy output, private cache files and bounded on-disk entries. State
lengths are checked before allocation. Before allocating a save buffer, Flash
checks MemAvailable against a 1024 MiB save reserve plus twice the entry size;
when memory is short or unknown, or an earlier save is still running, it skips the
save without changing output. The store remains off unless explicitly enabled.
Installed qualification includes explicit O43/O43b timing exceptions, with all
five output identities, security and memory checks passing and cancel recovery
below five seconds. Raw failed timing reports remain part of the receipt.
Receipts: FLASH-PREFIX-2

Known limitation, FP-SHORTLAT: two-token chat/context decode added about 120-180 ms
versus the fresh control. The v0.1.2 target is <=50 ms of added short-request latency.
768/1024 px image qualification and NPU inference are outside this release.

New: ready-made binaries. Every v* tag builds, tests and publishes Linux aarch64 tarballs from
the tagged source on GitHub's ARM64 runner (Fedora 44 container, GCC 16, pinned Rust 1.99.1,
actions pinned by commit): oxe-server (oxe MoE), oxe-server-flash (Flash + flash-m0/flash-m3,
production ggml built in the same run from BigMoeOnEdge 930b2c9 + llama.cpp 7ac98f4 + the
demand-mapping patch) and oxi. Each tarball carries README.txt (commit, run, toolchain,
glibc >= 2.39), the licences of every vendored component and linked Rust crate, SHA256SUMS and
Sigstore build provenance (gh attestation verify FILE --repo n0rpan/snapdragon-engine
--signer-workflow n0rpan/snapdragon-engine/.github/workflows/release.yml). CI builds pass the
model-free tests and the Flash selftest; they are not gate-qualified and can differ from the
measured laptop builds in the last floating-point bits (README "Download").
Flash archives include the exact Apache-2.0 BigMoeOnEdge and MIT llama.cpp fork licence texts, pinned source attribution and licence hashes. Model-free archive tests also run when checks do not publish packages.
CI also runs on every push to main and every pull request.

Squashed snapshot of private source 9c76ef5ba9aa1fdd03331732e5149af60d564159 (previous public release v0.1.0).

Binaries

Built by GitHub Actions from v0.1.1 (commit 510d250) in run 43078406408; nobody uploads binaries by hand.
Linux aarch64, for ARMv8.6-A cores with dotprod, i8mm, fp16 and bf16 (Snapdragon X Elite / X Plus); glibc requirement and toolchain in each tarball's README.txt.
CI builds pass the model-free tests and the Flash selftest; they have not been through the lab's model-based identity gates, and their outputs can differ from the measured laptop builds in the last floating-point bits (README, "Download").

File Contents
oxe-server-v0.1.1-linux-aarch64.tar.gz oxe-server: the oxe MoE engine (Ornith 1.5, Qwen3.6 35B-A3B)
oxe-server-flash-v0.1.1-linux-aarch64.tar.gz oxe-server with the Flash engine (--engine flash) + flash-m0 (expert sidecar) and flash-m3 (selftest); ggml built in the same run from the pinned public sources
oxi-v0.1.1-linux-aarch64.tar.gz oxi: FLUX.2 klein image engine (experimental)

Verify:

sha256sum -c SHA256SUMS --ignore-missing
gh attestation verify oxe-server-v0.1.1-linux-aarch64.tar.gz --repo n0rpan/snapdragon-engine \
  --signer-workflow n0rpan/snapdragon-engine/.github/workflows/release.yml

No model weights are included.