Skip to content

v1.4.0 — portable native AMD395 engine

Choose a tag to compare

View all tags
@skyguan92 skyguan92 released this 03 Aug 15:09
· 360 commits to main since this release
v1.4.0
db54224

AIMA AMD395 Qwen3.6 native engine v1.4.0

This is the first hardened portable release of the batch-1 native engine for
Qwen3.6-35B-A3B-BF16 on Ryzen AI Max+ 395 / Radeon 8060S (gfx1151). Model
weights are not included.

What ships

  • A 105,712,311-byte relocatable native archive with a static launcher and a
    complete userspace ELF closure. Runtime Python, PyTorch, vLLM, Triton,
    Transformers and host ROCm userspace are not required.
  • Resident OpenAI-compatible HTTP serving, live chunked SSE streaming,
    function tools and tool history, exact-prefix reuse, bearer authentication,
    bounded socket I/O, disconnect cancellation, graceful shutdown and a
    hardened systemd template.
  • A no-load doctor command, machine-readable --build-info, recursive
    package manifest, exact component hashes and deterministic public evidence.
  • A one-reader direct checkpoint-loader default that avoids same-NVMe O_DIRECT
    contention while retaining an explicit --workers override.

Exact qualification

  • Release/tag commit: db54224cfcb9dae60607ccf6481e412e5c3a991e
  • Qualified native source commit: 4d6c3ce48fd419f404b1a80d8e2ac6202972cec9
  • Native engine SHA-256:
    a9095e5889304381ae8d716ebb262141998f72a254fc7235c290e127b85da872
  • CI: CPU-safe release checks passed.
  • Performance: all 19 cells passed the per-cell >= 0.97 retained-performance
    gate using two runs within 3%, or a third run and median when required.
  • Correctness: all nine full-vocabulary contexts passed KLD < 0.005 and top-1
    identity. Maximum measured KLD was 0.002174; the exact 128-token completion
    hash was aa910692fd03ed4a8e89c04497751e3a28eee36c6148237f7e97c74a6dd68201.
  • Startup: three fresh resident processes measured 50.25, 48.59 and
    48.07 seconds; median 48.59 seconds passed the 51.41-second ceiling.
  • Prefix cache at q32768/output512: TTFT fell from 23,998 ms to 9.190 ms
    (2611x) with 99.995% decode retention and byte-identical output tokens.
  • Portable isolation: checksum, 363 manifest entries, ELF closure and real
    q1024/q16384/q65536 provider smokes all passed with only HOME, LANG and
    PATH supplied.

Selected median batch-1 throughput:

Input / output Cold prefill tok/s Decode tok/s
1024 / 512 1633 34.05
8192 / 512 1654 32.23
16384 / 512 1438 30.68
32768 / 512 1362 28.15
65536 / 512 1175 24.62
131072 / 512 873.2 19.52
261632 / 512 562.5 13.60
261120 / 1024 561.0 13.61

The machine-readable product result and deterministic evidence archive contain
the complete matrix, per-run measurements, correctness reports and HTTP/tool
qualification.

Install

sha256sum -c aima-engine-native-portable-a15b2774e3ab.tar.zst.sha256
tar --zstd -xf aima-engine-native-portable-a15b2774e3ab.tar.zst

ENGINE=./aima-engine-native-portable-a15b2774e3ab/bin/aima-engine
MODEL=/srv/models/Qwen3.6-35B-A3B

"$ENGINE" doctor --model-dir "$MODEL" --json
"$ENGINE" serve --model-dir "$MODEL" --context-tokens 8192

See the bundled README.md, docs/INSTALL.md, docs/API.md and systemd
templates for memory configuration, authentication and lifecycle commands.

Asset integrity

  • Portable archive SHA-256:
    749a2acb8b8d49b3979e1dbb9785ce3a305bb24129175747fef6330579d2f0f2
  • Release-evidence archive SHA-256:
    82b1bedeceaf36ae4a4dfe8fc55a3248041b6eadb98d348ef651a87705ecc27a
  • Product-result JSON SHA-256:
    bf28f94ec4b0c4bc45905e38488b5076d4110058123f97577308de698ca96c7f
  • Portable-bundle result JSON SHA-256:
    be7acd68bab0bc2a20b083982cf4e418851d39822e4ebbd832a628d6510baf53

Security note: the v1.4 public tree and release evidence passed the repository
hygiene scanner, but scanning is not Git-history sanitization. Treat any secret
that ever entered history as compromised and rotate it; see SECURITY.md.

Assets 8
Loading