Skip to content

v1.5.1 — variable-length resident AOT prefill

Choose a tag to compare

@skyguan92 skyguan92 released this 11 Aug 03:19
· 338 commits to main since this release

What changed

v1.5.1 fixes Approaching-AI issue #5.
Cold variable-length prompts and prefix extensions now compose the resident
q1024/q2048/q4096/q8192 AOT prefill schedules. Only the final segment is
padded when needed; unmatched prompt tokens no longer fall back to serial
decode.

The release also preserves the v1.5.0 resident prefix LRU, live SSE streaming,
OpenAI function tools, disconnect cancellation, and the portable userspace
runtime.

Qualification

  • all 19 batch-1 context/output performance cells passed;
  • all nine full-vocabulary correctness contexts passed, with maximum KLD
    0.002174 under the frozen KLD < 0.005 and top-1 gate;
  • exact q8192 128-token output identity passed;
  • q8192 measured 1660 prefill tok/s and 32.30 decode tok/s for output 512;
  • frozen MMLU-256 scored 218/256 (85.16%), versus 216/256 for the GB10
    reference;
  • startup, exact-prefix reuse, resident HTTP, variable prompt lengths, SSE,
    tools, and the isolated archive smokes at q1024/q16384/q65536 passed.

Release commit: 6f3e669ac897eaabfeceb7f193a5e02708a4d95e
Qualified native source: 65c198415709dad6d046c247acab3dc9df2a95a0
Native engine SHA-256: a9f18771175757af080c8a1d8d7e3fb3906c9aa41b43a496686103b626f80262

Download verification

sha256sum -c aima-engine-native-portable-c12eb036ad77.tar.zst.sha256

Archive SHA-256:
4e38f90fce3feb7bccf1965d87a3ec2bebddc439ce62e75fe1bc797c6ce1a5bc.

Independent-host status

The full primary AMD395 qualification and isolated archive qualification are
complete. The independent AMD395 host was unavailable at publication, so this
release does not claim a fresh v1.5.1 second-host result. That sanitized result
will be added as append-only evidence without moving the immutable tag.