Skip to content

TurboFieldfare 0.3 — Apple10 Long-Context Prefill

Latest

Choose a tag to compare

@drumih drumih released this 29 Jul 14:48
f8abc44

TurboFieldfare 0.3 speeds up long-context prefill on Apple10 GPUs and fixes the Mac app's download ETA countdown.

Apple10 long-context prefill

  • Full-attention layers now process all eight GQA query heads together with TensorOps, reusing K/V reads.
  • The new path is selected automatically on Apple10 for the pinned full-attention shape. Earlier GPUs keep causal-tiled attention.
  • Isolated full attention measured 11.24x faster at 16K and 11.63x faster at 64K.
  • On the same 32K input, full-runtime prefill fell from 491.09 to 204.29 seconds, a 2.404x speedup without increased memory use.
  • Direct attention checks passed through 64K, and MLX-relative endpoints matched top-1 at 8K, 16K, 32K, and 64K.

Mac app

  • The visible download ETA now updates after each estimation interval, so a steady download advances the minute countdown.

Validation

  • The release build, serial package tests, and Markdown link check passed on the release commit.
  • Thirteen Apple10 tile-boundary cases passed against the CPU reference and were byte-stable across repeated runs on an M5 Pro.

This is a source-only release. It does not include model weights or application binaries.

Full changelog: 0.2.1...0.3

Implemented in #16 and #17.