Skip to content

v1.0.8

Choose a tag to compare

@brontoguana brontoguana released this 27 May 18:39
· 237 commits to main since this release
  • Fix Typhon post-prefill hard exits during HCS reload before decode by using bounded synchronous reload on immediate-wait request, benchmark, and reference paths.
  • Preserve live VRAM pressure checks at the decode boundary instead of queuing all soft-HCS reload DMA before synchronization.
  • Validated with local ./dev build, Typhon ./dev build, an instrumented 8870-token streaming request, and a clean Typhon benchmark with no hard exit.