Skip to content

FlashAlign 1.1.1

Latest

Choose a tag to compare

@Kurcide Kurcide released this 01 Nov 03:59
e09b512

Adds TensorFold 1.2.0 support for the native DeepSeek starter.

  • Uses the same profile payload as the native vLLM backend.
  • Keeps speculative decoding active and stock/profile caches separate in RAM.
  • Adds profile verification and managed setup for the TensorFold runtime.

The TensorFold path requires the pinned LibertAIDAI EXL3 3.5-bpw checkpoint, Linux x86_64, four SM120 GPUs and strength 1.0. JSON-schema and guided output are unsupported.

Setup and requirements · Validation results