Skip to content

Ferrite 0.4.3

Choose a tag to compare

View all tags
@BHCC2025 BHCC2025 released this 12 Nov 02:32
· 2 commits to main since this release
v0.4.3
1b853f8

Ferrite 0.4.3 tunes decoding for the RTX 5060 Ti 16 GB.

In this release

  • Decode plans for the RTX 5060 Ti 16 GB. The EXL3 decode kernels have a plan table tuned on the card (36 SMs); until now it ran with the DGX Spark's.
  • Faster generation on that card. Code goes from 139 to 155 tokens per second at 2K context (121 to 136 at 16K, 86 to 97 at 56K), and 500-token code edits from 343 to 357.
  • Same text. Replies with drafting on and off are identical, as before.
  • The DGX Spark and RTX 5080 engines are unchanged.

Details: docs/rtx-5080.md. Full list: CHANGELOG.md.

Install on a DGX Spark (one line):

curl -fsSL https://raw.githubusercontent.com/BHCC2025/ferrite/main/scripts/install.sh | bash

Assets

  • ferrite-0.4.3-dgx-spark-aarch64.tar.gz: prebuilt binaries for DGX Spark (aarch64, CUDA 13, kernels for sm_121a) plus scripts and docs. No Rust toolchain needed. The RTX 5080, RTX 5060 Ti and Arc Pro B70 targets are built from source.
  • ferrite-0.4.3-dgx-spark-aarch64.tar.gz.sha256: its checksum (sha256sum -c).
Assets 4
Loading