Skip to content

Ferrite 0.2.0

Choose a tag to compare

View all tags
@BHCC2025 BHCC2025 released this 10 Nov 23:38
· 5 commits to main since this release
v0.2.0
25ddac0

Ferrite 0.2.0 adds an experimental second target: the same model and server on one Intel Arc Pro B70.

In this release

  • Intel Arc Pro B70 engine (experimental). fe-server --engine xe serves Qwen3.8-27B on one Arc Pro B70 (32 GB), with Rust kernels compiled to SPIR-V and loaded through Level Zero: XQ 5.0 bpw weights, int8 prompt processing, lossless DFlash2 and MTP drafting, a prefix cache and 128K context. It is built from source and serves one request at a time: docs/arc-b70.md.
  • XQ model: BHCC2025/Qwen3.8-27B-XQ-5.0bpw-mix, fetched and sha256-checked by scripts/fetch-models.sh xq.
  • fe-server: streamed responses declare charset=utf-8, and engines may report their own timings.
  • A CHANGELOG.md.

Install on a DGX Spark (one line):

curl -fsSL https://raw.githubusercontent.com/BHCC2025/ferrite/main/scripts/install.sh | bash

Assets

  • ferrite-0.2.0-dgx-spark-aarch64.tar.gz: prebuilt binaries for DGX Spark (aarch64, CUDA 13, kernels for sm_121a) plus scripts and docs. No Rust toolchain needed. The Arc Pro B70 engine is not in this package; build it from source.
  • ferrite-0.2.0-dgx-spark-aarch64.tar.gz.sha256: its checksum (sha256sum -c).

Requirements, settings and benchmarks: docs/quickstart.md, docs/benchmarks.md. Credits: CREDITS.md.

Assets 4
Loading