kinfer v0.2.2

Ollama's MLX models — NVFP4, as Ollama 0.40 pulls them — are listed and served where they lie.

curl -fsSL https://raw.githubusercontent.com/LocalKinAI/kinfer/main/scripts/install.sh | sh

• Ollama's MLX models. Ollama 0.40 keeps an MLX model as a blob per tensor, so kinfer list showed only Ollama's GGUFs. Now it shows qwen3.8:27b-mlx … ollama, MLX too, and serves it. kinfer keeps a directory of symbolic links to the blobs, in ~/Library/Caches/kinfer/ollama-mlx, with the chat template written out. Nothing is copied, nothing of Ollama's is touched, and kinfer rm points at ollama rm.
• NVFP4. The MLX engine reads NVIDIA's NVFP4 as ModelOpt exports it — 4-bit floats, an FP8 scale for each 16, a scale for the whole weight — beside bf16 and MLX 4-bit.

qwen3.8:27b-mlx on a MacBook Pro (M5 Max), the same blobs	Ollama 0.40.14	kinfer
decode	53–99 tok/s, with MTP drafting	30.2–31.0 tok/s
a 7,753-token prompt	794 tok/s	662 tok/s

The replies give the same answers as Ollama's, word for word at first and then in other words, as two engines' rounding makes greedy replies part. kinfer's MLX engine does not draft with the MTP head yet, which is most of the decode difference.

The patched libraries are unchanged (darwin_arm64_b11998k6). CHANGELOG.md

kinfer-v0.2.2-darwin-arm64.tar.gz sha256 f36ad5f1923d51539df9ca3e39536e51001452bddf296882b91f06fa0d57ded4