Skip to content

v0.14.1: Ornith-9B nvfp4

Choose a tag to compare

@srvsngh99 srvsngh99 released this 27 Jun 12:52
· 131 commits to main since this release
9b6607c

Registers the Ornith-9B nvfp4 build and fixes the int4 alias.

Added

  • ornith-9b-nvfp4 model (krill pull ornith-9b-nvfp4), pulling srv-sngh/Ornith-9B-mlx-nvfp4: mixed-precision nvfp4 (group 16 base, down_proj/o_proj at 8-bit, vision tower preserved), complete-VLM weights, smaller and faster than the int4.

Fixed

  • ornith-9b int4 alias now points at the published srv-sngh/Ornith-1.0-9B-MLX-4bit.
  • nvfp4 weight loader resolves per-module 8-bit overrides under the language_model. key prefix.

Install/update: brew upgrade krill or krill update.