Repository navigation
Welcome to the v1.17.0 release of Kit! This release adds support for ModelKit indexes and improves how kit unpack handles remote references.
Breaking Changes
- The
sizefield inkit list --format jsonoutput is now an integer number of bytes rather than a human-readable string (e.g.7168instead of"7.0 KiB"), which is easier to work with in scripts. The table output ofkit listis unchanged.
New Features
ModelKit indexes
KitOps v1.17.0 adds ModelKit indexes. Similar to OCI image indexes, which group builds of one image for different platforms, a ModelKit index groups variants of one model (e.g. different quantizations) under a single reference. That reference can be shared as-is, and the format leaves room for automation that picks a variant based on the runtime environment, such as available VRAM.
Indexes are managed with the new kit index command and its subcommands create, add, remove, delete, list, info, inspect, push, and pull. Each ModelKit in an index can carry labels, which are used to select a ModelKit from the index. To create an index and add ModelKits to it:
kit index create my-org/my-model:all
kit index add my-org/my-model:all my-org/my-model:q4_0 -l quantization=q4_0 -l vram=6GB
kit index add my-org/my-model:all my-org/my-model:q8_0 -l quantization=q8_0 -l vram=10GBModelKits in an index must be in the same repository as the index, but they don't need to be stored locally: kit index add --remote adds a ModelKit that's only in the remote registry, so you can create an index for an existing model without downloading it. kit index push and kit index pull share the index itself; each ModelKit in an index must already be in the registry when the index is pushed.
kit pull and kit unpack now accept an index reference along with a -l (--label) selector that matches exactly one ModelKit in the index:
kit unpack my-org/my-model:all -l quantization=q4_0 -d ./my-modelWhen you pull a ModelKit from an index, it is tagged locally with the index's tag, similar to how docker pull handles image indexes. To see which ModelKits an index contains and their labels, use kit index info (add --remote for an index that isn't stored locally, and --format json for scripting).
For more information, see kit index --help, or PR #1292
Significant Changes
kit unpacknow verifies the digest of every layer it unpacks. Previously, data unpacked directly from a remote registry wasn't verified as thoroughly as ModelKits pulled withkit pullfirst. Additionally, if unpacking a layer fails for any reason, including a digest mismatch, the files already unpacked from that layer are removed so a failed unpack doesn't look complete. See PR #1300 for details.
Bug Fixes
- Always include layers field, even if there are no layers in ModelKit by @amisevsk in #1291
- Handle duplicate files when packing ModelKits as raw layers by @amisevsk in #1293
Full Changelog: v1.16.0...v1.17.0