Skip to content

Release v1.17.0

Latest

Choose a tag to compare

@github-actions github-actions released this 06 Nov 21:38
· 10 commits to main since this release

Welcome to the v1.17.0 release of Kit! This release adds support for ModelKit indexes and improves how kit unpack handles remote references.

Breaking Changes

  • The size field in kit list --format json output is now an integer number of bytes rather than a human-readable string (e.g. 7168 instead of "7.0 KiB"), which is easier to work with in scripts. The table output of kit list is unchanged.

New Features

ModelKit indexes

KitOps v1.17.0 adds ModelKit indexes. Similar to OCI image indexes, which group builds of one image for different platforms, a ModelKit index groups variants of one model (e.g. different quantizations) under a single reference. That reference can be shared as-is, and the format leaves room for automation that picks a variant based on the runtime environment, such as available VRAM.

Indexes are managed with the new kit index command and its subcommands create, add, remove, delete, list, info, inspect, push, and pull. Each ModelKit in an index can carry labels, which are used to select a ModelKit from the index. To create an index and add ModelKits to it:

kit index create my-org/my-model:all
kit index add my-org/my-model:all my-org/my-model:q4_0 -l quantization=q4_0 -l vram=6GB
kit index add my-org/my-model:all my-org/my-model:q8_0 -l quantization=q8_0 -l vram=10GB

ModelKits in an index must be in the same repository as the index, but they don't need to be stored locally: kit index add --remote adds a ModelKit that's only in the remote registry, so you can create an index for an existing model without downloading it. kit index push and kit index pull share the index itself; each ModelKit in an index must already be in the registry when the index is pushed.

kit pull and kit unpack now accept an index reference along with a -l (--label) selector that matches exactly one ModelKit in the index:

kit unpack my-org/my-model:all -l quantization=q4_0 -d ./my-model

When you pull a ModelKit from an index, it is tagged locally with the index's tag, similar to how docker pull handles image indexes. To see which ModelKits an index contains and their labels, use kit index info (add --remote for an index that isn't stored locally, and --format json for scripting).

For more information, see kit index --help, or PR #1292

Significant Changes

  • kit unpack now verifies the digest of every layer it unpacks. Previously, data unpacked directly from a remote registry wasn't verified as thoroughly as ModelKits pulled with kit pull first. Additionally, if unpacking a layer fails for any reason, including a digest mismatch, the files already unpacked from that layer are removed so a failed unpack doesn't look complete. See PR #1300 for details.

Bug Fixes

  • Always include layers field, even if there are no layers in ModelKit by @amisevsk in #1291
  • Handle duplicate files when packing ModelKits as raw layers by @amisevsk in #1293

Full Changelog: v1.16.0...v1.17.0