Skip to content

kern 0.3.1

Choose a tag to compare

@github-actions github-actions released this 15 Oct 08:44
· 45 commits to master since this release

Prebuilt kern for Linux x86_64 and aarch64, glibc 2.39 or newer (Ubuntu 24.04).
Needs an NVIDIA driver that supports CUDA 13 (r580 or newer) and cuBLAS 13 on the
loader path; no toolkit, no Python.

Install the latest release, or this one with KERN_VERSION=v0.3.1:

curl -fsSL https://kern-baa.pages.dev/install.sh | sh

The Python runtime and the vLLM and SGLang plugins, for Python 3.10 or newer and
glibc 2.28 or newer:

pip install kern-llm==0.3.1

What's Changed

  • release: the notes say the binaries need glibc 2.39, the wheel 2.28 by @xiaguan in #60
  • kern-py: a plugin reads weights from the engine's model id, a directory or a Hugging Face repo by @xiaguan in #61

Full Changelog: v0.3.0...v0.3.1