Repository navigation
kern 0.3.1
Prebuilt kern for Linux x86_64 and aarch64, glibc 2.39 or newer (Ubuntu 24.04).
Needs an NVIDIA driver that supports CUDA 13 (r580 or newer) and cuBLAS 13 on the
loader path; no toolkit, no Python.
Install the latest release, or this one with KERN_VERSION=v0.3.1:
curl -fsSL https://kern-baa.pages.dev/install.sh | sh
The Python runtime and the vLLM and SGLang plugins, for Python 3.10 or newer and
glibc 2.28 or newer:
pip install kern-llm==0.3.1
What's Changed
- release: the notes say the binaries need glibc 2.39, the wheel 2.28 by @xiaguan in #60
- kern-py: a plugin reads weights from the engine's model id, a directory or a Hugging Face repo by @xiaguan in #61
Full Changelog: v0.3.0...v0.3.1