Repository navigation
Linux serving engines for pip install lifeboat, built against an OLD glibc so they run on the long-term releases still in service.
Upstream builds every prebuilt Linux asset on the current Ubuntu, so those binaries need GLIBC_2.38 / GLIBCXX_3.4.32 — measured failing on a Jetson Orin (JetPack 6 = Ubuntu 22.04, glibc 2.35 / GLIBCXX 3.4.30). That floor excludes Ubuntu 22.04, JetPack 6, Debian 12, and RHEL 9 with its Rocky, AlmaLinux and Oracle Linux rebuilds — and none of them can raise the runtime from its own repositories.
These are compiled in manylinux_2_28 (glibc 2.28). glibc is forward-compatible only, so a binary linked there runs on everything above it.
| asset | highest symbol required |
|---|---|
| linux-x86_64 | GLIBC_2.27 |
| linux-aarch64 | GLIBC_2.27, GLIBCXX_3.4.25 |
Both carry the Vulkan backend plus every CPU variant as loadable modules (GGML_BACKEND_DL), so one artifact offloads to NVIDIA, AMD or Intel where a Vulkan loader exists and falls back to CPU where it does not. Verified on a Jetson Orin: zero missing libraries and Vulkan0: NVIDIA Tegra Orin.
Built from llama.cpp f805c57a2d0b7cc171e599303ce2040f6e1bfe15 — the same commit for both architectures.