Repository navigation
llama-runtime 0.6.0: optional Tailscale/Headscale transport
Adds an optional userspace Tailscale/Headscale transport for the existing llama.cpp HTTP client. Applications own configuration, credentials and node state through TailnetConfig and TailnetHelper; the library does not require a system VPN installation. Existing package/import names and default HTTP behavior are preserved.
The helper provides an authenticated loopback proxy, verified peer routing, end-to-end TLS through CONNECT, per-request cancellation and bounded drained shutdown. Generation, embeddings and model discovery share the explicit route. Native helpers pin Go 1.27.1 and Tailscale 1.104.1, omit the web UI and contain no working-tree VCS metadata.
Assets include the universal Python wheel, normalized source archive, separate macOS ARM64 / Linux AMD64 / Windows AMD64 helper archives with complete license notices, RELEASE-MANIFEST.json and SHA256SUMS.
Validation: 967 Python tests; 121 focused tests on Python 3.14; Go 20 top-level tests plus 16 subtests, race detector, vet and formatting; clean installed-wheel and real native offline smoke; source, archive, license and privacy checks. Linux/Windows helpers were crossbuilt. This release makes no claim of live VPN enrollment/inference, execution on Linux/Windows or new CI coverage.