Skip to content

Releases: koksny/klif

Release list

KLIF 0.3.3

KLIF 0.3.3 Latest
Latest

Choose a tag to compare

View all tags
@koksny koksny released this 05 Oct 23:51
v0.3.3
0ede013

KLIF manages a local inference stack from one window: the language-model, image, speech, transcription, music and video servers you already run, on one machine or several. 0.3.3 is the first version published as a release, with builds for Windows, macOS and Linux.

What is in it

  • Systems. Any number of servers side by side, each a tab with its live status, the exact command line that starts it, and what it does to your GPU right now. llama.cpp, stable-diffusion.cpp, vLLM, audio.cpp and any OpenAI-compatible or other server.
  • Nine skins, each with a full window and a 960×640 layout for a small status screen. Pick one in Tune, from the tray's Skin menu, or with F2.
  • klif-cli for scripts and coding agents: one JSON document per command, and an Agent Skill (skills/klif/SKILL.md) that teaches it.
  • Other machines. A KLIF on another computer is a node: watch, launch and stop its Systems from here.
  • klif-webui, an opt-in page for a phone on your network, paired with a QR code.
  • Records and suggestions. The best speeds reached per model file and backend, and the models that fit this machine, downloaded from Hugging Face only when you ask.
  • Windows, macOS and Linux. Built and tuned for AMD GPUs on Windows, on macOS with Apple silicon, and on Linux x86_64 (tested in WSL2; the Linux GPU readers have not met real hardware yet).

Every change since 0.1 is in CHANGELOG.md.

Downloads

File For SHA-256
KLIF-0.3.3.zip Windows 10 / 11, x64 895fb651fb629ec9ad6029cb8345f032f5ec00b88e679216f06694b29c79e08a
KLIF-0.3.3-macos-arm64.zip macOS 13 or later on Apple silicon, signed and notarized b39716c4630076edd15a42be2182226fbca1d0de47a0440833a8679fd650bcc6
KLIF-0.3.3-linux-x86_64.tar.gz Linux x86_64 with WebKitGTK 4.1 5e626f17b521a749f8d3b023eb7dedda95670b6c640d41af6533cf79361cd87e

Unpack anywhere and run klif (the window) or klif-cli. KLIF ships no inference servers and no weights: it starts, watches and stops the ones you install. The README has the requirements and the first steps.

The Windows programs are not code-signed, so SmartScreen may ask once; docs/windows-defender.md explains what to check before you pass it.

Assets 8
Loading