Skip to content

SibillaOS v0.1.0

Choose a tag to compare

View all tags
@engineering87 engineering87 released this 05 Jul 17:52
· 9 commits to main since this release
v0.1.0
06f3f01

First public release. SibillaOS is a Linux distribution based on Ubuntu 24.04 LTS that ships with a local LLM: install it, and the machine serves an OpenAI-compatible API from its first boot.

What this release does

The installer walks you through the standard Ubuntu screens (locale, keyboard, network, disk, your own user and password). Everything LLM-related happens automatically: the system detects your hardware, selects an inference engine (vLLM in a container on datacenter GPUs with 24 GB of VRAM or more, Ollama everywhere else, CPU-only machines included), asks llmfit which model actually fits your memory, downloads it from Hugging Face and brings up an authenticated gateway on port 8080.

After installation:

$ sibilla-model status
engine:  ollama
model:   hf.co/bartowski/Qwen_Qwen3-4B-GGUF
api:     http://192.168.1.50:8080 (key in /etc/llmd/apikey)

$ curl http://192.168.1.50:8080/v1/chat/completions \
    -H "Authorization: Bearer $(sudo cat /etc/llmd/apikey)" \
    -d '{"model": "default", "messages": [{"role": "user", "content": "hello"}]}'

sibilla-model list shows the curated models that fit your machine; sibilla-model use ID downloads and switches the served model.

What has been verified

Every commit on main goes through a pipeline that builds the ISO, boots it under both BIOS and UEFI firmware, performs a complete unattended installation in a virtual machine, reboots into the installed system, downloads a model and obtains a real chat completion through the authenticated gateway. This release is cut from a fully green pipeline. Engine versions are pinned (Ollama 0.31.1, llmfit 0.9.36) and the Ubuntu base image is verified against its official checksums during the build.

Installation

GitHub caps release assets at 2 GiB, so the ISO is published in parts. Download all .part files and SHA256SUMS, reassemble, verify, then write the image to a USB drive:

$ cat sibillaos-0.1.0-amd64.iso.part* > sibillaos-0.1.0-amd64.iso
$ sha256sum -c SHA256SUMS
$ sudo dd if=sibillaos-0.1.0-amd64.iso of=/dev/sdX bs=4M status=progress

Boot from the drive and select "Install SibillaOS (automated)". A wired network connection during installation is recommended: the model download starts during install and resumes at first boot if interrupted. Minimum practical requirements: 8 GB of RAM, 25 GB of disk, and either a supported GPU or patience with CPU inference.

Known limitations

The gateway serves plain HTTP with a mandatory bearer token. Do not expose port 8080 beyond your LAN; TLS termination is planned for a future release together with a hostname setup step. The vLLM path (datacenter GPUs) is implemented but has not yet been exercised on physical GPU hardware; reports are welcome. The curated catalog only contains permissively licensed, non-gated models; gated models (Llama, Gemma) require a Hugging Face token and are not supported yet. Sharded GGUF repositories are not supported by the Ollama pull path.

Licensing

SibillaOS components are licensed under Apache-2.0. The image bundles vLLM (Apache-2.0), Ollama (MIT) and llmfit (MIT); NVIDIA drivers are installed from the Ubuntu restricted component and are not redistributed by this project. Models are downloaded by the user from Hugging Face under their respective licenses.

Checksums

See the attached SHA256SUMS file.

Full Changelog: https://github.com/engineering87/sibillaos/commits/v0.1.0

Assets 5
Loading