Repository navigation
v1.2.0 - 2026-07-24
Release Notes
A native runtime for Apple's on-device model (#4). hedos now serves Apple Intelligence directly through the FoundationModels framework, so the model built into the machine appears on the shelf and answers chat and completion requests over the gateway with no download and no sidecar.
- The runtime bridges Rust to the framework through a small Swift shim, streaming the model's output back over the gateway in every dialect. When Apple Intelligence is turned off or still downloading, the shelf says so instead of silently omitting the model.
- Tool calling works end to end. Apple's model executes tools during generation, so the runtime captures each call as a structured
tool_call, ends the turn, and replays the result on the next request as tool-call and tool-output history. Tool parameter schemas port into the framework's dynamic schema — strings, numbers, booleans, enums, arrays, and nested objects with required and optional fields — and a tool whose schema the framework cannot express is dropped from the offer rather than failing the request. - Apple's on-device model has a fixed 4096-token context window. hedos records that window honestly on the shelf and in
/v1/models, and warns at pick time when a model's window is too tight for the request ahead of it, instead of letting the run fail deep in the model with a context error.
Install hedos 1.2.0
Install prebuilt binaries via Homebrew
brew install theiskaa/tap/hedosDownload hedos 1.2.0
| File | Platform | Checksum |
|---|---|---|
| hedos-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum |
| hedos-x86_64-apple-darwin.tar.xz | Intel macOS | checksum |
| hedos-aarch64-unknown-linux-gnu.tar.xz | ARM64 Linux | checksum |
| hedos-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |