sys1rust 0.1.0

sys1rust runs Laya's System 1 decision models on an Apple silicon Mac's GPU. It is written in Rust on MLX, with custom Metal kernels and no Python at run time.

Send text and questions to its /v1/systemone API to get choices, scores and yes probabilities. The server accepts the same requests as laya serve.

Install

Give a coding agent this prompt:

Set up sys1rust on my Mac from https://github.com/krishhgg/sys1rust

Or install from a native Apple silicon terminal:

curl -fsSL https://raw.githubusercontent.com/krishhgg/sys1rust/main/install.sh | sh
~/.local/bin/sys1rust serve

The first start downloads the default typed-decisions model, 846 MB. The README has an example request and the setup, use and development instructions for coding agents.

Bundles

• sys1rust-0.1.0-macos14-arm64.tar.gz supports macOS 14.0 through 26.1.
• sys1rust-0.1.0-macos26-arm64.tar.gz supports macOS 26.2 and later.
• SHA256SUMS contains the hashes of both bundles. The installer checks the download against this file and selects the bundle for your macOS version.

Both bundles include MLX 0.32.2 and their license notices. Installation needs no Homebrew, sudo, Python or API token. Use --service to run at login and restart after a crash. Updates retain the previous version, and uninstall keeps the downloaded models.

The included models are typed-decisions, multilingual and english. The server binds to 127.0.0.1 by default.

Performance

On a base M5 with macOS 26.2 and the macOS 26 bundle, the typed-decisions model takes a median 15.5 ms for a request with one question and a 128-token state. The measured workloads are up to 4.1x faster than stock laya serve. Performance on other Mac chips has not been benchmarked.

See the README for setup and the results for the measurements and their limits.