Skip to content

mac-ssi v0.3.0

Latest
Latest

Choose a tag to compare

View all tags
@dcharlot65-openie dcharlot65-openie released this 27 Jun 20:32
v0.3.0
56f0298

mac-ssi v0.3.0 — Single System Image for Apple Silicon.

Highlights since v0.2.0:

  • ssi-mlx: a pure-Rust MLX inference engine (Q4 quantized matmul, RMSNorm/RoPE/SDPA, safetensors, full transformer forward + greedy generate) on the Metal GPU — no Python.
  • Real OS page-fault distributed shared memory (mmap + SIGBUS) with coherent MOESI write-invalidation, owner-forwarding, write-back-on-eviction, single/multi-home rings — exposed as ssi memory serve/bench. Proven cross-node.
  • Distributed inference: ssi serve ggml-rpc planner; ssi inference run drives a cluster-consistent MLX stack. Distributed MLX proven across the cluster.
  • Cluster TLS/federation hardening (ECDSA P-256, source-IP bootstrap, shared-CA deploy).
  • Zero errors, zero warnings across all 16 crates; 710 tests pass.

Install: download the tarball below, extract, and run ./install.sh.
Requirements: Apple Silicon, macOS.

Assets 3
Loading