Skip to content

embeddinggemma.c v0.2.3

Choose a tag to compare

View all tags
@ehartford ehartford released this 20 Jul 17:33
v0.2.3
16400ee

v0.2.3 adds the optimized Intel XPU SYCL backend, completes the cross-platform
benchmark documentation, and ships the first installer-aware XPU release.
Release assets are raw executables; GitHub provides source archives separately.
Model weights are not included.

Binaries

  • embeddinggemma-darwin-arm64-cpu: Apple Silicon CPU server.
  • embeddinggemma-darwin-arm64-metal: Apple Silicon Metal server with the
    compiled Metal library embedded in the executable.
  • embeddinggemma-linux-x86_64-cpu: Linux x86-64 CPU server.
  • embeddinggemma-linux-x86_64-cuda: Linux x86-64 CUDA server with native cubins
    for every architecture supported by CUDA 12.9, plus newest-target PTX.
  • embeddinggemma-linux-x86_64-xpu: Linux x86-64 oneAPI XPU SYCL server with
    PVC/BMG device images and runtime-gated Xe2 Flash, W4A16, command-graph, and
    register-cached RMS optimizations.
  • SHA256SUMS: SHA-256 checksums for all five executables.

The installer saves the selected release binary as ~/.local/bin/quixiembed:

curl -fsSL https://raw.githubusercontent.com/QuixiAI/embeddinggemma.c/main/install.sh | sh

Runtime Requirements

The Darwin binaries target macOS 14.0 or newer and are ad-hoc signed. The Metal
binary has no metallib sidecar. Linux model acquisition invokes an available
curl or wget command and has no linked libcurl dependency.

The CUDA binary requires CUDA 12 runtime libraries and an NVIDIA driver. It
contains native SM50, SM52, SM53, SM60, SM61, SM62, SM70, SM72, SM75, SM80,
SM86, SM87, SM89, SM90, SM100, SM101, SM103, SM120, and SM121 code plus
compute_121 PTX.

The XPU binary requires the Intel oneAPI 2026.1 SYCL/oneMKL runtime and a Level
Zero driver. It was validated on Intel Arc Pro B60; BMG-specific routes are
enabled only after an exact runtime architecture check.

Validation

  • CPU, Metal, CUDA, and XPU pass all 10 llama.cpp golden embeddings.
  • Packed-batch and backend-specific kernel parity suites pass.
  • The stripped release executables pass HTTP Matryoshka dimensions 768, 512,
    256, and 128 on their native validation hosts.
  • Metal loads its embedded kernels with no sidecar.
  • CUDA contains all 19 advertised cubins and its PTX fallback.
  • XPU was rebuilt from the pinned vLLM XPU kernel and SYCL-TLA commits.

The README now records comparable warmed engine throughput for Apple M5 Max
CPU/Metal, RTX 3090 CUDA, and Arc Pro B60 XPU, together with concurrent and
packed short-request throughput.

Assets 8
Loading