Skip to content

Celiums BitNet Runtime 0.3.0

Choose a tag to compare

View all tags
@terrizoaguimor terrizoaguimor released this 21 Aug 04:48
· 11 commits to main since this release
v0.3.0
24bfe05
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Celiums BitNet Runtime 0.3.0 adds a complete local AI product layer around the strict CPU runtime.

Highlights

  • Adds the optional Celiums Runtime Gateway with authenticated Hyphae UDS.
  • Adds scoped local knowledge and memory with BM25, exact vector, HNSW ANN, and hybrid retrieval.
  • Adds RAG completion receipts, idempotent request state, semantic cache, proof/witness generation, and offline semantic verification.
  • Adds artifact, dataset, lineage, run, evaluation, contamination, and hard-negative registry surfaces.
  • Adds a separate MCP stdio adapter for retrieval, RAG, memory, and receipt verification.
  • Formalizes the I2_S/I8_S numerical contract, including 128-value packing, activation quantization, unsigned-code correction, zero-row recovery, accumulator scope, and squared-ReLU FFN semantics.
  • Preserves the experimental C ABI v1 and the celiums-bitnet run/serve/bench/validate/version commands.

Supported Runtime

  • Certified fixture: microsoft/BitNet-b1.58-2B-4T
  • Architecture: bitnet-b1.58
  • Format: GGUF v3 MOSTLY_I2_S (file type 41)
  • Validated model SHA-256: e23b16fa81b890e8b65e676262b645e8ffa5ae1f6df89dadaf793246826bbd90
  • Release platform: Linux x86-64, built on Ubuntu 24.04

Assets

  • native: built with -march=native; use only on the same CPU class as the release builder.
  • avx2: x86-64 SSE4.2/AVX/AVX2/FMA/F16C, with AVX-VNNI, AVX-512, and AMX disabled.
  • scalar: compatibility and correctness fallback without the AVX product profile.

Each archive has a matching JSON manifest containing product and engine provenance, compiler identities, Rust and Hyphae versions, Cargo lock digest, and archive SHA-256. Verify the archive against its manifest before extraction.

CPU profile portability does not guarantee compatibility with Linux userspaces older than the Ubuntu 24.04 release builder.

Validation

  • Main CI is green for native, AVX2, scalar, sanitizers, Python, gateway, and package jobs.
  • The model-backed release gate passed for native, AVX2, and scalar profiles.
  • Full-vocabulary logits matched the fixed converted-model oracle bitwise.
  • Gateway E2E tests cover authenticated Hyphae, lexical/exact/ANN/hybrid retrieval, proof verification, HTTP pass-through/RAG, and idempotency.

See README.md, docs/NUMERICAL_CONTRACT.md, and docs/LOCAL_AI_GATEWAY.md for complete capabilities, deployment instructions, and non-claims.

Assets 8
Loading