Skip to content

v0.9.0 — fused decode attention, resident KV (κ move semantics), κ-leases

Choose a tag to compare

@afflom afflom released this 12 Jul 12:40
· 261 commits to main since this release

Hologram v0.9.0

Installation

Via Git Dependency

Add to your Cargo.toml:

[dependencies]
# Depend on the specific crates you need (all share one version):
hologram-compiler = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.9.0" }
hologram-exec     = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.9.0" }
hologram-backend  = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.9.0" }

CLI Binary

Download the appropriate binary for your platform from the assets below and add it to your PATH.

Changes

Commits since v0.8.2

  • feat(exec)!: kappa-leases, pinned total semantics, the flow law, and exact confinement (22b0ce1)
  • feat(exec): resident KV — KvCacheWrite with kappa move semantics; no per-step re-hash (82763f1)
  • feat(backend)!: fused, pooled, KV-cache-aware masked decode attention (326ff2d)

What's Changed

  • feat(backend)!: fused, pooled, KV-cache-aware masked decode attention (v0.9.0) by @afflom in #41

Full Changelog: v0.8.2...v0.9.0