Skip to content

v0.10.0 — valid_len scalar decode attention (κ121) + concurrent-session soundness

Choose a tag to compare

@afflom afflom released this 14 Jul 03:56
· 258 commits to main since this release

Hologram v0.10.0

Installation

Via Git Dependency

Add to your Cargo.toml:

[dependencies]
# Depend on the specific crates you need (all share one version):
hologram-compiler = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.10.0" }
hologram-exec     = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.10.0" }
hologram-backend  = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.10.0" }

CLI Binary

Download the appropriate binary for your platform from the assets below and add it to your PATH.

Changes

Commits since v0.9.0

  • refactor(backend): move the kappa-121 kernel suite to the end of float_kernels.rs (47a4955)
  • feat(backend)!: valid_len scalar decode attention — the last O(bucket) per-token input becomes 4 bytes (e49e41d)
  • fix(backend): one batch owns the pool — concurrent sessions are sound (485b2b9)

What's Changed

  • feat(backend)!: valid_len scalar decode attention (κ121) + concurrent-pool soundness (v0.10.0) by @afflom in #43

Full Changelog: v0.9.0...v0.10.0