v0.10.0 — valid_len scalar decode attention (κ121) + concurrent-session soundness
Hologram v0.10.0
Installation
Via Git Dependency
Add to your Cargo.toml:
[dependencies]
# Depend on the specific crates you need (all share one version):
hologram-compiler = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.10.0" }
hologram-exec = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.10.0" }
hologram-backend = { git = "https://github.com/Hologram-Technologies/hologram", tag = "v0.10.0" }CLI Binary
Download the appropriate binary for your platform from the assets below and add it to your PATH.
Changes
Commits since v0.9.0
- refactor(backend): move the kappa-121 kernel suite to the end of float_kernels.rs (47a4955)
- feat(backend)!: valid_len scalar decode attention — the last O(bucket) per-token input becomes 4 bytes (e49e41d)
- fix(backend): one batch owns the pool — concurrent sessions are sound (485b2b9)
What's Changed
- feat(backend)!: valid_len scalar decode attention (κ121) + concurrent-pool soundness (v0.10.0) by @afflom in #43
Full Changelog: v0.9.0...v0.10.0