Skip to content

v0.8.0

Choose a tag to compare

@github-actions github-actions released this 01 Nov 20:46
· 202 commits to main since this release
5d50959

Basalt v0.8.0

brew tap goodmai/basalt https://github.com/goodmai/basalt
brew trust goodmai/basalt
brew install goodmai/basalt/basalt

Builds from source: Xcode 27.0+ (Swift 6.4) and macOS 27+, Apple Silicon.

Source tarball SHA256: d92a7736971da20ef9d5961b92c07cad91e1e0d7e6cee8f488ee4f422b58008b

What's Changed

  • chore: point formula at v0.7.0 by @github-actions[bot] in #169
  • feat(kv): experimental L2-norm key eviction in the zoned cache (#43) by @goodmai in #170
  • feat(speculative): opt-in Token Recycling chain drafts for prompt lookup (#38) by @goodmai in #173
  • feat(speculative): prompt lookup on dense recurrent hybrids via snapshot and replay (#162) by @goodmai in #180
  • Persist the prompt cache to disk so a resumed session skips the prefill; basalt chat reuses KV between turns (#174) by @goodmai in #181
  • Reseed the Nemotron-H lookup fixture off a near-tie and pin the margin (#162, #180) by @goodmai in #183
  • Continue a trailing assistant message instead of answering it in a new turn (#98) by @goodmai in #182
  • docs(contributing): Swift 6.4, types first, performance, smallest change by @goodmai in #184
  • chore(toolchain): move to Swift 6.4 (Xcode 27) (#185) by @goodmai in #186
  • fix(serve): shield shutdown from cancellation and drain MCP-only serve (#187) by @goodmai in #191
  • fix(inference): ~Copyable single-owner guards for PromptCacheLease, flock, and GPU lock (#188) by @goodmai in #192
  • test: Swift Testing 6.4 repetition gate, CustomTestReflectable token diffs, and drop XCTest (#189) by @goodmai in #193
  • fix(inference): safe RawSpan safetensors header parsing and zero per-token scratch allocation (#190) by @goodmai in #194
  • ci: pin GitHub Actions to full SHAs, reuse main test results, header-aware metallib freshness (#63) by @goodmai in #195
  • fix(rest): provider-accurate error envelopes, Retry-After headers, and pre-stream failures (#76) by @goodmai in #196
  • feat(ratelimit): per-client token buckets, separate burst size, and bounded LRU eviction (#62) by @goodmai in #197
  • refactor(arch): finish Basalt* split, drop Sources/mlx, migrate Gem names (#64) by @goodmai in #198
  • refactor(ui): drop Splash dependency and eliminate AppKit linkage from CLI (#65) by @goodmai in #199
  • perf(lookup): back off and adapt draft limit on low-yield drafts (#172) by @goodmai in #200
  • [P2] Grammar jump-forward for constrained decoding (#175) by @goodmai in #201
  • fix(audit): 59-point post-v0.7 audit, token recycling, forced spans, and file modes by @goodmai in #202
  • release: 0.8.0 — MTPLX compatibility (Bonsai 2, --mtp), version bump, CHANGELOG by @goodmai in #203

Full Changelog: v0.7.0...v0.8.0