Skip to content

v0.4.0

Choose a tag to compare

@github-actions github-actions released this 27 Oct 11:31
· 254 commits to main since this release
3a37d32

Basalt v0.4.0

brew tap goodmai/basalt https://github.com/goodmai/basalt
brew install goodmai/basalt/basalt

Builds from source: Xcode 26.4+ (Swift 6.3) and a macOS it runs on, Apple Silicon.

Source tarball SHA256: 06a6e3d88dba0c6d60f38521ac60ecb36114effa8d8958bd5062542758b054ab

What's Changed

  • chore: point formula at v0.3.0; fix the release formula push by @goodmai in #70
  • feat(sampling): entropy-based dynamic temperature, per-request min_p (#40) by @goodmai in #69
  • docs: CONTRIBUTING — no comments in code, enforced in CI by @goodmai in #71
  • feat(cache): prefix KV-cache reuse per conversation slot (#56) by @goodmai in #77
  • feat(cache): radix prefix tree for the prompt KV cache (#32) by @goodmai in #80
  • feat(cache): prefix reuse for hybrid models via SSM state snapshots (#79) by @goodmai in #82
  • fix(memory): one KV-cache geometry for every memory estimate (#75) by @goodmai in #84
  • feat(cache): CacheBlend non-prefix KV reuse, opt-in (#36) by @goodmai in #83
  • fix(security): loopback Host/Origin/Content-Type guard; REST model ids only (#72) by @goodmai in #92
  • feat(api): tool calling on /v1/messages and /v1/chat/completions (#73) by @goodmai in #93
  • fix(arc-agi): run hybrid-mode generated code in a sandboxed child (#78) by @goodmai in #94
  • feat(harness): Harness² PoC — KV-cache reuse plan, Claude SKILL.md parser & MCP ExperienceLibrary (#90) by @goodmai in #91
  • fix(api): send chat turns as messages through the native chat template (#86) by @goodmai in #97
  • fix(models): run Nemotron-H Nano 4B and Nano 9B v2 out of the box (#100) by @goodmai in #101
  • feat: thinking budget, model sampling defaults and reasoning_effort; ARC prompt fixes (#105) by @goodmai in #107
  • fix(mcp): remove playwright_screenshot, which interpolated the url into Python (#67) by @goodmai in #108
  • fix(cache): prompt-cache reuse for VLM-loaded models on text-only chats (#103) by @goodmai in #109
  • feat(inference): grammar-constrained JSON decoding via XGrammar (response_format, forced tool calls) (#42) by @goodmai in #110
  • fix(cloud): ModelRouter routes to the chosen local model, surfaces cloud stream errors, reads free RAM (#89) by @goodmai in #112
  • feat(cloud): calibrated Bradley–Terry routing with cache stickiness, session/key budgets, deterministic fallback chain (#34) by @goodmai in #115
  • fix(inference): stop verbatim loops in the generation loop; decode CacheBlend token texts outside the lock (#87) by @goodmai in #116
  • fix(models): LFM2.5 MoE out of the box: thinking_budget and generation_config repetition_penalty (#113) by @goodmai in #114
  • feat(hybrid): local ↔ cloud arbiter in the orchestrator, OpenAI-compatible fallback endpoint, switchable in the config (#22) by @goodmai in #117
  • feat(serve): cost routing flags, x-session-id stickiness, virtual keys with budgets (#34) by @goodmai in #118
  • fix(memory): max_tokens is capped by the KV room; --max-tokens is a ceiling; weights counted once (#85) by @goodmai in #119
  • fix(orchestrator): bounded concurrent generations, single-flight model switch, drain on shutdown (#74) by @goodmai in #120
  • fix(api): refuse a full queue (503) or an oversized prompt (413) before the SSE starts (#121) by @goodmai in #122
  • fix(inference): drop the newlines that open the answer after (#123) by @goodmai in #124
  • fix(memory): models check judges the fit on the Metal working set, not momentary free memory (#125) by @goodmai in #126
  • fix(security): control tokens in message text cannot forge chat turns (#99) by @goodmai in #127
  • fix(arc-agi): numpy transforms get the matrix, not a Grid object (#96) by @goodmai in #128
  • deps: Hummingbird 2.28 (cap lifted), swift-jinja 2.5.2, swift-service-lifecycle 2.13 and transitive minor bumps by @goodmai in #129
  • release: 0.4.0 — version bump, CHANGELOG by @goodmai in #130

Full Changelog: v0.3.0...v0.4.0