Repository navigation
v0.4.0
Basalt v0.4.0
brew tap goodmai/basalt https://github.com/goodmai/basalt
brew install goodmai/basalt/basaltBuilds from source: Xcode 26.4+ (Swift 6.3) and a macOS it runs on, Apple Silicon.
Source tarball SHA256: 06a6e3d88dba0c6d60f38521ac60ecb36114effa8d8958bd5062542758b054ab
What's Changed
- chore: point formula at v0.3.0; fix the release formula push by @goodmai in #70
- feat(sampling): entropy-based dynamic temperature, per-request min_p (#40) by @goodmai in #69
- docs: CONTRIBUTING — no comments in code, enforced in CI by @goodmai in #71
- feat(cache): prefix KV-cache reuse per conversation slot (#56) by @goodmai in #77
- feat(cache): radix prefix tree for the prompt KV cache (#32) by @goodmai in #80
- feat(cache): prefix reuse for hybrid models via SSM state snapshots (#79) by @goodmai in #82
- fix(memory): one KV-cache geometry for every memory estimate (#75) by @goodmai in #84
- feat(cache): CacheBlend non-prefix KV reuse, opt-in (#36) by @goodmai in #83
- fix(security): loopback Host/Origin/Content-Type guard; REST model ids only (#72) by @goodmai in #92
- feat(api): tool calling on /v1/messages and /v1/chat/completions (#73) by @goodmai in #93
- fix(arc-agi): run hybrid-mode generated code in a sandboxed child (#78) by @goodmai in #94
- feat(harness): Harness² PoC — KV-cache reuse plan, Claude SKILL.md parser & MCP ExperienceLibrary (#90) by @goodmai in #91
- fix(api): send chat turns as messages through the native chat template (#86) by @goodmai in #97
- fix(models): run Nemotron-H Nano 4B and Nano 9B v2 out of the box (#100) by @goodmai in #101
- feat: thinking budget, model sampling defaults and reasoning_effort; ARC prompt fixes (#105) by @goodmai in #107
- fix(mcp): remove playwright_screenshot, which interpolated the url into Python (#67) by @goodmai in #108
- fix(cache): prompt-cache reuse for VLM-loaded models on text-only chats (#103) by @goodmai in #109
- feat(inference): grammar-constrained JSON decoding via XGrammar (response_format, forced tool calls) (#42) by @goodmai in #110
- fix(cloud): ModelRouter routes to the chosen local model, surfaces cloud stream errors, reads free RAM (#89) by @goodmai in #112
- feat(cloud): calibrated Bradley–Terry routing with cache stickiness, session/key budgets, deterministic fallback chain (#34) by @goodmai in #115
- fix(inference): stop verbatim loops in the generation loop; decode CacheBlend token texts outside the lock (#87) by @goodmai in #116
- fix(models): LFM2.5 MoE out of the box: thinking_budget and generation_config repetition_penalty (#113) by @goodmai in #114
- feat(hybrid): local ↔ cloud arbiter in the orchestrator, OpenAI-compatible fallback endpoint, switchable in the config (#22) by @goodmai in #117
- feat(serve): cost routing flags, x-session-id stickiness, virtual keys with budgets (#34) by @goodmai in #118
- fix(memory): max_tokens is capped by the KV room; --max-tokens is a ceiling; weights counted once (#85) by @goodmai in #119
- fix(orchestrator): bounded concurrent generations, single-flight model switch, drain on shutdown (#74) by @goodmai in #120
- fix(api): refuse a full queue (503) or an oversized prompt (413) before the SSE starts (#121) by @goodmai in #122
- fix(inference): drop the newlines that open the answer after (#123) by @goodmai in #124
- fix(memory): models check judges the fit on the Metal working set, not momentary free memory (#125) by @goodmai in #126
- fix(security): control tokens in message text cannot forge chat turns (#99) by @goodmai in #127
- fix(arc-agi): numpy transforms get the matrix, not a Grid object (#96) by @goodmai in #128
- deps: Hummingbird 2.28 (cap lifted), swift-jinja 2.5.2, swift-service-lifecycle 2.13 and transitive minor bumps by @goodmai in #129
- release: 0.4.0 — version bump, CHANGELOG by @goodmai in #130
Full Changelog: v0.3.0...v0.4.0