Skip to content

v1.8.0

Choose a tag to compare

@cubist38 cubist38 released this 26 Apr 08:37
· 27 commits to main since this release

What's Changed

  • Fix/gemma4 reasoning open optional newline by @cubist38 in #277
  • Feature/kv cache quantization by @cubist38 in #278
  • Feature/continuous batching by @cubist38 in #285
  • chore: clean up schema enums and README footer by @lyonsno in #254
  • fix: resolve on-demand text model for omitted-model responses with non-text fallback by @lyonsno in #258
  • feat: add disk-backed prompt KV cache support by @cubist38 in #286
  • Fix/generation config sampling defaults by @cubist38 in #288
  • docs: add feature launch section for Darwin 36B Opus model by @cubist38 in #289

Full Changelog: v1.7.1...v1.8.0