v1.8.0
What's Changed
- Fix/gemma4 reasoning open optional newline by @cubist38 in #277
- Feature/kv cache quantization by @cubist38 in #278
- Feature/continuous batching by @cubist38 in #285
- chore: clean up schema enums and README footer by @lyonsno in #254
- fix: resolve on-demand text model for omitted-model responses with non-text fallback by @lyonsno in #258
- feat: add disk-backed prompt KV cache support by @cubist38 in #286
- Fix/generation config sampling defaults by @cubist38 in #288
- docs: add feature launch section for Darwin 36B Opus model by @cubist38 in #289
Full Changelog: v1.7.1...v1.8.0