Skip to content

v0.9.0-dev.6

Choose a tag to compare

View all tags
@github-actions github-actions released this 30 Apr 17:43
· 59 commits to main since this release
v0.9.0-dev.6
0e17c5c 
params: expose missing llama.cpp options across sampler/context/model

- SamplerParams: Mirostat (v1/v2), grammar (incl. lazy patterns), DRY,
  XTC, dynamic temperature, adaptive-P, top-n-sigma, infill, logit
  bias, shared min_keep. SamplerFactory.build now accepts model: for
  vocab-dependent stages.
- ContextParams: RoPE scaling/freq, full YaRN knobs, pooling and
  attention type, defrag threshold, no_perf, op_offload, swa_full,
  kv_unified.
- ModelParams: split mode, main GPU, tensor split, device list, GGUF
  kv overrides (int/float/bool/str), use_direct_io, use_extra_bufts,
  no_host, no_alloc.
- README: link to aichat sample app.
- Bump to 0.9.0-dev.6 + CHANGELOG.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Assets 10
Loading