Skip to content

v0.19.5

Latest

Choose a tag to compare

@github-actions github-actions released this 26 Oct 10:47

Oriel 0.19.5

Added

  • llama.ChatTemplates.Options takes the rest of llama.cpp's sampler:
    top_p, top_k, min_p, and the presence, frequency and repeat
    penalties (with penalty_last_n). Their defaults are llama.cpp's, so an
    answer samples as before unless a field is set. Agents on a small
    thinking model need them: near-greedy sampling without a penalty makes it
    repeat itself, calling the same tool turn after turn.