Skip to content

v0.6.0

Choose a tag to compare

@benoitc benoitc released this 18 May 08:40
· 100 commits to main since this release

[0.6.0] - 2026-05-18

Added

  • erllama:continue/3 for caller-asserted chat-template continuation
    on a sticky session. Skips the prompt prefix-equality check in
    resolve_sticky_continuation so chat templates whose rendered
    prefix shifts between turns can still reuse the live KV cells.
    Caller passes the tokenised tail directly; the engine prefills
    only that tail on top of the pinned seq's stored KV. Returns
    {error, no_session} for unknown session ids and
    {error, sticky_busy} for in-flight seqs. New
    cache_hit_kind => continuation reports the path in Stats.
    Companion guide section in guides/examples.md and lifecycle
    notes in internals/request-lifecycle.md.