Skip to content

mAIndmeld 0.4.4: too-large requests shrink the model window

Choose a tag to compare

@dev-dull dev-dull released this 24 Sep 20:08
· 33 commits to main since this release

Fixed

  • A model participant that gets a 413, or a 400 naming a length or token
    limit, now halves its transcript window and retries at once instead of
    counting a failure toward a ten-minute pause; the window creeps back by
    one message per reply. Profiles take max_prompt_chars; health shows the
    effective window; single messages over 4,000 characters are clipped in
    the model's view (#28).

Image: ghcr.io/dev-dull/maindmeld:0.4.4@sha256:c3cb2480def9dda1567598d3459177d5c062849090c5769925d3b9db1d429f9f