Skip to content

TUFF 9.1.1

Choose a tag to compare

@rexmhall09 rexmhall09 released this 14 Oct 06:44
· 19 commits to main since this release

TUFF 9.1.1 lets saved chats pick up where they left off.

Before, reopening a long chat after quitting TUFF or switching models meant reading the whole conversation again. Now TUFF saves the chat's state to disk and resumes from it.

On a 16 GB M2 Air, a follow-up in a 3,300-token chat after reloading the model:

Model Before Now Saved state
Gemma 4 26B-A4B 114 s 6.8 s 334 MB
Qwen 3.6 35B-A3B 157 s 7.8 s 132 MB
GPT-OSS 20B 155 s 10.3 s 91 MB
  • Only chats of 1,024 tokens or more are saved, and a chat is saved again only after it has grown by a quarter, so a long chat is written a few times, not after every reply.
  • Saved state lives in TUFF's cache (2 GB limit, oldest removed first). It's deleted when you delete the chat or edit an earlier message.
  • Set TUFF_SAVED_CHATS=off to keep chat state in memory only.
  • All engines are now 1.0.17 and download the next time you load a model.