Repository navigation
TUFF 9.1.1
TUFF 9.1.1 lets saved chats pick up where they left off.
Before, reopening a long chat after quitting TUFF or switching models meant reading the whole conversation again. Now TUFF saves the chat's state to disk and resumes from it.
On a 16 GB M2 Air, a follow-up in a 3,300-token chat after reloading the model:
| Model | Before | Now | Saved state |
|---|---|---|---|
| Gemma 4 26B-A4B | 114 s | 6.8 s | 334 MB |
| Qwen 3.6 35B-A3B | 157 s | 7.8 s | 132 MB |
| GPT-OSS 20B | 155 s | 10.3 s | 91 MB |
- Only chats of 1,024 tokens or more are saved, and a chat is saved again only after it has grown by a quarter, so a long chat is written a few times, not after every reply.
- Saved state lives in TUFF's cache (2 GB limit, oldest removed first). It's deleted when you delete the chat or edit an earlier message.
- Set
TUFF_SAVED_CHATS=offto keep chat state in memory only. - All engines are now 1.0.17 and download the next time you load a model.