Rulith Inference 0.3.8: long conversations are summarized instead of failing, tools in several chats at once, downloads from the chat

Rulith Inference 0.3.8 keeps long conversations going by summarizing their earlier part, lets several conversations use tools at the same time, makes the download buttons in the chat work, and gives the chat the same width as the model pages.

Long conversations no longer run out of context. A conversation that grew past the model's context (256K tokens by default) failed with "Model ran out of context size", and every later message did too. Now, when the next message would take the conversation past 80% of the context, the model first writes a summary of everything so far, and the conversation carries on from the summary and the new message; the chat says when this happens and how much smaller the conversation became. The summary is written right after the last answer, while the server still has the conversation cached, so it takes about as long as a normal answer instead of re-reading the whole conversation, and the messages after it reuse the cache as before. If you edit or delete a message the summary covers, the summary is dropped. If no summary can be made, the oldest messages are left out instead, with a note telling the model so.

Tools in several conversations at once. Two conversations that used web search at the same time could leave one of them stopped after its search: it showed its sources and never answered. Switching to another chat while a search was running also stopped it. Each conversation now runs its own tool calls and answers even while you are in another chat; only a tool call waiting for your approval stops when you leave its chat, as before.

Downloads from the chat work. The download button on a code block in an answer (issue #5), a table's CSV export and the Logs page's log saved nowhere you could see. They now save into your Downloads folder, and a notice says where, with a button to show the file.

One column width. The conversation, the chat box, the new-chat page and a project's page now use the same column as the Configuration and Logs pages: up to 1280 pixels, centred.

Everything else is 0.3.7: the same model runtime, byte for byte.