MegaCapybara 1.08

What's new

• See where each conversation's context is. The monitor's Conversations tab shows VRAM, RAM and disk side by
  side, each conversation as a dot with its size; a prompt being read shows in its slot.
• Statistics tab (instead of the launcher's Server log): how the slots spent the last 10 minutes and since the
  start: whether the clients send enough work, or requests wait for context.
• Smarter cache, the disk as the last resort. Finished jobs' caches go first and are never written to disk;
  nothing idle for an hour stays on disk; an active conversation's state stays in RAM. On a busy hosted hour this
  removes thousands of disk round trips and the ~3 s wait they added to agent turns.

The "Source code" files GitHub attaches to this release hold only the README and the docs; the engine's source code will be released soon.

Full changelog · How to run it