Skip to content

MegaCapybara 1.03

Choose a tag to compare

View all tags
@perkel666 perkel666 released this 03 Oct 11:37
· 17 commits to main since this release
v1.03
e9298c3

What's new

Conversations keep their cache when many agents share the server. Under memory pressure, 1.02 could drop a whole idle
conversation (often 100K–300K tokens) and read it again from scratch on its next turn.

  • A conversation coming back from RAM no longer causes another one to be dropped: it swaps places with an idle one.
  • Running out of pinned RAM moves another conversation to disk instead of dropping the one being moved.
  • The conversations needed last make room first; one is never pushed out for one that is needed later.

The "Source code" files GitHub attaches to this release hold only the README and the docs; the engine's source code will be released soon.

Full changelog · How to run it

Assets 4
Loading