SimpleMemoryBackend - set max size

[rspadim]

When using SimpleMemoryBackend, should be important set the max size of internal dict

an idea is use an algorithm to select what to do when dict is "full", remove last element, first, random, rlu ...

[rspadim]

This could help:

https://cachetools.readthedocs.io/en/stable/

https://github.com/hephex/asyncache/blob/master/asyncache/__init__.py

[prochanev-thw]

We have any problems with alru_cache while this feature not implemented?

[sergioave]

Any progress or implementation schedule?
Thank you

[Dreamsorcerer]

Feel free to make a PR implementing it.

[Yiling-J]

Consider using Theine as the backend when you decide to implement it. Which is much faster than cachetools.

[Dreamsorcerer]

Probably better if someone can create an external backend for theine (or even include it in theine itself, if they're intersted), rather than adding more dependencies here.

We can link to it in the README as an alternative backend if someone sorts that out.

[mirandadam]

Hi @Dreamsorcerer, I have submitted an incomplete PR to address this. Proper unit tests are needed and I have no idea how to implement them. Please advise.

[Yiling-J]

Actually I'm thinking, async-lru is also an aio-libs project, maybe it's possible to combine these two and use async-lru as the SimpleMemoryBackend? Theine is a little heavy because it has a Rust core(and maybe not that simple).