Add memoization to index #20
Description
it would be great to cache output for specific queries for specific roles. I had a good experience with memoize crate, but once data structures became complex, I could not apply it. Example of LRU with TTL 2 seconds https://github.com/dermesser/memoize/blob/84e37f773b91406946dc78eaae19e834e90bf426/examples/full_featured.rs#L14
For example this call:
terraphim-ai/crates/middleware/src/lib.rs
Line 209 in 64adc58