[common/cache] add a basic lru cache

[PsiACE]

I hereby agree to the terms of the CLA available at: https://datafuse.rs/policies/cla/

Summary

• a basic lru cache for memory/disk, derived from sccache/lru_disk_cache

TODO

• Reconstructing the interface for memory cache, provide a common abstract interface
• Reconstructing disk cache
• Integrating with datafuse
• Polishing, docs and more

Changelog

• New Feature
• Improvement

Related Issues

Fixes #1429

Test Plan

Unit Tests

Stateless Tests

[databend-bot]

Thanks for the contribution!
I have applied any labels matching special text in your PR Changelog.

Please review the labels and make any necessary changes.

[ZhiHanZ]

folly has some interesting LRU cache implementations:
https://github.com/facebook/folly/blob/master/folly/container/EvictingCacheMap.h

[ZhiHanZ]

one question about disk based LRU cache, could we assume the size for persistence storage, for example, in sccache, we could set the cache size to 10Gi or more

[PsiACE]

one question about disk based LRU cache, could we assume the size for persistence storage, for example, in sccache, we could set the cache size to 10Gi or more

At present there are no differences between it and the cache in sccache, except for some differences in dependencies and features.

[codecov-commenter]

Codecov Report

Merging #1600 (22bc1a0) into master (7b2afe7) will increase coverage by 0%.
The diff coverage is 92%.

@@           Coverage Diff           @@
##           master   #1600    +/-   ##
=======================================
  Coverage      71%     72%            
=======================================
  Files         568     575     +7     
  Lines       33130   33731   +601     
=======================================
+ Hits        23823   24378   +555     
- Misses       9307    9353    +46     

Impacted Files	Coverage Δ
...uery/src/datasources/remote/remote_meta_backend.rs	0% <ø> (ø)
common/cache/src/disk_cache.rs	71% <71%> (ø)
common/cache/src/cache/lru.rs	97% <97%> (ø)
common/cache/src/disk_cache_test.rs	98% <98%> (ø)
common/cache/src/cache/lru_test.rs	100% <100%> (ø)
common/cache/src/meter/count_meter.rs	100% <100%> (ø)
common/cache/src/meter/file_meter.rs	100% <100%> (ø)
common/cache/src/meter/heap_meter.rs	100% <100%> (ø)
... and 6 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7b2afe7...22bc1a0. Read the comment docs.

[bohutang]

Tips:
It would better define the api(the api keeping TODO is ok) first, then let datafuse integrate it, and finally make it workable.
From your todo list, that's what you do 👍

[databend-bot]

Hello @PsiACE, 🎉 Thank you for opening the pull request! 🎉
Your pull request state is not in Draft, please add Reviewers or Re-request review again!
FuseQuery: @BohuTANG @sundy-li @zhang2014
FuseStore: @drmingdrmer @dantengsky
Or visit datafuse roadmap for some clues.

[PsiACE]

We can easily define another disk cache based on a different policy by simply implementing the common_cache::cache::Cache trait.

[PsiACE]

An almost universal Cache trait

[dantengsky]

Looks great to me, 👍

[databend-bot]

CI Passed
Reviewer Approved
Let's Merge