Pycachu

A tool to provide a LRU cache on files.

It has been created to store gigabytes of Thumbor thumbnails on a DigitalOcean server.

Usage

from pycachu import Pycachu

# Initialize the cache
# The dir has to exist
p = Pycachu('/storage/pycachu', 20 * (1024 ** 3))

# Get a file
f = p.get('/some/file')

if f is not None:
    yield f
    f.close()
else:
    content = generate_file_content()
    p.put('/some/file', content)
    content.seek(0)
    yield content
    content.close()

Performance

The performance is not exceptional, but operations basically take a constant time independently of the number of files in the cache, which is not too bad.

Rough benchmarking gave about 170 get per second.