Scrapy Memcached Cache

Memcached HTTP cache storage backend for Scrapy.

Install

Install the package with pipenv install scrapy-memcached-cache or pip install memcached-cache.

Usage

In your Scrapy settings.py:

1. Enable HTTP cache with HTTPCACHE_ENABLED = True
2. Set the cache expiration (in seconds), for example, with HTTPCACHE_EXPIRATION_SECS = 600
3. Set MemcachedCacheStorage as your cache storage with HTTPCACHE_STORAGE = 'scrapy_memcached_cache.MemcachedCacheStorage'
4. Set the location where your Memcached is running, for example, with MEMCACHED_LOCATION=localhost:11211
5. Done 🎉

Contributing

Please, format your code with Black.