Why does Chore require memcached?

[jellybob]

The documentation mentions a dependency on Dali for SQS consumers, but doesn't mention what that is for. Is it possible to add a bit more explanation as to what that does, and would you be open to a PR replacing memcached with Redis, as I'd rather avoid introducing another piece of infrastructure to our system just for this.

[marcuswalser]

Hi @jellybob - because SQS's delivery guarantee is "at-least-once," we use memcached as a store for message IDs, so they can be deduplicated by the consumer processes. If your system is resilient to duplicate messages, you wouldn't require it and could safely omit it.

[marcuswalser]

Should have mentioned - we're happy to review a PR which adds Redis as an option for dedupe.

[jellybob]

Thanks for the clarification - we always build in a way which can handle duplicates, so its not an issue for us.