feat: locking and retry in FB message parsing

[scmmishra]

This PR adds a Redis based lock for Facebook message processing to avoid race conditions/concurrent processing of messages from the same sender.

This PR adds the Redis::LockManager, it provides a simple mechanism to handle distributed locks using Redis. example usage

lock_manager = Redis::LockManager.new

if lock_manager.lock("some_key")
  # Critical code that should not be run concurrently
  lock_manager.unlock("some_key")
end

This also adds a new namespace pool called $sherlock, our key solver. This is added to ensure that locks don't collide anywhere.

The LockManager is used in Webhooks::FacebookEventsJob, which uses the [retry_on](# https://edgeapi.rubyonrails.org/classes/ActiveJob/Exceptions/ClassMethods.html#method-i-retry_on) method to retry the message creation at least 5 times, with a 10 second backoff.

TODO

• Tests for LockMangager
• Tests for Webhooks::FacebookEventsJob retry mechanism
• Figure out better timeouts for retry and lock duration

[netlify]

✅ Deploy Preview for chatwoot-storybook canceled.

Name	Link
🔨 Latest commit	94113df
🔍 Latest deploy log	https://app.netlify.com/sites/chatwoot-storybook/deploys/64e2ffc6de62c50008ea1f46

[sojan-official]

LGTM overall. some minor comments on code organisation.

[scmmishra]

@sojan-official LMK your thoughts on the key used to acquire the lock? Also about the lock timings, I was thinking we can increase the lock timeout to about 30 seconds

[sojan-official]

LGTM overall .
Some minor comments. let's have this added for whatsapp messages as well as a follow up

ref: #5433

[scmmishra]

@sojan-official tests are all done, just need to take a look at the key used for locking and we're good to go

[sojan-official]

The code looks good to me. Let's test this on staging and then get it merged.

[scmmishra]

@sojan-official tested this on staging, working fine. We're good to merge this

[scmmishra]

@sojan-official the breaking test is because of a security audit. This PR solves it #7765

[sentry]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ Webhooks::FacebookEventsJob::LockAcquisitionError: Failed to acquire lock for key: FB_MESSAGE_CREATE_LOCK::182015432606460::9739988746043421 (Webhoo... Sidekiq/Webhooks::FacebookEventsJob View Issue

_{Did you find this useful? React with a 👍 or 👎}

[github-actions]

This pull request has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.