Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Locks are not released: seeing 'Might need to be unlocked manually" warnings #594

Closed
Axxiss opened this issue Apr 9, 2021 · 8 comments
Closed
Assignees

Comments

@Axxiss
Copy link

Axxiss commented Apr 9, 2021

Describe the bug
After upgrading to v7. Looks like all locks are not released properly. Seeing thousands of warnings with "might need to be unlocked manually". Which correlates with a steep increase on redis total keys and memory usage

image

Expected behavior
Locks are released automatically

Current behavior
Locks are not released automatically.

@mhenrixon mhenrixon self-assigned this Apr 9, 2021
@mhenrixon
Copy link
Owner

That seems exactly the opposite of what I would expect. Can you share some more details about your setup? Anything out of the ordinary with your setup? Did you configure the server like here: https://github.com/mhenrixon/sidekiq-unique-jobs/blob/fde172b31f3d42d90bb727594d58c21b921dbfaa/README.md#add-the-middleware

Are you using any other Sidekiq middleware? The order of said middleware are paramount to allowing the various keys to be released properly.

@Axxiss
Copy link
Author

Axxiss commented Apr 9, 2021

Yes, it's configured that way, we are using other middlewares. I'll triple check everything and come back to you.

@mhenrixon
Copy link
Owner

@Axxiss Did you sort this one out or is it still something that needs to be looked into?

@Axxiss
Copy link
Author

Axxiss commented Apr 12, 2021

I rolled back on Friday to avoid filling up our redis instance, will continue with the investigation during this week.

@mhenrixon
Copy link
Owner

I added some debugging in #595 for your scenario. I'll cut a new release soon with these changes and I was hoping you'd be able to provide some details about your configuration using that. Basically, it should allow you to also see which workers are generating these problems so that you can share that configuration with me.

@Axxiss
Copy link
Author

Axxiss commented Apr 14, 2021

Thanks @mhenrixon, this is the next item on my backlog, will get back to it once I wrap up my current topics.

@mhenrixon
Copy link
Owner

@Axxiss, there was a ton of improvements since I last commented. The latest version is v7.1.1. Was a small bug in v7.1.0 but that was internal stuff only.

@Axxiss
Copy link
Author

Axxiss commented Jul 5, 2021

@mhenrixon thanks for the heads up. I'm currently not working on this and is hard to tell when I will pick up again. If it helps to keep your backlog clean, please close the ticket (I can reopen/recreate in the future)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants