Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prevent deadlocks with load interlock and DB lock. #31035

Merged
merged 1 commit into from
Nov 17, 2017
Merged

Prevent deadlocks with load interlock and DB lock. #31035

merged 1 commit into from
Nov 17, 2017

Conversation

BrentWheeldon
Copy link
Contributor

Summary

This fixes an issue where competing threads deadlock each other.

  • Thread A holds the load interlock but is blocked on getting the DB lock
  • Thread B holds the DB lock but is blocked on getting the load interlock (for example when there is a Model.transaction block that needs to autoload)

This solution allows for dependency loading in other threads while a thread is waiting to acquire the DB lock.

Other Information

I'm very open to suggestions on naming and location of the new monitor, and also totally alternate approaches if folks have other thoughts.

Fixes #31019

@rails-bot
Copy link

Thanks for the pull request, and welcome! The Rails team is excited to review your changes, and you should hear from @georgeclaghorn (or someone else) soon.

If any changes to this PR are deemed necessary, please add them as extra commits. This ensures that the reviewer can see what has changed since they last reviewed the code. Due to the way GitHub handles out-of-date commits, this should also make it reasonably obvious what issues have or haven't been addressed. Large or tricky changes may require several passes of review and changes.

This repository is being automatically checked for code quality issues using Code Climate. You can see results for this analysis in the PR status below. Newly introduced issues should be fixed before a Pull Request is considered ready to review.

Please see the contribution instructions for more information.

@georgeclaghorn
Copy link
Contributor

r? @matthewd

@rails-bot rails-bot assigned matthewd and unassigned georgeclaghorn Nov 2, 2017
@BrentWheeldon
Copy link
Contributor Author

The test failures seem unrelated to this change (and I've seen them failing on other branches, too). Let me know if that's something I should be trying to take care of as part of this.

This fixes an issue where competing threads deadlock each other.

- Thread A holds the load interlock but is blocked on getting the DB lock
- Thread B holds the DB lock but is blocked on getting the load interlock (for example when there is a `Model.transaction` block that needs to autoload)

This solution allows for dependency loading in other threads while a thread is waiting to acquire the DB lock.

Fixes #31019
@BrentWheeldon
Copy link
Contributor Author

A rebase cleaned up the failures. @matthewd, please let me know if there's anything else I need to do here.

@matthewd
Copy link
Member

This looks perfect, thanks! Great work on the test, too! 👌

@matthewd matthewd merged commit 56c1326 into rails:master Nov 17, 2017
@BrentWheeldon
Copy link
Contributor Author

BrentWheeldon commented Nov 17, 2017

Awesome - thanks for you're help, @matthewd! Should I open new PRs to backport this to 5-1-stable and 5-0-stable? Should I open new PR to backport this to 5-1-stable? (This locking doesn't exist in 5.0.)

@BrentWheeldon
Copy link
Contributor Author

Just opened #31174 for the backport while I was in context.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Deadlocks in rails 5
4 participants