New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reliable scheduler can trigger slowlog #3332

Closed
mperham opened this Issue Jan 27, 2017 · 0 comments

Comments

1 participant
@mperham
Owner

mperham commented Jan 27, 2017

The reliable scheduler calls Redis and enqueues any scheduled jobs which are ready to be enqueued. If you schedule 100,000 jobs for midnight, the reliable scheduler will make one call to Redis which will then loop over all 100,000 jobs in Lua and enqueue each. This can take many seconds, locking out all other Redis commands.

Put in a limit of 100 jobs per call. Have the scheduler call Redis in a loop, enqueuing 100 jobs per call.

@mperham mperham added the pro label Jan 27, 2017

@mperham mperham closed this Jan 27, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment