Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Reliable scheduler can trigger slowlog #3332
The reliable scheduler calls Redis and enqueues any scheduled jobs which are ready to be enqueued. If you schedule 100,000 jobs for midnight, the reliable scheduler will make one call to Redis which will then loop over all 100,000 jobs in Lua and enqueue each. This can take many seconds, locking out all other Redis commands.
Put in a limit of 100 jobs per call. Have the scheduler call Redis in a loop, enqueuing 100 jobs per call.