-
-
Notifications
You must be signed in to change notification settings - Fork 798
Closed
Labels
Description
We're currently on 0.13.0 but 0.14.0
comes with automatic queue management, so it will be easier to do #392 along with other things:
- New "batch jobs" feature for merging payloads with a job_key (see README)
- Significantly improved 'large jobs table' performance (e.g. when a large queue is locked, or there's a lot of jobs queued for task identifiers your worker instance doesn't support, or a lot of failed jobs). Around 20x improvement in this 'worst case' performance for real user workloads.
- Added new (experimental) much faster add_jobs batch API.
- Fix error handling of cron issues in 'run' method.
- CronItem.match can now accept either a pattern string or a matcher function
- Jobs that were locked more than 4 hours will be reattempted as before, however they are slightly de-prioritised by virtue of having their run_at updated, giving interim jobs a chance to be executed (and lessening the impact of queue stalling through hanging tasks).
The full release notes are here:
https://github.com/graphile/worker/blob/main/RELEASE_NOTES.md#v0140
As mentioned in the release notes, this is a breaking change, meaning workers running 0.13
cannot run against the 0.14
schema. So we'll need to make this clear in any release notes for this feature.
From SyncLinear.com | TRI-1152