Skip to content

[TRI-1152] chore: upgrade webapp to use graphile-worker 0.14.0-rc.0 #396

@ericallam

Description

@ericallam

We're currently on 0.13.0 but 0.14.0 comes with automatic queue management, so it will be easier to do #392 along with other things:

  • New "batch jobs" feature for merging payloads with a job_key (see README)
  • Significantly improved 'large jobs table' performance (e.g. when a large queue is locked, or there's a lot of jobs queued for task identifiers your worker instance doesn't support, or a lot of failed jobs). Around 20x improvement in this 'worst case' performance for real user workloads.
  • Added new (experimental) much faster add_jobs batch API.
  • Fix error handling of cron issues in 'run' method.
  • CronItem.match can now accept either a pattern string or a matcher function
  • Jobs that were locked more than 4 hours will be reattempted as before, however they are slightly de-prioritised by virtue of having their run_at updated, giving interim jobs a chance to be executed (and lessening the impact of queue stalling through hanging tasks).

The full release notes are here:

https://github.com/graphile/worker/blob/main/RELEASE_NOTES.md#v0140

As mentioned in the release notes, this is a breaking change, meaning workers running 0.13 cannot run against the 0.14 schema. So we'll need to make this clear in any release notes for this feature.

From SyncLinear.com | TRI-1152

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions