v0.12.0
go install github.com/riverqueue/river/cmd/river@latest
river migrate-up --database-url "$DATABASE_URL"
If not using River's internal migration system, the raw SQL can alternatively be dumped with:
go install github.com/riverqueue/river/cmd/river@latest
river migrate-get --version 6 --up > river6.up.sql
river migrate-get --version 6 --down > river6.down.sql
The migration includes a new index. Users with a very large job table may want to consider raising the index separately using CONCURRENTLY
(which must be run outside of a transaction), then run river migrate-up
to finalize the process (it will tolerate an index that already exists):
ALTER TABLE river_job ADD COLUMN unique_states BIT(8);
CREATE UNIQUE INDEX CONCURRENTLY river_job_unique_idx ON river_job (unique_key)
WHERE unique_key IS NOT NULL
AND unique_states IS NOT NULL
AND river_job_state_in_bitmask(unique_states, state);
go install github.com/riverqueue/river/cmd/river@latest
river migrate-up --database-url "$DATABASE_URL"
Added
rivertest.WorkContext
, a test function that can be used to initialize a context to test aJobArgs.Work
implementation that will have a client set to context for use withriver.ClientFromContext
. PR #526.- A new
river migrate-list
command is available which lists available migrations and which version a target database is migrated to. PR #534. river version
orriver --version
now prints River version information. PR #537.Config.JobCleanerTimeout
was added to allow configuration of the job cleaner query timeout. In some deployments with millions of stale jobs, the cleaner may not be able to complete its query within the default 30 seconds.
Changed
InsertMany
and one in rivermigrate
. As before, we try never to make breaking changes, but these ones were deemed worth it because of minimal impact and to help avoid panics.
-
Breaking change:
Client.InsertMany
/InsertManyTx
now return the inserted rows rather than merely returning a count of the inserted rows. The new implementations no longer use Postgres'COPY FROM
protocol in order to facilitate return values.Users who relied on the return count can merely wrap the returned rows in a
len()
to return to that behavior, or you can continue using the old APIs using their new namesInsertManyFast
andInsertManyFastTx
. PR #589. -
Breaking change:
rivermigrate.New
now returns a possible error along with a migrator. An error may be returned, for example, when a migration line is configured that doesn't exist. PR #558.# before migrator := rivermigrate.New(riverpgxv5.New(dbPool), nil) # after migrator, err := rivermigrate.New(riverpgxv5.New(dbPool), nil) if err != nil { // handle error }
-
Unique jobs have been improved to allow bulk insertion of unique jobs via
InsertMany
/InsertManyTx
, and to allow customizing theByState
list to add or remove certain states. This enables users to expand the set of unique states to also includecancelled
anddiscarded
jobs, or to removeretryable
from uniqueness consideration. This updated implementation maintains the speed advantage of the newer index-backed uniqueness system, while allowing some flexibility in which job states.Unique jobs utilizing
ByArgs
can now also opt to have a subset of the job's arguments considered for uniqueness. For example, you could choose to consider only thecustomer_id
field while ignoring thetrace_id
field:type MyJobArgs { CustomerID string `json:"customer_id" river:"unique` TraceID string `json:"trace_id"` }
Any fields considered in uniqueness are also sorted alphabetically in order to guarantee a consistent result, even if the encoded JSON isn't sorted consistently. For example
encoding/json
encodes struct fields in their defined order, so merely reordering struct fields would previously have been enough to cause a new job to not be considered identical to a pre-existing one with different JSON order.The
UniqueOpts
type also gains anExcludeKind
option for cases where uniqueness needs to be guaranteed across multiple job types.In-flight unique jobs using the previous designs will continue to be executed successfully with these changes, so there should be no need for downtime as part of the migration. However the v6 migration adds a new unique job index while also removing the old one, so users with in-flight unique jobs may also wish to avoid removing the old index until the new River release has been deployed in order to guarantee that jobs aren't duplicated by old River code once that index is removed.
Deprecated: The original unique jobs implementation which relied on advisory locks has been deprecated, but not yet removed. The only way to trigger this old code path is with a single insert (
Insert
/InsertTx
) and usingUniqueOpts.ByState
with a custom list of states that omits some of the now-required states for unique jobs. Specifically,pending
,scheduled
,available
, andrunning
can not be removed from theByState
list with the new implementation. These are included in the default list so only the places which customize this attribute need to be updated to opt into the new (much faster) unique jobs. The advisory lock unique implementation will be removed in an upcoming release, and until then emits warning level logs when it's used. -
Deprecated: The
MigrateTx
method ofrivermigrate
has been deprecated. It turns out there are certain combinations of schema changes which cannot be run within a single transaction, and the migrator now prefers to run each migration in its own transaction, one-at-a-time.MigrateTx
will be removed in future version. -
The migrator now produces a better error in case of a non-existent migration line including suggestions for known migration lines that are similar in name to the invalid one. PR #558.
Fixed
- Fixed a panic that'd occur if
StopAndCancel
was invoked before a client was started. PR #557. - A
PeriodicJobConstructor
should be able to returnnil
JobArgs
if it wishes to not have any job inserted. However, this was either never working or was broken at some point. It's now fixed. Thanks @semanser! PR #572. - Fixed a nil pointer exception if
Client.Subscribe
was called when the client had no configured workers (it still, panics with a more instructive error message now). PR #599.