v5.1.5 Migrator: v5.0.3 and greater to v5.1.5 upgrades fail

[DaedalusG]

• Sourcegraph version: v5.1.5
• Platform information: All deployment types utilizing migrator will be affected by this bug

Internal debugging thread: https://sourcegraph.slack.com/archives/C032Z79NZQC/p1690655844061789

Steps to reproduce:

1. Attempt to upgrade a Sourcegraph instance from any version to v5.1.5
2. Observe Migrator exit loop on SQL error

Reproduction

A Sourcegraph instance is initialized in v5.0.3 and upgrade via a standard upgrade (up) and multiversion (upgrade) command.

Migrator is observed to crash loop on up and the upgrade command errors

Migrator standard upgrade up

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.0.3 docker ps
CONTAINER ID   IMAGE                                         COMMAND                  CREATED          STATUS                             PORTS                                                         NAMES
20d28200cb4b   sourcegraph/frontend:5.0.3                    "/sbin/tini -- /usr/…"   9 seconds ago    Up 8 seconds (health: starting)                                                                  sourcegraph-frontend-0
1dd8f4855233   sourcegraph/frontend:5.0.3                    "/sbin/tini -- /usr/…"   15 seconds ago   Up 14 seconds (healthy)                                                                          sourcegraph-frontend-internal
a1fed0eb27e4   sourcegraph/redis-store:5.0.3                 "/sbin/tini -- redis…"   30 seconds ago   Up 26 seconds                      6379/tcp                                                      redis-store
b5482347503e   sourcegraph/gitserver:5.0.3                   "/sbin/tini -- /usr/…"   30 seconds ago   Up 26 seconds                                                                                    gitserver-0
8139a5566639   sourcegraph/github-proxy:5.0.3                "/sbin/tini -- /usr/…"   30 seconds ago   Up 27 seconds                                                                                    github-proxy
9d798eb0d309   sourcegraph/codeinsights-db:5.0.3             "/postgres.sh"           30 seconds ago   Up 26 seconds (healthy)            5432/tcp                                                      codeinsights-db
c5fb78c13663   sourcegraph/repo-updater:5.0.3                "/sbin/tini -- /usr/…"   30 seconds ago   Up 26 seconds                                                                                    repo-updater
0ca89e93d099   sourcegraph/search-indexer:5.0.3              "/sbin/tini -- zoekt…"   30 seconds ago   Up 27 seconds                                                                                    zoekt-indexserver-0
89fa6b53c0a2   sourcegraph/indexed-searcher:5.0.3            "/sbin/tini -- /bin/…"   30 seconds ago   Up 27 seconds (healthy)                                                                          zoekt-webserver-0
8397b3c2e1e2   sourcegraph/redis-cache:5.0.3                 "/sbin/tini -- redis…"   30 seconds ago   Up 26 seconds                      6379/tcp                                                      redis-cache
ab77fef558a5   sourcegraph/codeintel-db:5.0.3                "/postgres.sh"           30 seconds ago   Up 26 seconds (healthy)            5432/tcp                                                      codeintel-db
274dc1bfa353   sourcegraph/postgres_exporter:5.0.3           "/usr/local/bin/post…"   30 seconds ago   Up 27 seconds                      9187/tcp                                                      codeinsights-db-exporter
736262a3c903   sourcegraph/cadvisor:5.0.3                    "/usr/bin/cadvisor -…"   30 seconds ago   Up 26 seconds (health: starting)   8080/tcp                                                      cadvisor
fe94549a3b4a   sourcegraph/syntax-highlighter:5.0.3          "sh -c '/http-server…"   30 seconds ago   Up 26 seconds (healthy)            9238/tcp                                                      syntect-server
785337d43111   sourcegraph/worker:5.0.3                      "/sbin/tini -- /usr/…"   30 seconds ago   Up 26 seconds                      3189/tcp                                                      worker
04ba6a67957e   sourcegraph/postgres-12-alpine:5.0.3          "/postgres.sh"           30 seconds ago   Up 26 seconds (healthy)            5432/tcp                                                      pgsql
2b84e6a881c8   sourcegraph/prometheus:5.0.3                  "/bin/prom-wrapper"      30 seconds ago   Up 26 seconds                      0.0.0.0:9090->9090/tcp                                        prometheus
a34f0dbba700   sourcegraph/precise-code-intel-worker:5.0.3   "/sbin/tini -- /usr/…"   30 seconds ago   Up 27 seconds (healthy)            3188/tcp                                                      precise-code-intel-worker
48badbf888e9   sourcegraph/node-exporter:5.0.3               "/bin/node_exporter …"   30 seconds ago   Up 27 seconds                      9100/tcp                                                      node-exporter
3ab568c192fe   sourcegraph/postgres_exporter:5.0.3           "/usr/local/bin/post…"   30 seconds ago   Up 27 seconds                      9187/tcp                                                      codeintel-db-exporter
937b415051a8   caddy:2.5.2-alpine                            "caddy run --config …"   30 seconds ago   Up 26 seconds                      0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp, 443/udp, 2019/tcp   caddy
cf661fdeebb6   sourcegraph/blobstore:5.0.3                   "/sbin/tini -- /opt/…"   30 seconds ago   Up 27 seconds (healthy)            9000/tcp                                                      blobstore
70e1b393a342   sourcegraph/postgres_exporter:5.0.3           "/usr/local/bin/post…"   30 seconds ago   Up 27 seconds                      9187/tcp                                                      pgsql-exporter
0f201630afec   sourcegraph/opentelemetry-collector:5.0.3     "/bin/otelcol-source…"   30 seconds ago   Up 27 seconds                                                                                    otel-collector
dd308fdaeba5   sourcegraph/searcher:5.0.3                    "/sbin/tini -- /usr/…"   30 seconds ago   Up 28 seconds (healthy)                                                                          searcher-0
cbf039437210   sourcegraph/grafana:5.0.3                     "/opt/grafana/entry.…"   30 seconds ago   Up 27 seconds                      0.0.0.0:3370->3370/tcp                                        grafana
b7957dc4dc10   sourcegraph/symbols:5.0.3                     "/sbin/tini -- /usr/…"   30 seconds ago   Up 28 seconds (healthy)            3184/tcp                                                      symbols-0

After checking out the v5.1.5 tag and running docker-compose up -d the terminal session hangs

In another terminals session we check the status of containers and find migrator and dependent services restarting:

λ ~/ docker ps
CONTAINER ID   IMAGE                                         COMMAND                  CREATED          STATUS                         PORTS                                                         NAMES
cf82e9a4e9a7   sourcegraph/migrator:5.1.5                    "/sbin/tini -- /migr…"   40 seconds ago   Restarting (1) 1 second ago

Checking migrators container logs we find migrator continuously restarts:

λ ~/ docker logs migrator
✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
{"SeverityText":"ERROR","Timestamp":1690695371906853900,"InstrumentationScope":"migrator.migrations.Up","Caller":"store/store.go:387","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).Up","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"bbc6d73c-3ed9-4241-b5d0-707e0b19b2e0"},"Attributes":{"count":1,"elapsed":0.0564196,"error":"ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
{"SeverityText":"ERROR","Timestamp":1690695371910218000,"InstrumentationScope":"migrator.migrations.WithMigrationLog","Caller":"store/store.go:461","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).WithMigrationLog","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"bbc6d73c-3ed9-4241-b5d0-707e0b19b2e0"},"Attributes":{"count":1,"elapsed":0.0639039,"error":"failed to apply migration 1682683129:\n```\nCREATE TABLE IF NOT EXISTS own_aggregate_recent_view\n(\n    id                  SERIAL PRIMARY KEY,\n    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,\n    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),\n    views_count         INTEGER DEFAULT 0\n);\nCREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer\n    ON own_aggregate_recent_view\n        USING btree (viewed_file_path_id, viewer_id);\nCOMMENT ON TABLE own_aggregate_recent_view\n    IS 'One entry contains a number of views of a single file by a given viewer.';\nCREATE TABLE IF NOT EXISTS event_logs_scrape_state_own\n(\n    id          SERIAL\n        CONSTRAINT event_logs_scrape_state_own_pk\n            PRIMARY KEY,\n    bookmark_id INT NOT NULL,\n    job_type    INT NOT NULL\n);\nCOMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';\nCOMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';\n```: ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
failed to run migration for schema "frontend": failed to apply migration 1682683129:
CREATE TABLE IF NOT EXISTS own_aggregate_recent_view
(
    id                  SERIAL PRIMARY KEY,
    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,
    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),
    views_count         INTEGER DEFAULT 0
);
CREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer
    ON own_aggregate_recent_view
        USING btree (viewed_file_path_id, viewer_id);
COMMENT ON TABLE own_aggregate_recent_view
    IS 'One entry contains a number of views of a single file by a given viewer.';
CREATE TABLE IF NOT EXISTS event_logs_scrape_state_own
(
    id          SERIAL
        CONSTRAINT event_logs_scrape_state_own_pk
            PRIMARY KEY,
    bookmark_id INT NOT NULL,
    job_type    INT NOT NULL
);
COMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';
COMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';
: ERROR: relation "repo_paths" does not exist (SQLSTATE 42P01)
✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
failed to run migration for schema "frontend": dirty database: schema "frontend" marked the following migrations as failed: 1682683129
The target schema is marked as dirty and no other migration operation is seen running on this schema. The last migration operation over this schema has failed (or, at least, the migrator instance issuing that migration has died). Please contact support@sourcegraph.com for further assistance.

Migrator is erroring while attempting to run a schema migration 1682683129 setting the database as dirty.

In another session shelling into the database and checking the migration_logs table to see where the migration runner has failed:

sg=# SELECT * FROM migration_logs WHERE success IS false;
-[ RECORD 1 ]-----------------+--------------------------------------------------------------------------------------------------------------------------------------------
id                            | 566
migration_logs_schema_version | 2
schema                        | schema_migrations
version                       | 1682683129
up                            | t
started_at                    | 2023-07-30 05:36:11.846863+00
finished_at                   | 2023-07-30 05:36:11.908437+00
success                       | f
error_message                 | failed to apply migration 1682683129:                                                                                                      +
                              | ```                                                                                                                                        +
                              | CREATE TABLE IF NOT EXISTS own_aggregate_recent_view                                                                                       +
                              | (                                                                                                                                          +
                              |     id                  SERIAL PRIMARY KEY,                                                                                                +
                              |     viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,                                               +
                              |     viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),                                                                       +
                              |     views_count         INTEGER DEFAULT 0                                                                                                  +
                              | );                                                                                                                                         +
                              | CREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer                                                                         +
                              |     ON own_aggregate_recent_view                                                                                                           +
                              |         USING btree (viewed_file_path_id, viewer_id);                                                                                      +
                              | COMMENT ON TABLE own_aggregate_recent_view                                                                                                 +
                              |     IS 'One entry contains a number of views of a single file by a given viewer.';                                                         +
                              | CREATE TABLE IF NOT EXISTS event_logs_scrape_state_own                                                                                     +
                              | (                                                                                                                                          +
                              |     id          SERIAL                                                                                                                     +
                              |         CONSTRAINT event_logs_scrape_state_own_pk                                                                                          +
                              |             PRIMARY KEY,                                                                                                                   +
                              |     bookmark_id INT NOT NULL,                                                                                                              +
                              |     job_type    INT NOT NULL                                                                                                               +
                              | );                                                                                                                                         +
                              | COMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';                              +
                              | COMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';+
                              | ```: ERROR: relation "repo_paths" does not exist (SQLSTATE 42P01)
backfilled                    | f

This is causing the runner to fail here: https://sourcegraph.com/github.com/sourcegraph/sourcegraph@3ab5bb324b2f8404feffb5f4f6e7bc876eefac4d/-/blob/internal/database/migration/runner/runner.go?L393-396

Multiversion upgrade upgrade

A multi-version upgrade was also tested by initializing an instance at v5.0.3 and running the migrator upgrade command:

  migrator:
    container_name: migrator
    image: 'index.docker.io/sourcegraph/migrator:5.1.5'
    cpus: 0.5
    mem_limit: '500m'
    command: ['upgrade', '--from=v5.0.3', '--to=v5.1.5']
...

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.0.3* docker-compose up migrator
Creating pgsql           ... done
Creating codeintel-db    ... done
Creating codeinsights-db ... done
Creating migrator        ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.5
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC" succeeded
migrator                         | Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
migrator                         | Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
migrator                         | ✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
migrator                         | 👉 Migrating to v5.1 (step 1 of 1)
migrator                         | 👉 Running schema migrations
migrator                         | {"SeverityText":"ERROR","Timestamp":1690697789737890800,"InstrumentationScope":"migrator.migrations.Up","Caller":"store/store.go:387","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).Up","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"8193870e-86c8-4ee2-8ef3-1a6ade9401a1"},"Attributes":{"count":1,"elapsed":0.0084011,"error":"ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
migrator                         | {"SeverityText":"ERROR","Timestamp":1690697789740881800,"InstrumentationScope":"migrator.migrations.WithMigrationLog","Caller":"store/store.go:461","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).WithMigrationLog","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"8193870e-86c8-4ee2-8ef3-1a6ade9401a1"},"Attributes":{"count":1,"elapsed":0.0140002,"error":"failed to apply migration 1682683129:\n```\nCREATE TABLE IF NOT EXISTS own_aggregate_recent_view\n(\n    id                  SERIAL PRIMARY KEY,\n    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,\n    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),\n    views_count         INTEGER DEFAULT 0\n);\nCREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer\n    ON own_aggregate_recent_view\n        USING btree (viewed_file_path_id, viewer_id);\nCOMMENT ON TABLE own_aggregate_recent_view\n    IS 'One entry contains a number of views of a single file by a given viewer.';\nCREATE TABLE IF NOT EXISTS event_logs_scrape_state_own\n(\n    id          SERIAL\n        CONSTRAINT event_logs_scrape_state_own_pk\n            PRIMARY KEY,\n    bookmark_id INT NOT NULL,\n    job_type    INT NOT NULL\n);\nCOMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';\nCOMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';\n```: ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
migrator                         | failed to run migration for schema "frontend": failed to apply migration 1682683129:
migrator                         | ```
migrator                         | CREATE TABLE IF NOT EXISTS own_aggregate_recent_view
migrator                         | (
migrator                         |     id                  SERIAL PRIMARY KEY,
migrator                         |     viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,
migrator                         |     viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),
migrator                         |     views_count         INTEGER DEFAULT 0
migrator                         | );
migrator                         | CREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer
migrator                         |     ON own_aggregate_recent_view
migrator                         |         USING btree (viewed_file_path_id, viewer_id);
migrator                         | COMMENT ON TABLE own_aggregate_recent_view
migrator                         |     IS 'One entry contains a number of views of a single file by a given viewer.';
migrator                         | CREATE TABLE IF NOT EXISTS event_logs_scrape_state_own
migrator                         | (
migrator                         |     id          SERIAL
migrator                         |         CONSTRAINT event_logs_scrape_state_own_pk
migrator                         |             PRIMARY KEY,
migrator                         |     bookmark_id INT NOT NULL,
migrator                         |     job_type    INT NOT NULL
migrator                         | );
migrator                         | COMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';
migrator                         | COMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';
migrator                         | ```: ERROR: relation "repo_paths" does not exist (SQLSTATE 42P01)

The same error pattern holds here, with migration 1682683129 failing.

If you would like immediate help on this, please email support@sourcegraph.com (you can still create the issue, but there are no SLAs on issues like there are for support requests).

[DaedalusG]

In previous v5.1 patch versions migrator upgrade command was broken due to a release tooling issue. This was resolved by generating a new stitched migration table merged in this version release: https://github.com/sourcegraph/sourcegraph/pull/55237/files

In summary the release tooling stumbled on backported changes to some of the schema migrations:
https://github.com/sourcegraph/sourcegraph/pull/52098/files

The erroring migration 1682683129 is found here: https://github.com/sourcegraph/sourcegraph/pull/51293/files

This wasn't changed between v5.1.4 and v5.1.5 and while the upgrade command failed in v5.1, a standard upgrade in previous versions was working as expected. Therefore its safe to assume internal/database/migration/shared/data/stitched-migration-graph.json wasn't generated correctly, or now contains some error.

Diff for v5.1.4 internal/database/migration/shared/data/stitched-migration-graph.json and v5.1.5:
v5.1.5-stitch-diff.txt

[DaedalusG]

The table repo_paths should be added in: https://sourcegraph.com/github.com/sourcegraph/sourcegraph@bc34c4dcbe2919e86cfa35e8b2c2096640818825/-/blob/internal/database/migration/shared/data/stitched-migration-graph.json?L9499-9509

The migration is 1681300431 and in internal/database/migration/shared/data/stitched-migration-graph.json , this seems to imply that the cd internal/database/migration/shared && go run ./data/cmd/generator --write-frozen=false didn't order the stitched migrations correctly, or that introduction of new entries in stitch.go has disordered the execution order of the stitched migrations somehow.

[DaedalusG]

This information has been corrected initially MVU was thought to be broken. MVU are working in v5.1.5 migrator for Sourcegraph instances upgrading from before v5.0.3

After some further testing a mapping of the upgrade paths that are still functioning has been established:

Current Upgrade Path

From Version	To Version	Upgrade Type	Status
v5.1.x	v5.1.5	Standard Upgrade	✔️ Works
v5.1.x	v5.1.5	MVU Upgrade	❌ Issues with migrations
v5.0.3 to v5.0.6	v5.1.5	Standard Upgrade	❌ Issues with migrations
less than v5.0.3	v5.1.x	MVU Upgrade	✔️ Works
v5.1 less than v5.1.5	v5.1.5	Standard Upgrade	✔️ Works

Recommended Upgrade Path:

1. Standard or MVU upgrade to v5.0.x
2. Standard upgrade to v5.1.x less than v5.1.5
3. Standard upgrade from v5.1.x to v5.1.5

[coury-clark]

Progress notes:

we've validated the stitched graph on branch 5.1, tag 5.1.4, and tag 5.1.5 contains the proper order between 1681300431 and 1682683129, despite the table in 431 not existing when 129 tries to execute.

In the migration logs table we saw the 431 record existed and was marked as successful, but we were able to manually reproduce the table repo_paths didn't exist.

[DaedalusG]

During another reproduction standard upgrade v5.0.3 -> v5.1.5 we find 1684771948 fails

✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable, frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
failed to run migration for schema "frontend": dirty database: schema "frontend" marked the following migrations as failed: 1684771948
The target schema is marked as dirty and no other migration operation is seen running on this schema. The last migration operation over this schema has failed (or, at least, the migrator instance issuing that migration has died). Please contact support@sourcegraph.com for further assistance.

sg=# select * from migration_logs where version=1684771948;
-[ RECORD 1 ]-----------------+-------------------------------------------------------------------
id                            | 593
migration_logs_schema_version | 2
schema                        | schema_migrations
version                       | 1684771948
up                            | t
started_at                    | 2023-07-31 16:18:53.96701+00
finished_at                   | 2023-07-31 16:18:53.969524+00
success                       | f
error_message                 | failed to apply migration 1684771948:                             +
                              | ```                                                               +
                              | ALTER TABLE github_apps                                           +
                              |     ADD COLUMN IF NOT EXISTS domain TEXT NOT NULL DEFAULT 'repos';+
                              | ```: ERROR: relation "github_apps" does not exist (SQLSTATE 42P01)
backfilled                    | f

sg=# \d repo_paths
Did not find any relation named "repo_paths".
sg=# \d github_apps
Did not find any relation named "github_apps".

[DaedalusG]

Following a standard upgrade (up) command between v5.1.0 and v5.1.5

Init instance

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.0 docker ps
CONTAINER ID   IMAGE                                         COMMAND                  CREATED         STATUS                   PORTS                                                         NAMES
dcd6da23b34b   sourcegraph/frontend:5.1.0                    "/sbin/tini -- /fron…"   4 minutes ago   Up 4 minutes (healthy)                                                                 sourcegraph-frontend-0
7f3898b8106f   sourcegraph/frontend:5.1.0                    "/sbin/tini -- /fron…"   4 minutes ago   Up 4 minutes (healthy)                                                                 sourcegraph-frontend-internal
c3111b6721e0   sourcegraph/worker:5.1.0                      "/sbin/tini -- /work…"   4 minutes ago   Up 4 minutes                                                                           worker
8facdccb0efa   sourcegraph/opentelemetry-collector:5.1.0     "/bin/otelcol-source…"   4 minutes ago   Up 4 minutes                                                                           otel-collector
21eba625a560   sourcegraph/gitserver:5.1.0                   "/sbin/tini -- /gits…"   4 minutes ago   Up 4 minutes                                                                           gitserver-0
7dfbb74af613   sourcegraph/redis-store:5.1.0                 "redis-server /etc/r…"   4 minutes ago   Up 4 minutes                                                                           redis-store
3359af61abf4   sourcegraph/search-indexer:5.1.0              "/sbin/tini -- zoekt…"   4 minutes ago   Up 4 minutes                                                                           zoekt-indexserver-0
0bac87379ee9   sourcegraph/syntax-highlighter:5.1.0          "/usr/local/bin/http…"   4 minutes ago   Up 4 minutes (healthy)                                                                 syntect-server
c1430b849888   sourcegraph/searcher:5.1.0                    "/sbin/tini -- /sear…"   4 minutes ago   Up 4 minutes (healthy)                                                                 searcher-0
6a529aec9308   caddy:2.5.2-alpine                            "caddy run --config …"   4 minutes ago   Up 4 minutes             0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp, 443/udp, 2019/tcp   caddy
6fc698bbd187   sourcegraph/postgres_exporter:5.1.0           "/usr/bin/postgres_e…"   4 minutes ago   Up 4 minutes                                                                           pgsql-exporter
6dad1b0397f3   sourcegraph/redis-cache:5.1.0                 "redis-server /etc/r…"   4 minutes ago   Up 4 minutes                                                                           redis-cache
fac0942b74ab   sourcegraph/indexed-searcher:5.1.0            "/entry.sh"              4 minutes ago   Up 4 minutes (healthy)                                                                 zoekt-webserver-0
771a2b4ebf5c   sourcegraph/codeinsights-db:5.1.0             "/postgres.sh"           4 minutes ago   Up 4 minutes (healthy)   5432/tcp                                                      codeinsights-db
bc04cb1174bf   sourcegraph/github-proxy:5.1.0                "/sbin/tini -- /gith…"   4 minutes ago   Up 4 minutes                                                                           github-proxy
3570ee366530   sourcegraph/precise-code-intel-worker:5.1.0   "/sbin/tini -- /prec…"   4 minutes ago   Up 4 minutes (healthy)                                                                 precise-code-intel-worker
882e48a57823   sourcegraph/blobstore:5.1.0                   "/sbin/tini -- /opt/…"   4 minutes ago   Up 4 minutes (healthy)                                                                 blobstore
bf69668ccc27   sourcegraph/prometheus:5.0.6                  "/bin/prom-wrapper"      4 minutes ago   Up 4 minutes             0.0.0.0:9090->9090/tcp                                        prometheus
f38f15f6c6ac   sourcegraph/cadvisor:5.1.0                    "/usr/bin/cadvisor -…"   4 minutes ago   Up 4 minutes                                                                           cadvisor
8c6cd3376dca   sourcegraph/grafana:5.1.0                     "/entry.sh"              4 minutes ago   Up 4 minutes             0.0.0.0:3370->3370/tcp                                        grafana
502ccbe899dc   sourcegraph/codeintel-db:5.1.0                "/postgres.sh"           4 minutes ago   Up 4 minutes (healthy)   5432/tcp                                                      codeintel-db
c8ce5efd8918   sourcegraph/postgres-12-alpine:5.1.0          "/postgres.sh"           4 minutes ago   Up 4 minutes (healthy)   5432/tcp                                                      pgsql
36f8611fdbb2   sourcegraph/postgres_exporter:5.1.0           "/usr/bin/postgres_e…"   4 minutes ago   Up 4 minutes                                                                           codeinsights-db-exporter
6960a0a410b9   sourcegraph/postgres_exporter:5.1.0           "/usr/bin/postgres_e…"   4 minutes ago   Up 4 minutes                                                                           codeintel-db-exporter
7feec746a4c5   sourcegraph/node-exporter:5.1.0               "/usr/bin/node_expor…"   4 minutes ago   Up 4 minutes             9100/tcp                                                      node-exporter
96e904bd9313   sourcegraph/repo-updater:5.1.0                "/sbin/tini -- /repo…"   4 minutes ago   Up 4 minutes                                                                           repo-updater
a72ef2406627   sourcegraph/symbols:5.1.0                     "/sbin/tini -- /symb…"   4 minutes ago   Up 4 minutes (healthy)                                                                 symbols-0

Upgrading

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.0 git checkout v5.1.5
Previous HEAD position was 66741b3 release: sourcegraph@5.1.0 (#926)
HEAD is now at da213a6 release: sourcegraph@5.1.5 (#937)
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5 docker-compose up -d
Creating network "docker-compose_sourcegraph" with the default driver
Creating pgsql-exporter            ... done
Creating github-proxy              ... done
Creating precise-code-intel-worker ... done

...

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5 docker ps
CONTAINER ID   IMAGE                                         COMMAND                  CREATED          STATUS                    PORTS                                                         NAMES
5fa8a513e92c   sourcegraph/frontend:5.1.5                    "/sbin/tini -- /fron…"   22 seconds ago   Up 21 seconds (healthy)                                                                 sourcegraph-frontend-0
2bb16d5dd97a   sourcegraph/frontend:5.1.5                    "/sbin/tini -- /fron…"   27 seconds ago   Up 26 seconds (healthy)                                                                 sourcegraph-frontend-internal
fdbc134d8ef3   sourcegraph/codeinsights-db:5.1.5             "/postgres.sh"           42 seconds ago   Up 38 seconds (healthy)   5432/tcp                                                      codeinsights-db
0d6937192751   sourcegraph/worker:5.1.5                      "/sbin/tini -- /work…"   42 seconds ago   Up 39 seconds                                                                           worker
d4b0cde9ee98   sourcegraph/postgres-12-alpine:5.1.5          "/postgres.sh"           42 seconds ago   Up 38 seconds (healthy)   5432/tcp

...

The upgrade is successful and both of the previously failing tables exist

λ ~/deploy-sourcegraph-docker/ v5.1.5 docker exec -it pgsql psql -U sg
psql (12.11)
Type "help" for help.

sg=# \x
Expanded display is on.
sg=# \d repo_paths
                                                 Table "public.repo_paths"
            Column            |            Type             | Collation | Nullable |                Default
------------------------------+-----------------------------+-----------+----------+----------------------------------------
 id                           | integer                     |           | not null | nextval('repo_paths_id_seq'::regclass)
 repo_id                      | integer                     |           | not null |
 absolute_path                | text                        |           | not null |
 parent_id                    | integer                     |           |          |
 tree_files_count             | integer                     |           |          |
 tree_files_counts_updated_at | timestamp without time zone |           |          |
Indexes:
    "repo_paths_pkey" PRIMARY KEY, btree (id)
    "repo_paths_index_absolute_path" UNIQUE, btree (repo_id, absolute_path)
Foreign-key constraints:
    "repo_paths_parent_id_fkey" FOREIGN KEY (parent_id) REFERENCES repo_paths(id)
    "repo_paths_repo_id_fkey" FOREIGN KEY (repo_id) REFERENCES repo(id) ON DELETE CASCADE DEFERRABLE
Referenced by:
    TABLE "assigned_owners" CONSTRAINT "assigned_owners_file_path_id_fkey" FOREIGN KEY (file_path_id) REFERENCES repo_paths(id)
    TABLE "assigned_teams" CONSTRAINT "assigned_teams_file_path_id_fkey" FOREIGN KEY (file_path_id) REFERENCES repo_paths(id)
    TABLE "codeowners_individual_stats" CONSTRAINT "codeowners_individual_stats_file_path_id_fkey" FOREIGN KEY (file_path_id) REFERENCES repo_paths(id)
    TABLE "own_aggregate_recent_contribution" CONSTRAINT "own_aggregate_recent_contribution_changed_file_path_id_fkey" FOREIGN KEY (changed_file_path_id) REFERENCES repo_paths(id)
    TABLE "own_aggregate_recent_view" CONSTRAINT "own_aggregate_recent_view_viewed_file_path_id_fkey" FOREIGN KEY (viewed_file_path_id) REFERENCES repo_paths(id)
    TABLE "own_signal_recent_contribution" CONSTRAINT "own_signal_recent_contribution_changed_file_path_id_fkey" FOREIGN KEY (changed_file_path_id) REFERENCES repo_paths(id)
    TABLE "ownership_path_stats" CONSTRAINT "ownership_path_stats_file_path_id_fkey" FOREIGN KEY (file_path_id) REFERENCES repo_paths(id)
    TABLE "repo_paths" CONSTRAINT "repo_paths_parent_id_fkey" FOREIGN KEY (parent_id) REFERENCES repo_paths(id)

sg=# \d github_apps
                                          Table "public.github_apps"
      Column       |           Type           | Collation | Nullable |                 Default
-------------------+--------------------------+-----------+----------+-----------------------------------------
 id                | integer                  |           | not null | nextval('github_apps_id_seq'::regclass)
 app_id            | integer                  |           | not null |
 name              | text                     |           | not null |
 slug              | text                     |           | not null |
 base_url          | text                     |           | not null |
 client_id         | text                     |           | not null |
 client_secret     | text                     |           | not null |
 private_key       | text                     |           | not null |
 encryption_key_id | text                     |           | not null |
 logo              | text                     |           |          |
 created_at        | timestamp with time zone |           | not null | now()
 updated_at        | timestamp with time zone |           | not null | now()
 app_url           | text                     |           | not null | ''::text
 webhook_id        | integer                  |           |          |
 domain            | text                     |           | not null | 'repos'::text
Indexes:
    "github_apps_pkey" PRIMARY KEY, btree (id)
    "github_apps_app_id_slug_base_url_unique" UNIQUE, btree (app_id, slug, base_url)
Foreign-key constraints:
    "github_apps_webhook_id_fkey" FOREIGN KEY (webhook_id) REFERENCES webhooks(id) ON DELETE SET NULL
Referenced by:
    TABLE "github_app_installs" CONSTRAINT "github_app_installs_app_id_fkey" FOREIGN KEY (app_id) REFERENCES github_apps(id) ON DELETE CASCADE

sg=# SELECT * FROM migration_logs WHERE success IS false;
(0 rows)

[DaedalusG]

Noting that running the upgrade from:
v4.5.1 -> v5.0.0 -> v5.1.5 the upgrade path proceeds successfully. This runs up three times. It may be the case that theres some problem in the initialization of the the migrator_logs table.

In the case of an upgrade directly from v5.0.3 -> v5.1.5 migrator fails.

[DaedalusG]

After more extensive testing this now appears to be bug with a much more limited scope of impact. Further testing shows that many multi-version upgrade paths are successful with migrator v5.1.5. At this time it appears to be the case that upgrades from versions prior to patch release v5.1.3 to v5.1.5 are actually stable and successful.

Tests

v3.39.0 -> v5.1.5

λ ~/deploy-sourcegraph-docker/docker-compose/ v3.39.0 git checkout v5.1.5
Previous HEAD position was 44ef598 release: sourcegraph@3.39.0 (#802)
HEAD is now at da213a6 release: sourcegraph@5.1.5 (#937)
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5 clear
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5 docker-compose up migrator
Creating network "docker-compose_sourcegraph" with the default driver
Creating volume "docker-compose_blobstore" with default driver
Creating codeinsights-db ... done
Creating pgsql           ... done
Creating codeintel-db    ... done
Creating migrator        ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.5
migrator                         | ℹ️ Connection DSNs used: codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable, frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | {"SeverityText":"FATAL","Timestamp":1690874958101457000,"InstrumentationScope":"migrator","Caller":"migrator/main.go:29","Function":"main.main","Body":"the -from and -to flags are required when auto upgrade is not enabled","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"abe43730-d8db-4ed2-bdb6-08ec43b473bf"},"Attributes":{}}
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5* docker-compose up migrator
codeintel-db is up-to-date
codeinsights-db is up-to-date
pgsql is up-to-date
Recreating migrator ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.5
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | ℹ️ Connection DSNs used: codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable, frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC" succeeded
migrator                         | Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
migrator                         | Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
migrator                         | ✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
migrator                         | 👉 Migrating to v3.43 (step 1 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [1 2 4 5 7 13 14 15 16]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v4.3 (step 2 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [17 18]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v4.5 (step 3 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [19 20]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v5.1 (step 4 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator exited with code 0
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5* git stash
Saved working directory and index state WIP on (no branch): da213a6 release: sourcegraph@5.1.5 (#937)
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5 docker-compose up -d
pgsql is up-to-date
codeintel-db is up-to-date
codeinsights-db is up-to-date
Creating node-exporter             ... done
Creating repo-updater              ... done
Creating symbols-0                 ... done
Creating blobstore                 ... done
Creating zoekt-indexserver-0       ... done
Creating codeintel-db-exporter     ... done
Creating grafana                   ... done
Creating codeinsights-db-exporter  ... done
Creating prometheus                ... done
Creating cadvisor                  ... done
Creating precise-code-intel-worker ... done
Creating github-proxy              ... done
Creating pgsql-exporter            ... done
Creating zoekt-webserver-0         ... done
Creating redis-cache               ... done
Creating syntect-server            ... done
Creating otel-collector            ... done
Creating redis-store               ... done
Creating worker                    ... done
Creating gitserver-0               ... done
Creating caddy                     ... done
Creating searcher-0                ... done
Recreating migrator                ... done
Creating sourcegraph-frontend-internal ... done
Creating sourcegraph-frontend-0        ... done
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5

v4.5.1 -> v5.1.5

λ ~/deploy-sourcegraph-docker/docker-compose/ v4.5.1 docker-compose up migrator
Creating network "docker-compose_sourcegraph" with the default driver
Creating codeinsights-db ... done
Creating codeintel-db    ... done
Creating pgsql           ... done
Creating migrator        ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.5
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | ℹ️ Checking drift against version "v4.5.1"
migrator                         | ℹ️ Locating schema description
migrator                         | ✅ Schema found in Local file (/schema-descriptions/v4.5.1-internal_database_schema.json).
migrator                         | ✅ No drift detected
migrator exited with code 0
λ ~/deploy-sourcegraph-docker/docker-compose/ v4.5.1* docker-compose up migrator
codeintel-db is up-to-date
codeinsights-db is up-to-date
pgsql is up-to-date
Recreating migrator ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.5
migrator                         | ℹ️ Connection DSNs used: codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable, frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC" succeeded
migrator                         | Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
migrator                         | Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
migrator                         | ✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
migrator                         | 👉 Migrating to v4.5 (step 1 of 2)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [19 20]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v5.1 (step 2 of 2)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator exited with code 0

Note that MVU upgrades using migrator images in minor release v5.1.x where patch version x is less than v5.1.5 are still not valid. Additionally note that upgrades of any sort from from v5.0.3, v5.0.4, v5.0.5, or v5.0.6 will fail to upgrade to v5.1.5

Example failing standard upgrade

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.0.5 docker ps
CONTAINER ID   IMAGE                                         COMMAND                  CREATED          STATUS                    PORTS                                                         NAMES
c5813511e085   sourcegraph/frontend:5.0.5                    "/sbin/tini -- /usr/…"   33 seconds ago   Up 32 seconds (healthy)                                                                 sourcegraph-frontend-0
b34d3b61d29c   sourcegraph/frontend:5.0.5                    "/sbin/tini -- /usr/…"   39 seconds ago   Up 38 seconds (healthy)                                                                 sourcegraph-frontend-internal
94e0cd08d4a9   sourcegraph/worker:5.0.5                      "/sbin/tini -- /usr/…"   58 seconds ago   Up 55 seconds             3189/tcp                                                      worker
d4d03440696b   sourcegraph/codeintel-db:5.0.5                "/postgres.sh"           58 seconds ago   Up 54 seconds (healthy)   5432/tcp                                                      codeintel-db
21511505e7ac   sourcegraph/gitserver:5.0.5                   "/sbin/tini -- /usr/…"   58 seconds ago   Up 55 seconds                                                                           gitserver-0
bd571ec8e30f   sourcegraph/syntax-highlighter:5.0.5          "sh -c '/http-server…"   58 seconds ago   Up 55 seconds (healthy)   9238/tcp                                                      syntect-server
5a1421c3c8b2   sourcegraph/searcher:5.0.5                    "/sbin/tini -- /usr/…"   58 seconds ago   Up 56 seconds (healthy)                                                                 searcher-0
83e4f0ef80d0   sourcegraph/codeinsights-db:5.0.5             "/postgres.sh"           58 seconds ago   Up 54 seconds (healthy)   5432/tcp                                                      codeinsights-db
7183d35328ed   sourcegraph/search-indexer:5.0.5              "/sbin/tini -- zoekt…"   58 seconds ago   Up 56 seconds                                                                           zoekt-indexserver-0
4848104ae233   sourcegraph/opentelemetry-collector:5.0.5     "/bin/otelcol-source…"   58 seconds ago   Up 55 seconds                                                                           otel-collector
d0983278234b   sourcegraph/github-proxy:5.0.5                "/sbin/tini -- /usr/…"   58 seconds ago   Up 56 seconds                                                                           github-proxy
9efb4770b38c   sourcegraph/redis-store:5.0.5                 "/sbin/tini -- redis…"   58 seconds ago   Up 55 seconds             6379/tcp                                                      redis-store
371a4835f0cf   sourcegraph/redis-cache:5.0.5                 "/sbin/tini -- redis…"   58 seconds ago   Up 55 seconds             6379/tcp                                                      redis-cache
8572fdc0cbd3   sourcegraph/prometheus:5.0.5                  "/bin/prom-wrapper"      58 seconds ago   Up 54 seconds             0.0.0.0:9090->9090/tcp                                        prometheus
0d44ceead477   sourcegraph/postgres_exporter:5.0.5           "/usr/local/bin/post…"   58 seconds ago   Up 55 seconds             9187/tcp                                                      pgsql-exporter
22b9d93db257   sourcegraph/indexed-searcher:5.0.5            "/sbin/tini -- /bin/…"   58 seconds ago   Up 56 seconds (healthy)                                                                 zoekt-webserver-0
0839aaf67ce3   sourcegraph/precise-code-intel-worker:5.0.5   "/sbin/tini -- /usr/…"   58 seconds ago   Up 56 seconds (healthy)   3188/tcp                                                      precise-code-intel-worker
7a8636c95c23   sourcegraph/postgres_exporter:5.0.5           "/usr/local/bin/post…"   58 seconds ago   Up 55 seconds             9187/tcp                                                      codeinsights-db-exporter
aadded25cb59   sourcegraph/postgres-12-alpine:5.0.5          "/postgres.sh"           58 seconds ago   Up 54 seconds (healthy)   5432/tcp                                                      pgsql
1b9c80d9c6f4   sourcegraph/cadvisor:5.0.5                    "/usr/bin/cadvisor -…"   58 seconds ago   Up 54 seconds (healthy)   8080/tcp                                                      cadvisor
c4174e7f3e35   sourcegraph/node-exporter:5.0.5               "/bin/node_exporter …"   58 seconds ago   Up 55 seconds             9100/tcp                                                      node-exporter
7ae9573111e1   sourcegraph/blobstore:5.0.5                   "/sbin/tini -- /opt/…"   58 seconds ago   Up 55 seconds (healthy)   9000/tcp                                                      blobstore
0b25d824b04b   caddy:2.5.2-alpine                            "caddy run --config …"   58 seconds ago   Up 54 seconds             0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp, 443/udp, 2019/tcp   caddy
ad35c14c4c0c   sourcegraph/postgres_exporter:5.0.5           "/usr/local/bin/post…"   58 seconds ago   Up 56 seconds             9187/tcp                                                      codeintel-db-exporter
4f42e20ff895   sourcegraph/grafana:5.0.5                     "/opt/grafana/entry.…"   58 seconds ago   Up 55 seconds             0.0.0.0:3370->3370/tcp                                        grafana
896cdf3e760f   sourcegraph/repo-updater:5.0.5                "/sbin/tini -- /usr/…"   58 seconds ago   Up 57 seconds                                                                           repo-updater
235ee59973a8   sourcegraph/symbols:5.0.5                     "/sbin/tini -- /usr/…"   58 seconds ago   Up 56 seconds (healthy)   3184/tcp                                                      symbols-0
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.0.5 git checkout v5.1.5
Previous HEAD position was 3fabb49 release: sourcegraph@5.0.5 (#923)
HEAD is now at da213a6 release: sourcegraph@5.1.5 (#937)
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.5 docker-compose up -d
Creating network "docker-compose_sourcegraph" with the default driver
Creating pgsql-exporter            ... done
Creating github-proxy              ... done
Creating precise-code-intel-worker ... done
Creating codeintel-db-exporter     ... done
Creating caddy                     ... done
Creating prometheus                ... done
Creating gitserver-0               ... done
Creating blobstore                 ... done
Creating searcher-0                ... done
Creating repo-updater              ... done
Creating codeintel-db              ... done
Creating symbols-0                 ... done
Creating node-exporter             ... done
Creating zoekt-webserver-0         ... done
Creating codeinsights-db-exporter  ... done
Creating worker                    ... done
Creating syntect-server            ... done
Creating grafana                   ... done
Creating redis-cache               ... done
Creating pgsql                     ... done
Creating zoekt-indexserver-0       ... done
Creating cadvisor                  ... done
Creating otel-collector            ... done
Creating redis-store               ... done
Creating codeinsights-db           ... done
Creating migrator                  ... done

This hangs, in a separate terminal

λ ~/deploy-sourcegraph-docker/ v5.1.5* docker logs migrator
✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
{"SeverityText":"ERROR","Timestamp":1690876561821429900,"InstrumentationScope":"migrator.migrations.Up","Caller":"store/store.go:387","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).Up","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"b469fee9-cce4-408d-b81e-799eb002e666"},"Attributes":{"count":1,"elapsed":0.0005873,"error":"ERROR: relation \"github_apps\" does not exist (SQLSTATE 42P01)"}}
{"SeverityText":"ERROR","Timestamp":1690876561822759300,"InstrumentationScope":"migrator.migrations.WithMigrationLog","Caller":"store/store.go:461","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).WithMigrationLog","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"b469fee9-cce4-408d-b81e-799eb002e666"},"Attributes":{"count":1,"elapsed":0.0036408,"error":"failed to apply migration 1684771948:\n```\nALTER TABLE github_apps\n    ADD COLUMN IF NOT EXISTS domain TEXT NOT NULL DEFAULT 'repos';\n```: ERROR: relation \"github_apps\" does not exist (SQLSTATE 42P01)"}}
failed to run migration for schema "frontend": failed to apply migration 1684771948:
ALTER TABLE github_apps
    ADD COLUMN IF NOT EXISTS domain TEXT NOT NULL DEFAULT 'repos';
: ERROR: relation "github_apps" does not exist (SQLSTATE 42P01)

Example failing multi-version upgrade with v5.1.4

After initializing in v3.39.0

  migrator:
    container_name: migrator
    image: 'index.docker.io/sourcegraph/migrator:5.1.4@sha256:b871f4d32dee8ae757e3a66e5e0b75b0f2d6e04d6c598f1f0540a8e93648715b'
    cpus: 0.5
    mem_limit: '500m'
    command: ['upgrade', '--from=v3.39.0', '--to=v5.1.4', '-ignore-migrator-update']

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.4* docker-compose up migrator
pgsql is up-to-date
codeinsights-db is up-to-date
codeintel-db is up-to-date
Recreating migrator ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.4
migrator                         | ⚠️ A newer migrator version is available (v5.1.5), please consider using it instead. Continuing...
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | {"SeverityText":"FATAL","Timestamp":1690877170649777600,"InstrumentationScope":"migrator","Caller":"migrator/main.go:29","Function":"main.main","Body":"unknown tag \"v5.1.0\"","Resource":{"service.name":"migrator","service.version":"5.1.4","service.instance.id":"a953fc2b-334b-401a-a711-449ad58ced72"},"Attributes":{}}

Correcting migrator to the latest image and upgrading to v5.1.4

  migrator:
    container_name: migrator
    image: 'index.docker.io/sourcegraph/migrator:5.1.5'
    cpus: 0.5
    mem_limit: '500m'
    command: ['upgrade', '--from=v3.39.0', '--to=v5.1.4']

λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.4* docker-compose up migrator
pgsql is up-to-date
codeinsights-db is up-to-date
codeintel-db is up-to-date
Recreating migrator ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.4
migrator                         | ⚠️ A newer migrator version is available (v5.1.5), please consider using it instead. Continuing...
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | {"SeverityText":"FATAL","Timestamp":1690877170649777600,"InstrumentationScope":"migrator","Caller":"migrator/main.go:29","Function":"main.main","Body":"unknown tag \"v5.1.0\"","Resource":{"service.name":"migrator","service.version":"5.1.4","service.instance.id":"a953fc2b-334b-401a-a711-449ad58ced72"},"Attributes":{}}
λ ~/deploy-sourcegraph-docker/docker-compose/ v5.1.4* docker-compose up migrator
codeinsights-db is up-to-date
codeintel-db is up-to-date
pgsql is up-to-date
Recreating migrator ... done
Attaching to migrator
migrator                         | ✱ Sourcegraph migrator 5.1.5
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
migrator                         | ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
migrator                         | Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC...
migrator                         | ✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable&timezone=UTC" succeeded
migrator                         | Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
migrator                         | ✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
migrator                         | Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
migrator                         | ✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
migrator                         | 👉 Migrating to v3.43 (step 1 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [1 2 4 5 7 13 14 15 16]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v4.3 (step 2 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [17 18]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v4.5 (step 3 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator                         | 👉 Running out of band migrations [19 20]
migrator                         | ✅ Out of band migrations complete
migrator                         | 👉 Migrating to v5.1 (step 4 of 4)
migrator                         | 👉 Running schema migrations
migrator                         | ✅ Schema migrations complete
migrator exited with code 0

The instance started fine in v5.1.4 after this.

[loujar]

Another customer was unsuccessful in their attempt to upgrade from 3.39.1 > 5.1.5
internal thread with more details: https://sourcegraph.slack.com/archives/C02NFUV7V9A/p1691113060015189?thread_ts=1690873446.734719&cid=C02NFUV7V9A

[DaedalusG]

Three known error cases of sql queries failing to run due to missing relations:

1. failed to apply migration 1684771948 - metadata failed in standard upgrade v5.0.3 -> v5.1.5

ALTER TABLE github_apps
    ADD COLUMN IF NOT EXISTS domain TEXT NOT NULL DEFAULT 'repos';

ERROR: relation "github_apps" does not exist (SQLSTATE 42P01)

github_apps table is created in 1681807446

2. failed to apply migration 1682683129 - metadata failed during standard upgrade v5.0.3 -> v5.1.5

CREATE TABLE IF NOT EXISTS own_aggregate_recent_view
(
    id                  SERIAL PRIMARY KEY,
    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,
    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),
    views_count         INTEGER DEFAULT 0
);
CREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer
    ON own_aggregate_recent_view
        USING btree (viewed_file_path_id, viewer_id);
COMMENT ON TABLE own_aggregate_recent_view
    IS 'One entry contains a number of views of a single file by a given viewer.';
CREATE TABLE IF NOT EXISTS event_logs_scrape_state_own
(
    id          SERIAL
        CONSTRAINT event_logs_scrape_state_own_pk
            PRIMARY KEY,
    bookmark_id INT NOT NULL,
    job_type    INT NOT NULL
);
COMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';
COMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';

ERROR: relation "repo_paths" does not exist (SQLSTATE 42P01)

repo_paths is created in 1681300431

3. failed to apply migration 1685495400 - metadata Reported to fail during MVU v3.39.1 -> v5.1.5

DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_enabled TO cody_gateway_enabled;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_enabled does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_enabled IS NULL;
DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_chat_rate_limit TO cody_gateway_chat_rate_limit;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_chat_rate_limit does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_chat_rate_limit IS NULL;
DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_chat_rate_interval_seconds TO cody_gateway_chat_rate_interval_seconds;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_chat_rate_interval_seconds does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_chat_rate_interval_seconds IS NULL;
DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_chat_rate_limit_allowed_models TO cody_gateway_chat_rate_limit_allowed_models;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_chat_rate_limit_allowed_models does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_chat_rate_limit_allowed_models IS NULL;
DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_code_rate_limit TO cody_gateway_code_rate_limit;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_code_rate_limit does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_code_rate_limit IS NULL;
DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_code_rate_interval_seconds TO cody_gateway_code_rate_interval_seconds;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_code_rate_interval_seconds does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_code_rate_interval_seconds IS NULL;
DO $$
BEGIN
    ALTER TABLE public.product_subscriptions
        RENAME COLUMN llm_proxy_code_rate_limit_allowed_models TO cody_gateway_code_rate_limit_allowed_models;
EXCEPTION
    WHEN undefined_column THEN RAISE NOTICE 'column llm_proxy_code_rate_limit_allowed_models does not exist in table product_subscriptions';
END $$;
COMMENT ON COLUMN public.product_subscriptions.cody_gateway_code_rate_limit_allowed_models IS NULL;

ERROR: relation \"public.product_subscriptions\" does not exist (SQLSTATE 42P01)

product_subscriptions is created in 1648195639

[DaedalusG]

Migration Logs

Passed v5.0.2 -> v5.1.5
trial_1_v502_migration_logs.md
trial_1_v515_migration_logs.md

migrator logs

✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable, frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
✅ Schema(s) are up-to-date!

---

Failed v5.0.2 -> v5.0.3 -> v5.1.5
trial_2_v502_migration_logs.md
trial_2_v503_migration_logs.md
trial_2_v515_migration_logs.md

migrator logs

✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
{"SeverityText":"ERROR","Timestamp":1691244274829168800,"InstrumentationScope":"migrator.migrations.Up","Caller":"store/store.go:387","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).Up","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"cca50069-c47e-4431-919f-333121a7ebea"},"Attributes":{"count":1,"elapsed":0.0247115,"error":"ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
{"SeverityText":"ERROR","Timestamp":1691244274831494000,"InstrumentationScope":"migrator.migrations.WithMigrationLog","Caller":"store/store.go:461","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).WithMigrationLog","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"cca50069-c47e-4431-919f-333121a7ebea"},"Attributes":{"count":1,"elapsed":0.0290866,"error":"failed to apply migration 1682683129:\n```\nCREATE TABLE IF NOT EXISTS own_aggregate_recent_view\n(\n    id                  SERIAL PRIMARY KEY,\n    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,\n    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),\n    views_count         INTEGER DEFAULT 0\n);\nCREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer\n    ON own_aggregate_recent_view\n        USING btree (viewed_file_path_id, viewer_id);\nCOMMENT ON TABLE own_aggregate_recent_view\n    IS 'One entry contains a number of views of a single file by a given viewer.';\nCREATE TABLE IF NOT EXISTS event_logs_scrape_state_own\n(\n    id          SERIAL\n        CONSTRAINT event_logs_scrape_state_own_pk\n            PRIMARY KEY,\n    bookmark_id INT NOT NULL,\n    job_type    INT NOT NULL\n);\nCOMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';\nCOMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';\n```: ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
failed to run migration for schema "frontend": failed to apply migration 1682683129:
CREATE TABLE IF NOT EXISTS own_aggregate_recent_view
(
    id                  SERIAL PRIMARY KEY,
    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,
    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),
    views_count         INTEGER DEFAULT 0
);
CREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer
    ON own_aggregate_recent_view
        USING btree (viewed_file_path_id, viewer_id);
COMMENT ON TABLE own_aggregate_recent_view
    IS 'One entry contains a number of views of a single file by a given viewer.';
CREATE TABLE IF NOT EXISTS event_logs_scrape_state_own
(
    id          SERIAL
        CONSTRAINT event_logs_scrape_state_own_pk
            PRIMARY KEY,
    bookmark_id INT NOT NULL,
    job_type    INT NOT NULL
);
COMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';
COMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';
: ERROR: relation "repo_paths" does not exist (SQLSTATE 42P01)

---

Failed v5.0.3 -> v5.1.4
trial_3_v503_migration_logs.md
trial_3_v514_migration_logs.md

migrator logs

✱ Sourcegraph migrator 5.1.5
ℹ️ Connection DSNs used: frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable, codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@pgsql:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to "postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable" succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to "postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable" succeeded
{"SeverityText":"ERROR","Timestamp":1691244274829168800,"InstrumentationScope":"migrator.migrations.Up","Caller":"store/store.go:387","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).Up","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"cca50069-c47e-4431-919f-333121a7ebea"},"Attributes":{"count":1,"elapsed":0.0247115,"error":"ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
{"SeverityText":"ERROR","Timestamp":1691244274831494000,"InstrumentationScope":"migrator.migrations.WithMigrationLog","Caller":"store/store.go:461","Function":"github.com/sourcegraph/sourcegraph/internal/database/migration/store.(*Store).WithMigrationLog","Body":"operation.error","Resource":{"service.name":"migrator","service.version":"5.1.5","service.instance.id":"cca50069-c47e-4431-919f-333121a7ebea"},"Attributes":{"count":1,"elapsed":0.0290866,"error":"failed to apply migration 1682683129:\n```\nCREATE TABLE IF NOT EXISTS own_aggregate_recent_view\n(\n    id                  SERIAL PRIMARY KEY,\n    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,\n    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),\n    views_count         INTEGER DEFAULT 0\n);\nCREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer\n    ON own_aggregate_recent_view\n        USING btree (viewed_file_path_id, viewer_id);\nCOMMENT ON TABLE own_aggregate_recent_view\n    IS 'One entry contains a number of views of a single file by a given viewer.';\nCREATE TABLE IF NOT EXISTS event_logs_scrape_state_own\n(\n    id          SERIAL\n        CONSTRAINT event_logs_scrape_state_own_pk\n            PRIMARY KEY,\n    bookmark_id INT NOT NULL,\n    job_type    INT NOT NULL\n);\nCOMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';\nCOMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';\n```: ERROR: relation \"repo_paths\" does not exist (SQLSTATE 42P01)"}}
failed to run migration for schema "frontend": failed to apply migration 1682683129:
CREATE TABLE IF NOT EXISTS own_aggregate_recent_view
(
    id                  SERIAL PRIMARY KEY,
    viewer_id           INTEGER NOT NULL REFERENCES users (id) ON DELETE CASCADE DEFERRABLE,
    viewed_file_path_id INTEGER NOT NULL REFERENCES repo_paths (id),
    views_count         INTEGER DEFAULT 0
);
CREATE UNIQUE INDEX IF NOT EXISTS own_aggregate_recent_view_viewer
    ON own_aggregate_recent_view
        USING btree (viewed_file_path_id, viewer_id);
COMMENT ON TABLE own_aggregate_recent_view
    IS 'One entry contains a number of views of a single file by a given viewer.';
CREATE TABLE IF NOT EXISTS event_logs_scrape_state_own
(
    id          SERIAL
        CONSTRAINT event_logs_scrape_state_own_pk
            PRIMARY KEY,
    bookmark_id INT NOT NULL,
    job_type    INT NOT NULL
);
COMMENT ON TABLE event_logs_scrape_state_own IS 'Contains state for own jobs that scrape events if enabled.';
COMMENT ON COLUMN event_logs_scrape_state_own.bookmark_id IS 'Bookmarks the maximum most recent successful event_logs.id that was scraped';
: ERROR: relation "repo_paths" does not exist (SQLSTATE 42P01)

I did more testing on this and confirmed v5.0.3 -> v5.1.0 is failing with "frontend": dirty database: schema "frontend" marked the following migrations as failed: 1682683129 -- this is the repo_paths relation not existing

---

Passed v5.0.4 -> v5.1.0
trial_4_v504_migration_logs.md
trial_4_v510_migration_logs.md

migrator logs

✱ Sourcegraph migrator 5.1.0
ℹ️ Connection DSNs used: codeinsights => postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable, frontend => postgres://sg:sg@pgsql:5432/sg?sslmode=disable, codeintel => postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable
Attempting connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable...
✅ Connection to postgres://sg:sg@pgsql:5432/sg?sslmode=disable succeeded
Attempting connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable...
✅ Connection to postgres://sg:sg@codeintel-db:5432/sg?sslmode=disable succeeded
Attempting connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable...
✅ Connection to postgres://postgres:password@codeinsights-db:5432/postgres?sslmode=disable succeeded
✅ Schema(s) are up-to-date!

[efritz]

I wanted to see if 5.0.3 is a specific version. Looks like it fails upgrading from 5.0.6 as well. It does not fail if not upgrading directly to 5.1.5, though.

❌ 5.0.6 -> 5.1.5
✅ 5.0.6 -> 5.1.4
✅ 5.0.6 -> 5.1.3
✅ 5.0.6 -> 5.1.2
✅ 5.0.6 -> 5.1.1
✅ 5.0.6 -> 5.1.0

And upgrades to 5.1.5 from above 5.0.6 are also fine.

✅ 5.1.4 -> 5.1.5

[efritz]

Initializing 5.0.6:

migrator  | Sourcegraph migrator 5.0.6
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"codeinsights","leafVersions":[1675347548]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeinsights","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"codeinsights","targetDefinitions":[1000000027,1646761143,1647894746,1649801281,1651021000,1652289966,1656517037,1656608833,1659572248,1663626068,1664984848,1665003565,1665616961,1665053848,1666632478,1666729025,1667309737,1670253074,1672740238,1672917501,1672921606,1674474174,1675113463,1675347548],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeinsights","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeinsights","up":true,"count":24}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1000000027,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1646761143,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1647894746,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1649801281,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1651021000,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1652289966,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1656517037,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1656608833,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1659572248,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1663626068,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1664984848,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1665003565,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1665616961,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1665053848,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1666632478,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1666729025,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1667309737,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1670253074,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1672740238,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1672917501,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1672921606,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1674474174,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1675113463,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1675347548,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"codeintel","leafVersions":[1679010276]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"codeintel","targetDefinitions":[1000000033,1000000034,1665531314,1666727108,1669075922,1669842405,1669934289,1670001463,1670363942,1670365552,1670370058,1670881409,1670940342,1670967960,1671059396,1676423214,1678041507,1678898749,1678899132,1679010276],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeintel","up":true,"count":20}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1000000033,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1000000034,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1665531314,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1666727108,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1669075922,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1669842405,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1669934289,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670001463,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670363942,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670365552,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670370058,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670881409,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670940342,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1670967960,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1671059396,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1676423214,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1678041507,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"codeintel","tableName":"codeintel_scip_documents_dereference_logs","indexName":"codeintel_scip_documents_dereference_logs_last_removal_time_desc_doc","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"codeintel","migrationID":1678898749,"tableName":"codeintel_scip_documents_dereference_logs","indexName":"codeintel_scip_documents_dereference_logs_last_removal_time_desc_doc"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[1000000033,1000000034,1665531314,1666727108,1669075922,1669842405,1669934289,1670001463,1670363942,1670365552,1670370058,1670881409,1670940342,1670967960,1671059396,1676423214,1678041507,1678898749],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeintel","up":true,"count":2}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1678899132,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"codeintel","tableName":"codeintel_scip_metadata","indexName":"codeintel_scip_metadata_upload_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"codeintel","migrationID":1679010276,"tableName":"codeintel_scip_metadata","indexName":"codeintel_scip_metadata_upload_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[1000000033,1000000034,1665531314,1666727108,1669075922,1669842405,1669934289,1670001463,1670363942,1670365552,1670370058,1670881409,1670940342,1670967960,1671059396,1676423214,1678041507,1678898749,1678899132,1679010276],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"frontend","leafVersions":[1681923094,1681982430,1683290474,1684831743]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"frontend","targetDefinitions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791,1677073533,1677166643,1677242688,1677104938,1677483453,1677594756,1677607213,1677627515,1677627559,1677627566,1677694168,1677694170,1677700103,1677803354,1677811663,1677716184,1677716470,1677878270,1677944569,1677944752,1677945580,1677955553,1677958359,1678091683,1678112318,1678213774,1678220614,1678214530,1678290792,1678291091,1678291402,1678291831,1678320579,1678175532,1678380933,1678409821,1678456448,1678601228,1678899992,1678832491,1678994673,1680707560,1681923094,1681982430,1683053825,1683290474,1683641757,1684180461,1684831743],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":246}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1648051770,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1648195639,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1648524019,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1648628900,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1649159359,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1649269601,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1649441222,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1649759318,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1649432863,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1650456734,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1650637472,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1651061363,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1651077257,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1651159431,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652143849,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652175864,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652228814,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652189866,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652707934,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652946496,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1652964210,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1653334014,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1653472246,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1653479179,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1649253538,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1654116265,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1654168174,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655226733,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1653524883,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1654770608,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1654848945,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"changeset_specs","indexName":"changeset_specs_batch_spec_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1654872407,"tableName":"changeset_specs","indexName":"changeset_specs_batch_spec_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":214}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"batch_spec_workspaces","indexName":"batch_spec_workspaces_batch_spec_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1654874148,"tableName":"batch_spec_workspaces","indexName":"batch_spec_workspaces_batch_spec_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":213}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"batch_spec_workspace_execution_jobs","indexName":"batch_spec_workspace_execution_jobs_batch_spec_workspace_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1654874153,"tableName":"batch_spec_workspace_execution_jobs","indexName":"batch_spec_workspace_execution_jobs_batch_spec_workspace_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":212}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"changeset_specs","indexName":"changeset_specs_created_at","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1655037388,"tableName":"changeset_specs","indexName":"changeset_specs_created_at"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":211}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"changesets","indexName":"changesets_changeset_specs","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1655037391,"tableName":"changesets","indexName":"changesets_changeset_specs"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":210}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655067139,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655128668,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655328928,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655412173,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"batch_spec_workspace_execution_jobs","indexName":"batch_spec_workspace_execution_jobs_last_dequeue","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1655481894,"tableName":"batch_spec_workspace_execution_jobs","indexName":"batch_spec_workspace_execution_jobs_last_dequeue"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":205}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655737737,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"batch_spec_workspaces","indexName":"batch_spec_workspaces_id_batch_spec_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1655763641,"tableName":"batch_spec_workspaces","indexName":"batch_spec_workspaces_id_batch_spec_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":203}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"insights_query_runner_jobs","indexName":"insights_query_runner_jobs_series_id_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1655843069,"tableName":"insights_query_runner_jobs","indexName":"insights_query_runner_jobs_series_id_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":202}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655157509,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655105391,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1655454264,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"repo","indexName":"repo_description_trgm_idx","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1656447205,"tableName":"repo","indexName":"repo_description_trgm_idx"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":198}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"external_service_sync_jobs","indexName":"external_service_sync_jobs_state_external_service_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1657106983,"tableName":"external_service_sync_jobs","indexName":"external_service_sync_jobs_state_external_service_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":197}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1657107627,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"cm_action_jobs","indexName":"cm_action_jobs_state_idx","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1657279116,"tableName":"cm_action_jobs","indexName":"cm_action_jobs_state_idx"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":195}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"cm_trigger_jobs","indexName":"cm_trigger_jobs_state_idx","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1657279170,"tableName":"cm_trigger_jobs","indexName":"cm_trigger_jobs_state_idx"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":194}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1657635365,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658122170,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658174103,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"cm_trigger_jobs","indexName":"cm_trigger_jobs_finished_at","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1658225452,"tableName":"cm_trigger_jobs","indexName":"cm_trigger_jobs_finished_at"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":190}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1657663493,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658255432,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658384388,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1653596521,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658484997,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658503913,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"changesets","indexName":"changesets_computed_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1658512336,"tableName":"changesets","indexName":"changesets_computed_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":183}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658748822,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658837440,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658856572,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658950366,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1659085788,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1659368926,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1659380538,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1659434035,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1659459805,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1659721548,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1660132915,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1660312877,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1658874734,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1660710812,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1660710916,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1660711451,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1660742069,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1661441160,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1661502186,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1661507724,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1662467128,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1663569995,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1664300936,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1663665519,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1663871069,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1664897165,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1664988036,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665056530,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665138849,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665399117,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1662636054,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665420690,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665477911,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665488828,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665524865,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665646849,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665588249,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1665770699,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666034720,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666131819,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666145729,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666344635,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666398757,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"lsif_dependency_indexing_jobs","indexName":"lsif_dependency_indexing_jobs_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666524436,"tableName":"lsif_dependency_indexing_jobs","indexName":"lsif_dependency_indexing_jobs_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":139}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"lsif_dependency_syncing_jobs","indexName":"lsif_dependency_syncing_jobs_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666598814,"tableName":"lsif_dependency_syncing_jobs","indexName":"lsif_dependency_syncing_jobs_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":138}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"batch_spec_resolution_jobs","indexName":"batch_spec_resolution_jobs_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666598828,"tableName":"batch_spec_resolution_jobs","indexName":"batch_spec_resolution_jobs_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":137}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"gitserver_relocator_jobs","indexName":"gitserver_relocator_jobs_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666598983,"tableName":"gitserver_relocator_jobs","indexName":"gitserver_relocator_jobs_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":136}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"webhook_build_jobs","indexName":"webhook_build_jobs_state","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666598987,"tableName":"webhook_build_jobs","indexName":"webhook_build_jobs_state"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":135}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666598990,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666717223,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"event_logs","indexName":"event_logs_user_id_timestamp","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666886757,"tableName":"event_logs","indexName":"event_logs_user_id_timestamp"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":132}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1666904087,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"event_logs","indexName":"event_logs_user_id_name","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1666939263,"tableName":"event_logs","indexName":"event_logs_user_id_name"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":130}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667220502,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667220626,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667220628,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667220768,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667222952,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667259203,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667313173,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667395984,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667433265,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667497565,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667500111,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667825028,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667848448,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667863757,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1667917030,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"repo","indexName":"repo_dotcom_indexable_repos_idx","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1667950421,"tableName":"repo","indexName":"repo_dotcom_indexable_repos_idx"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":114}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"gitserver_repos","indexName":"gitserver_repos_not_explicitly_cloned_idx","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1667952974,"tableName":"gitserver_repos","indexName":"gitserver_repos_not_explicitly_cloned_idx"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":113}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"gitserver_repos","indexName":"gitserver_repos_last_changed_idx","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1668174127,"tableName":"gitserver_repos","indexName":"gitserver_repos_last_changed_idx"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":112}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1668184279,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"event_logs","indexName":"event_logs_name_timestamp","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1668179496,"tableName":"event_logs","indexName":"event_logs_name_timestamp"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":110}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1668179619,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"gitserver_repos","indexName":"gitserver_repo_size_bytes","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1668603582,"tableName":"gitserver_repos","indexName":"gitserver_repo_size_bytes"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":108}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1668707631,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1668767882,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1668808118,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1669184869,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1669297489,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1669576792,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1669645608,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1669836151,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670256530,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1668813365,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670350006,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670539388,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670539913,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670542168,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670543231,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670870072,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670934184,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1670600028,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1671159453,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1671463799,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1671543381,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1672884222,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1673019611,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1672897105,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1673351808,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1673405886,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1673871310,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1673897709,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674035302,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674041632,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674047296,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674455760,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674480050,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674669326,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674642349,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674669794,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674754280,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674814035,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1674952295,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675155867,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675257827,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675194688,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"lsif_uploads","indexName":"lsif_uploads_uploaded_at_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1675277218,"tableName":"lsif_uploads","indexName":"lsif_uploads_uploaded_at_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":65}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675277500,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"lsif_indexes","indexName":"lsif_indexes_queued_at_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1675277968,"tableName":"lsif_indexes","indexName":"lsif_indexes_queued_at_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":63}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675296942,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675367314,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675647612,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675962678,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1676996650,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677003167,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677005673,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677008591,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1676272751,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1676328864,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675850599,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1675864432,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1676420496,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"lsif_indexes","indexName":"lsif_indexes","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1676584791,"tableName":"lsif_indexes","indexName":"lsif_indexes"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":49}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677073533,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677166643,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677242688,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677104938,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677483453,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_ranking_path_counts_inputs","indexName":"codeintel_ranking_path_counts_inputs_graph_key_repository_id_processed","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1677594756,"tableName":"codeintel_ranking_path_counts_inputs","indexName":"codeintel_ranking_path_counts_inputs_graph_key_repository_id_processed"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791,1677073533,1677166643,1677242688,1677104938,1677483453,1677594756],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":43}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677607213,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677627515,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_ranking_definitions","indexName":"codeintel_ranking_definitions_graph_key_last_scanned_at_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1677627559,"tableName":"codeintel_ranking_definitions","indexName":"codeintel_ranking_definitions_graph_key_last_scanned_at_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791,1677073533,1677166643,1677242688,1677104938,1677483453,1677594756,1677607213,1677627515,1677627559],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":40}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_ranking_references","indexName":"codeintel_ranking_references_graph_key_last_scanned_at_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1677627566,"tableName":"codeintel_ranking_references","indexName":"codeintel_ranking_references_graph_key_last_scanned_at_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791,1677073533,1677166643,1677242688,1677104938,1677483453,1677594756,1677607213,1677627515,1677627559,1677627566],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":39}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677694168,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677694170,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677700103,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677803354,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677811663,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677716184,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677716470,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677878270,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677944569,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677944752,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677945580,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677955553,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1677958359,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678091683,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"user_external_accounts","indexName":"user_external_accounts_user_id_scim_service_type","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1678112318,"tableName":"user_external_accounts","indexName":"user_external_accounts_user_id_scim_service_type"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791,1677073533,1677166643,1677242688,1677104938,1677483453,1677594756,1677607213,1677627515,1677627559,1677627566,1677694168,1677694170,1677700103,1677803354,1677811663,1677716184,1677716470,1677878270,1677944569,1677944752,1677945580,1677955553,1677958359,1678091683,1678112318],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":24}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678213774,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678220614,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678214530,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678290792,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678291091,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678291402,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678291831,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678320579,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"repo","indexName":"idx_repo_github_topics","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1678175532,"tableName":"repo","indexName":"idx_repo_github_topics"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1648051770,1648195639,1648524019,1648628900,1649159359,1649269601,1649441222,1649759318,1649432863,1650456734,1650637472,1651061363,1651077257,1651159431,1652143849,1652175864,1652228814,1652189866,1652707934,1652946496,1652964210,1653334014,1653472246,1653479179,1649253538,1654116265,1654168174,1655226733,1653524883,1654770608,1654848945,1654872407,1654874148,1654874153,1655037388,1655037391,1655067139,1655128668,1655328928,1655412173,1655481894,1655737737,1655763641,1655843069,1655157509,1655105391,1655454264,1656447205,1657106983,1657107627,1657279116,1657279170,1657635365,1658122170,1658174103,1658225452,1657663493,1658255432,1658384388,1653596521,1658484997,1658503913,1658512336,1658748822,1658837440,1658856572,1658950366,1659085788,1659368926,1659380538,1659434035,1659459805,1659721548,1660132915,1660312877,1658874734,1660710812,1660710916,1660711451,1660742069,1661441160,1661502186,1661507724,1662467128,1663569995,1664300936,1663665519,1663871069,1664897165,1664988036,1665056530,1665138849,1665399117,1662636054,1665420690,1665477911,1665488828,1665524865,1665646849,1665588249,1665770699,1666034720,1666131819,1666145729,1666344635,1666398757,1666524436,1666598814,1666598828,1666598983,1666598987,1666598990,1666717223,1666886757,1666904087,1666939263,1667220502,1667220626,1667220628,1667220768,1667222952,1667259203,1667313173,1667395984,1667433265,1667497565,1667500111,1667825028,1667848448,1667863757,1667917030,1667950421,1667952974,1668174127,1668184279,1668179496,1668179619,1668603582,1668707631,1668767882,1668808118,1669184869,1669297489,1669576792,1669645608,1669836151,1670256530,1668813365,1670350006,1670539388,1670539913,1670542168,1670543231,1670870072,1670934184,1670600028,1671159453,1671463799,1671543381,1672884222,1673019611,1672897105,1673351808,1673405886,1673871310,1673897709,1674035302,1674041632,1674047296,1674455760,1674480050,1674669326,1674642349,1674669794,1674754280,1674814035,1674952295,1675155867,1675257827,1675194688,1675277218,1675277500,1675277968,1675296942,1675367314,1675647612,1675962678,1676996650,1677003167,1677005673,1677008591,1676272751,1676328864,1675850599,1675864432,1676420496,1676584791,1677073533,1677166643,1677242688,1677104938,1677483453,1677594756,1677607213,1677627515,1677627559,1677627566,1677694168,1677694170,1677700103,1677803354,1677811663,1677716184,1677716470,1677878270,1677944569,1677944752,1677945580,1677955553,1677958359,1678091683,1678112318,1678213774,1678220614,1678214530,1678290792,1678291091,1678291402,1678291831,1678320579,1678175532],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":15}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678380933,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678409821,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678456448,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678601228,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678899992,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678832491,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1678994673,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1680707560,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1681923094,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1681982430,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683053825,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683290474,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683641757,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684180461,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684831743,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"frontend"}}
migrator  | Schema(s) are up-to-date!

Upgrading to 5.1.4:

migrator  | ✱ Sourcegraph migrator 5.1.4
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"frontend","leafVersions":[1687792857]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"frontend","targetDefinitions":[1679058200,1679404397,1679426934,1679428966,1679432506,1679603787,1679690266,1680088638,1681300431,1681807446,1682012624,1682626931,1682114198,1682683129,1682598027,1683246005,1683295546,1683561153,1683593618,1682604499,1682967255,1683640362,1683670271,1683670735,1683753933,1683782561,1683913757,1684207923,1684217409,1684248574,1684306784,1683924275,1684396562,1684398004,1684429687,1684632550,1684771948,1684753192,1684854090,1684854389,1684933018,1685103392,1685105270,1685453088,1685495400,1685525992,1685562535,1685570436,1685695443,1685697346,1685727930,1685712730,1685645480,1684858266,1685983690,1685984018,1685999719,1686042710,1686169273,1686169626,1686208766,1686255261,1686415661,1686580819,1686723014,1686749117,1686282228,1686287028,1680296731,1687792857],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":70}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1679058200,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_ranking_path_counts_inputs","indexName":"codeintel_ranking_path_counts_inputs_graph_key_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1679404397,"tableName":"codeintel_ranking_path_counts_inputs","indexName":"codeintel_ranking_path_counts_inputs_graph_key_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1679058200,1679404397],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":68}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1679426934,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_ranking_references_processed","indexName":"codeintel_ranking_references_processed_reference_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1679428966,"tableName":"codeintel_ranking_references_processed","indexName":"codeintel_ranking_references_processed_reference_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1679058200,1679404397,1679426934,1679428966],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":66}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"cm_action_jobs","indexName":"cm_action_jobs_trigger_event","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1679432506,"tableName":"cm_action_jobs","indexName":"cm_action_jobs_trigger_event"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1679058200,1679404397,1679426934,1679428966,1679432506],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":65}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1679603787,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1679690266,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1680088638,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1681300431,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1681807446,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682012624,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682626931,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682114198,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682683129,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682598027,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683246005,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683295546,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683561153,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683593618,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682604499,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1682967255,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683640362,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683670271,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683670735,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683753933,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683782561,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683913757,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684207923,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684217409,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684248574,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684306784,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683924275,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684396562,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684398004,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684429687,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684632550,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684771948,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684753192,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684854090,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684854389,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_ranking_exports","indexName":"codeintel_ranking_exports_graph_key_deleted_at_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1684933018,"tableName":"codeintel_ranking_exports","indexName":"codeintel_ranking_exports_graph_key_deleted_at_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1679058200,1679404397,1679426934,1679428966,1679432506,1679603787,1679690266,1680088638,1681300431,1681807446,1682012624,1682626931,1682114198,1682683129,1682598027,1683246005,1683295546,1683561153,1683593618,1682604499,1682967255,1683640362,1683670271,1683670735,1683753933,1683782561,1683913757,1684207923,1684217409,1684248574,1684306784,1683924275,1684396562,1684398004,1684429687,1684632550,1684771948,1684753192,1684854090,1684854389,1684933018],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":29}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685103392,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685105270,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685453088,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685495400,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685525992,"up":true}}
migrator  | {"Body":"Checked progress of index creation","Attributes":{"result":{"schema":"frontend","tableName":"codeintel_initial_path_ranks_processed","indexName":"codeintel_initial_path_ranks_processed_codeintel_initial_path_ranks_id","exists":false,"isValid":false,"index status":{"in-progress":false}}}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Creating index concurrently","Attributes":{"schema":"frontend","migrationID":1685562535,"tableName":"codeintel_initial_path_ranks_processed","indexName":"codeintel_initial_path_ranks_processed_codeintel_initial_path_ranks_id"}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[1679058200,1679404397,1679426934,1679428966,1679432506,1679603787,1679690266,1680088638,1681300431,1681807446,1682012624,1682626931,1682114198,1682683129,1682598027,1683246005,1683295546,1683561153,1683593618,1682604499,1682967255,1683640362,1683670271,1683670735,1683753933,1683782561,1683913757,1684207923,1684217409,1684248574,1684306784,1683924275,1684396562,1684398004,1684429687,1684632550,1684771948,1684753192,1684854090,1684854389,1684933018,1685103392,1685105270,1685453088,1685495400,1685525992,1685562535],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":23}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685570436,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685695443,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685697346,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685727930,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685712730,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685645480,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684858266,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685983690,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685984018,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1685999719,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686042710,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686169273,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686169626,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686208766,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686255261,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686415661,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686580819,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686723014,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686749117,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686282228,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1686287028,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1680296731,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1687792857,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"codeinsights","leafVersions":[1679051112]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeinsights","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"codeinsights","targetDefinitions":[1679051112],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeinsights","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeinsights","up":true,"count":1}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1679051112,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"codeintel","leafVersions":[1686315964]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"codeintel","targetDefinitions":[1686315964],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeintel","up":true,"count":1}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1686315964,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"codeintel"}}
migrator  | ✅ Schema(s) are up-to-date!

Upgrading to 5.1.5 (from v5.0.6):

migrator  | ✱ Sourcegraph migrator 5.1.5
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"codeinsights","leafVersions":[1679051112]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeinsights","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"codeinsights","targetDefinitions":[1679051112],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeinsights","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeinsights","up":true,"count":1}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeinsights","migrationID":1679051112,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"codeinsights"}}
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"frontend","leafVersions":[1687792857]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"frontend","targetDefinitions":[1683593618,1684207923,1684771948,1684753192,1684854090,1684854389,1684933018,1685103392,1685105270,1685453088,1685495400,1685525992,1685562535,1685570436,1685695443,1685697346,1685727930,1685712730,1685645480,1684858266,1685983690,1685984018,1685999719,1686042710,1686169273,1686169626,1686208766,1686255261,1686415661,1686580819,1686723014,1686749117,1686282228,1686287028,1680296731,1687792857],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"frontend","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"frontend","up":true,"count":36}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1683593618,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684207923,"up":true}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"frontend","migrationID":1684771948,"up":true}}
migrator  | {"Body":"operation.error","Attributes":{"count":1,"elapsed":0.001722792,"error":"ERROR: relation \"github_apps\" does not exist (SQLSTATE 42P01)"}}
migrator  | {"Body":"operation.error","Attributes":{"count":1,"elapsed":0.010306667,"error":"failed to apply migration 1684771948:\n```\nALTER TABLE github_apps\n    ADD COLUMN IF NOT EXISTS domain TEXT NOT NULL DEFAULT 'repos';\n```: ERROR: relation \"github_apps\" does not exist (SQLSTATE 42P01)"}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"frontend"}}
migrator  | {"Body":"Desugaring `upgrade` to `targeted up` operation","Attributes":{"schema":"codeintel","leafVersions":[1686315964]}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Schema is not in the expected state - applying migration delta","Attributes":{"schema":"codeintel","targetDefinitions":[1686315964],"appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Acquired schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Checked current schema state","Attributes":{"schema":"codeintel","appliedVersions":[],"pendingVersions":[],"failedVersions":[]}}
migrator  | {"Body":"Applying migrations","Attributes":{"schema":"codeintel","up":true,"count":1}}
migrator  | {"Body":"Applying migration","Attributes":{"schema":"codeintel","migrationID":1686315964,"up":true}}
migrator  | {"Body":"Released schema migration lock","Attributes":{"schema":"codeintel"}}
migrator  | {"Body":"Schema is in the expected state","Attributes":{"schema":"codeintel"}}
migrator  | failed to run migration for schema "frontend": failed to apply migration 1684771948:
migrator  | ```
migrator  | ALTER TABLE github_apps
migrator  |     ADD COLUMN IF NOT EXISTS domain TEXT NOT NULL DEFAULT 'repos';
migrator  | ```: ERROR: relation "github_apps" does not exist (SQLSTATE 42P01)