Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
4cfa97a
[wip] MOLT Replicator draft docs
taroface Sep 16, 2025
01cb4a8
fix links
taroface Oct 1, 2025
c84c05c
fix more links
taroface Oct 1, 2025
56fdf25
Merge branch 'main' into molt-replicator
taroface Oct 14, 2025
8ce2c47
address review comments
taroface Oct 17, 2025
2c5426e
Merge branch 'main' into molt-replicator
taroface Oct 17, 2025
a32aac3
Update src/current/_includes/molt/migration-prepare-database.md
taroface Oct 17, 2025
bc7fe84
restructure replication-only doc
taroface Oct 18, 2025
bfabec1
review feedback and improvements
taroface Oct 20, 2025
ee821ed
add Replicator security content; refine includes
taroface Oct 21, 2025
95207a2
update MOLT Replicator doc & related
taroface Oct 22, 2025
c363464
update MOLT diagram; clean up MOLT docs
taroface Oct 22, 2025
5fae7fc
Merge branch 'main' into molt-replicator
taroface Oct 22, 2025
6c02b9b
enhance flags and user permissions
taroface Oct 22, 2025
397fcfb
Merge remote-tracking branch 'origin/molt-replicator' into molt-repli…
taroface Oct 22, 2025
1d35651
release notes; fix links
taroface Oct 22, 2025
7d855e2
fix links
taroface Oct 22, 2025
9667d57
add MOLT Fetch export retry flags
taroface Oct 22, 2025
09cef1d
new Replicator metrics; reviewer comments
taroface Oct 23, 2025
b130ce2
Apply suggestions from code review
taroface Oct 23, 2025
a3da547
final review comments
taroface Oct 23, 2025
0181866
Merge branch 'main' into molt-replicator
taroface Oct 23, 2025
4596eaa
fix link
taroface Oct 23, 2025
145672b
Merge remote-tracking branch 'origin/molt-replicator' into molt-repli…
taroface Oct 23, 2025
32f385c
Update release date
taroface Oct 24, 2025
5176df6
Merge branch 'main' into molt-replicator
taroface Oct 24, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions src/current/_data/redirects.yml
Original file line number Diff line number Diff line change
Expand Up @@ -299,6 +299,12 @@
- destination: molt/migrate-data-load-and-replication.md
sources: [':version/migrate-from-postgres.md']

- destination: molt/migrate-load-replicate.md
sources: ['molt/migrate-data-load-replicate-only.md']

- destination: molt/migrate-resume-replication.md
sources: ['molt/migrate-replicate-only.md']

- destination: molt/migration-overview.md
sources: [':version/migration-overview.md']

Expand Down
3 changes: 3 additions & 0 deletions src/current/_includes/molt/crdb-to-crdb-migration.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
{{site.data.alerts.callout_info}}
For CockroachDB-to-CockroachDB migrations, contact your account team for guidance.
{{site.data.alerts.end}}
28 changes: 14 additions & 14 deletions src/current/_includes/molt/fetch-data-load-output.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,16 @@
1. Check the output to observe `fetch` progress.

{% if page.name == "migrate-load-replicate.md" %}
<section class="filter-content" markdown="1" data-scope="oracle">
The following message shows the appropriate values for the `--backfillFromSCN` and `--scn` replication flags to use when [starting Replicator](#start-replicator):

{% include_cached copy-clipboard.html %}
~~~
replication-only mode should include the following replicator flags: --backfillFromSCN 26685444 --scn 26685786
~~~
</section>
{% endif %}

A `starting fetch` message indicates that the task has started:

<section class="filter-content" markdown="1" data-scope="postgres">
Expand All @@ -16,7 +27,7 @@

<section class="filter-content" markdown="1" data-scope="oracle">
~~~ json
{"level":"info","type":"summary","num_tables":3,"cdc_cursor":"2358840","time":"2025-02-10T14:28:11-05:00","message":"starting fetch"}
{"level":"info","type":"summary","num_tables":3,"cdc_cursor":"26685786","time":"2025-02-10T14:28:11-05:00","message":"starting fetch"}
~~~
</section>

Expand Down Expand Up @@ -68,7 +79,7 @@
~~~

{% if page.name != "migrate-bulk-load.md" %}
This message includes a `cdc_cursor` value. You must set the `--defaultGTIDSet` replication flag to this value when starting [`replication-only` mode](#replicate-changes-to-cockroachdb):
This message includes a `cdc_cursor` value. You must set the `--defaultGTIDSet` replication flag to this value when [starting Replicator](#start-replicator):

{% include_cached copy-clipboard.html %}
~~~
Expand All @@ -81,15 +92,4 @@
~~~ json
{"level":"info","type":"summary","fetch_id":"f5cb422f-4bb4-4bbd-b2ae-08c4d00d1e7c","num_tables":3,"tables":["migration_schema.employees","migration_schema.payments","migration_schema.payments"],"cdc_cursor":"2358840","net_duration_ms":6752.847625,"net_duration":"000h 00m 06s","time":"2024-03-18T12:30:37-04:00","message":"fetch complete"}
~~~
</section>

{% if page.name == "migrate-data-load-replicate-only.md" %}
<section class="filter-content" markdown="1" data-scope="oracle">
The following message shows the appropriate values for the `--backfillFromSCN` and `--scn` replication flags to use when [starting`replication-only` mode](#replicate-changes-to-cockroachdb):

{% include_cached copy-clipboard.html %}
~~~
replication-only mode should include the following replicator flags: --backfillFromSCN 26685444 --scn 26685786
~~~
</section>
{% endif %}
</section>
2 changes: 2 additions & 0 deletions src/current/_includes/molt/fetch-metrics.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
### Fetch metrics

By default, MOLT Fetch exports [Prometheus](https://prometheus.io/) metrics at `http://127.0.0.1:3030/metrics`. You can override the address with `--metrics-listen-addr '{host}:{port}'`, where the endpoint will be `http://{host}:{port}/metrics`.

Cockroach Labs recommends monitoring the following metrics during data load:
Expand Down
4 changes: 2 additions & 2 deletions src/current/_includes/molt/fetch-replication-output.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,8 +19,8 @@
DEBUG [Jan 22 13:52:40] upserted rows conflicts=0 duration=7.620208ms proposed=1 target="\"molt\".\"migration_schema\".\"employees\"" upserted=1
~~~

{% if page.name != "migrate-replicate-only.md" %}
{% if page.name != "migrate-resume-replication.md" %}
{{site.data.alerts.callout_success}}
If replication is interrupted, you can [resume replication]({% link molt/migrate-replicate-only.md %}).
If replication is interrupted, you can [resume replication]({% link molt/migrate-resume-replication.md %}).
{{site.data.alerts.end}}
{% endif %}
92 changes: 0 additions & 92 deletions src/current/_includes/molt/fetch-replicator-flags.md

This file was deleted.

34 changes: 0 additions & 34 deletions src/current/_includes/molt/fetch-secure-connection-strings.md

This file was deleted.

4 changes: 2 additions & 2 deletions src/current/_includes/molt/fetch-table-filter-userscript.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,8 @@ api.configureSource("defaultdb.migration_schema", {
});
~~~

Pass the userscript to MOLT Fetch with the `--userscript` [replication flag](#replication-flags):
Pass the userscript to MOLT Replicator with the `--userscript` [flag](#replication-flags):

~~~
--replicator-flags "--userscript table_filter.ts"
--userscript table_filter.ts
~~~
Loading
Loading