From 8813f9faf9dd8dee84eafd64c36cb7ed74264528 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Wed, 22 Jan 2025 16:09:39 -0600 Subject: [PATCH 01/19] DOCSP-45958 1.10.0 Release Notes --- source/release-notes/1.10.txt | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 1494b40c7..d46cb451d 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -14,8 +14,6 @@ Release Notes for mongosync 1.10 .. include:: /includes/in-dev.rst -.. _1.10.0-c2c-release-notes: - This page describes changes and new features introduced in {+c2c-full-product-name+} 1.10. @@ -37,6 +35,11 @@ To learn more, see: - :ref:`Pre-6.0 Migration Permissions `. - :ref:`c2c-sync-different-versions`. +.. _1.10.0-c2c-release-notes: + +1.10.0 Release +-------------- + Upgrades to Embedded Verifier ----------------------------- From f1c8576238b5323228c1d6ff7fea0ecfc32be7f1 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Wed, 22 Jan 2025 16:26:16 -0600 Subject: [PATCH 02/19] Adds minimum supported version --- source/release-notes/1.10.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index d46cb451d..67172b351 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -43,7 +43,7 @@ To learn more, see: Upgrades to Embedded Verifier ----------------------------- -.. include:: /includes/verify-reversible-migrations.rst +- .. include:: /includes/verify-reversible-migrations.rst Minimum Supported Version ------------------------- From 93a6826e9c44edba34405fbec425ee62e01fd985 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Thu, 23 Jan 2025 11:11:23 -0600 Subject: [PATCH 03/19] Adjusts text --- source/release-notes/1.10.txt | 2 ++ 1 file changed, 2 insertions(+) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 67172b351..63eb450b9 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -40,6 +40,8 @@ To learn more, see: 1.10.0 Release -------------- +**Upcoming** + Upgrades to Embedded Verifier ----------------------------- From c1eb39002269a3d61fe52bef86bb7d83a3943a6c Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Mon, 27 Jan 2025 16:45:57 -0600 Subject: [PATCH 04/19] Adds RN --- source/release-notes/1.10.txt | 62 +++++++++++++++++++++++++++++++++++ 1 file changed, 62 insertions(+) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 63eb450b9..9a862bf74 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -47,6 +47,68 @@ Upgrades to Embedded Verifier - .. include:: /includes/verify-reversible-migrations.rst +Other Notes +^^^^^^^^^^^ + +Fixed Issues: + +- Fixed a bug introduced in v1.3.0 that could result in a + descending index with a small negative float index key value + to be migrated as an ascending index. + +- Fixed a bug introduced in v1.9.0 where the embedded verifier + could incorrectly report failure if a TTL index was dropped on + the source cluster during a migration. + +- Fixed a bug introduced in v1.0.0 that could result in an + unversioned 2dsphere index to be migrated as a v3 2dsphere + index. + +- Fixed a bug introduced in v1.9.0 where the embedded verifier + incorrectly reported failure for collections with TTLs with a + 0-second ``expireAfterSeconds`` value. + +- Mitigated an issue introduced in v1.0.0 that could result in + ``mongosync`` timing out during initialization when sampling a + source collection and pre-splitting the corresponding + destination collection. + +- Added the number of empty source collections that mongosync + detects and creates on the destination to Atlas migration + metrics ``NumCollectionsTotal`` and ``NumCollections``. + +New Features: + +- Added support for migrations with 4.4 and 5.0 source clusters. + +- Added full support for embedded verification of reversible + migrations. Previously, verification was only supported in the + initial forward-direction of a reversible migration. + +- Added support for embedded verification of sharded clusters + +- Added support for migrations from 6.0 and 7.0 sources to 8.0 + destinations. + +- Added a new :option:`--disableVerification` option and + :setting:`disableVerification` setting to ``mongosync``. + +Performance Improvements: + +- Improved the partitioning algorithm for large source + collections. ``mongosync`` now directly samples documents from + WiredTiger instead of scanning the whole ``_id`` index. + +Other: + +- ``mongosync`` now provides RHEL 9 builds. + +- ``mongosync`` now disallows setting ``socketTimeoutMS`` in + connection strings. This is a deprecated parameter. + +- ``mongosync`` now disallows being restarted during commit if + verification is enabled. + Minimum Supported Version ------------------------- From ca0304b990a3dfde756246dc3f91f6cc61f8c243 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 10:24:30 -0600 Subject: [PATCH 05/19] Adds 8.0 source to table --- source/reference/supported-server-version.txt | 7 +++++++ source/release-notes/1.10.txt | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/source/reference/supported-server-version.txt b/source/reference/supported-server-version.txt index 6aaf8b850..5035dc8e6 100644 --- a/source/reference/supported-server-version.txt +++ b/source/reference/supported-server-version.txt @@ -75,6 +75,13 @@ destination MongoDB server versions: :ref:`Pre-6.0 Migration Limitations ` + * - **8.0** Source + - + - + - + - + - + .. _c2c-server-8.0-to-8.0: Synchronize Data Between Two 8.0 Clusters diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 9a862bf74..4dc6cbb3f 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -106,7 +106,7 @@ Other: - ``mongosync`` now disallows setting ``socketTimeoutMS`` in connection strings. This is a deprecated parameter. -- ``mongosync`` now disallows being restarted during commit if +- ``mongosync`` now disallows being restarted during commit when verification is enabled. Minimum Supported Version From 3bfa5fe272f9aa1c9ba528969147d51148e86a98 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 10:37:47 -0600 Subject: [PATCH 06/19] Fixes build issue --- source/reference/supported-server-version.txt | 7 ------- 1 file changed, 7 deletions(-) diff --git a/source/reference/supported-server-version.txt b/source/reference/supported-server-version.txt index 5035dc8e6..6aaf8b850 100644 --- a/source/reference/supported-server-version.txt +++ b/source/reference/supported-server-version.txt @@ -75,13 +75,6 @@ destination MongoDB server versions: :ref:`Pre-6.0 Migration Limitations ` - * - **8.0** Source - - - - - - - - - - - .. _c2c-server-8.0-to-8.0: Synchronize Data Between Two 8.0 Clusters From b34de4938adddb667ecd364ac221558d34619813 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 11:07:21 -0600 Subject: [PATCH 07/19] Updates release date --- source/release-notes/1.10.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 4dc6cbb3f..daeed1410 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -40,7 +40,7 @@ To learn more, see: 1.10.0 Release -------------- -**Upcoming** +**January 29, 2025** Upgrades to Embedded Verifier ----------------------------- From b014e3bd3879de75afc595bb10c9c17894bb5127 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 13:22:42 -0600 Subject: [PATCH 08/19] Migrates table to include --- .../includes/table-pre-6.0-compatibility.rst | 32 ++++++++++++++++--- 1 file changed, 27 insertions(+), 5 deletions(-) diff --git a/source/includes/table-pre-6.0-compatibility.rst b/source/includes/table-pre-6.0-compatibility.rst index 2fd3ca213..8cb22ecc5 100644 --- a/source/includes/table-pre-6.0-compatibility.rst +++ b/source/includes/table-pre-6.0-compatibility.rst @@ -1,24 +1,46 @@ .. list-table:: :header-rows: 1 :stub-columns: 1 - :widths: 40 30 30 + :widths: 30 14 14 14 14 14 * - - - **6.0 Destination** - - **7.0 Destination** + - **4.4 Destination + - **5.0 Destination** + - **6.0 Destination** + - **7.0 Destination** + - **8.0 Destination** * - **4.4 Source** - √ - - + - √ + - √ + - √ + - √ * - **5.0 Source** - √ - √ + - √ + - √ + - √ * - **6.0 Source** - √ - √ + - √ + - √ + - √ * - **7.0 Source** - - - √ + - √ + - √ + - √ + - √ + * - **8.0 Source** + - + - + - + - + - + From 15d84b22532202268467206d460fae2480f5817b Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 13:27:13 -0600 Subject: [PATCH 09/19] RN refactor --- source/release-notes/1.10.txt | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index daeed1410..4b5b98fc2 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -17,10 +17,22 @@ Release Notes for mongosync 1.10 This page describes changes and new features introduced in {+c2c-full-product-name+} 1.10. +.. _1.10.0-c2c-release-notes: + +1.10.0 Release +-------------- + +**January 29, 2025** + +Upgrades to Embedded Verifier +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +- .. include:: /includes/verify-reversible-migrations.rst + .. _c2c-older-version-support: Older Version Support ---------------------- +~~~~~~~~~~~~~~~~~~~~~ .. include:: /includes/fact-pre-6.0-migration.rst @@ -35,20 +47,8 @@ To learn more, see: - :ref:`Pre-6.0 Migration Permissions `. - :ref:`c2c-sync-different-versions`. -.. _1.10.0-c2c-release-notes: - -1.10.0 Release --------------- - -**January 29, 2025** - -Upgrades to Embedded Verifier ------------------------------ - -- .. include:: /includes/verify-reversible-migrations.rst - Other Notes -^^^^^^^^^^^ +~~~~~~~~~~~ Fixed Issues: From bed047e4b428d09401b7a839fd6db020462ba477 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 13:34:17 -0600 Subject: [PATCH 10/19] Fixes build issue --- source/includes/table-pre-6.0-compatibility.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/includes/table-pre-6.0-compatibility.rst b/source/includes/table-pre-6.0-compatibility.rst index 8cb22ecc5..e002bd4fa 100644 --- a/source/includes/table-pre-6.0-compatibility.rst +++ b/source/includes/table-pre-6.0-compatibility.rst @@ -4,7 +4,7 @@ :widths: 30 14 14 14 14 14 * - - - **4.4 Destination + - **4.4 Destination** - **5.0 Destination** - **6.0 Destination** - **7.0 Destination** From d5a76b826561b793027a2f54f00a399c18007514 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 15:14:35 -0600 Subject: [PATCH 11/19] Fixes per Johnny --- source/release-notes/1.10.txt | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 4b5b98fc2..95874ed78 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -52,9 +52,9 @@ Other Notes Fixed Issues: -- Fixed a bug introduced in v1.3.0 that could result in a - descending index with a small negative float index key value - to be migrated as an ascending index. +- Fixed a bug introduced in v1.3.0 where descending indexes with + key values between -1e-9 and 0 could be incorrectly migrated + as ascending. - Fixed a bug introduced in v1.9.0 where the embedded verifier could incorrectly report failure if a TTL index was dropped on @@ -85,7 +85,7 @@ New Features: migrations. Previously, verification was only supported in the initial forward-direction of a reversible migration. -- Added support for embedded verification of sharded clusters +- Added support for embedded verification of sharded clusters. - Added support for migrations from 6.0 and 7.0 sources to 8.0 destinations. From d45ef63a68ad902dbb4ff1e9819e79664b1fd0a0 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 15:21:26 -0600 Subject: [PATCH 12/19] Fixes per Johnny --- source/release-notes/1.10.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 95874ed78..46e781011 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -61,7 +61,7 @@ Fixed Issues: the source cluster during a migration. - Fixed a bug introduced in v1.0.0 that could result in an - unversioned 2dsphere index to be migrated as a v3 2dsphere + unversioned 2dsphere index being migrated as a v3 2dsphere index. - Fixed a bug introduced in v1.9.0 where the embedded verifier From 107eb8597f36fd528d0a4b9e671b85e3929585a8 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 15:23:28 -0600 Subject: [PATCH 13/19] Fixes per Johnny --- source/release-notes/1.10.txt | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 46e781011..6ced39717 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -65,8 +65,8 @@ Fixed Issues: index. - Fixed a bug introduced in v1.9.0 where the embedded verifier - incorrectly reported failure for collections with TTLs with a - 0-second ``expireAfterSeconds`` value. + incorrectly reported failure for collections with TTLs where + ``expireAfterSeconds: 0``. - Mitigated an issue introduced in v1.0.0 that could result in ``mongosync`` timing out during initialization when sampling a From 68cc2ae03e8be15bb37474ae0afa987f2d242b87 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 15:25:28 -0600 Subject: [PATCH 14/19] Fixes per Johnny --- source/release-notes/1.10.txt | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index 6ced39717..e1307dc24 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -60,9 +60,8 @@ Fixed Issues: could incorrectly report failure if a TTL index was dropped on the source cluster during a migration. -- Fixed a bug introduced in v1.0.0 that could result in an - unversioned 2dsphere index being migrated as a v3 2dsphere - index. +- Fixed a bug introduced in v1.0.0 that caused unversioned + 2dsphere indexes to be migrated as v3 2dsphere indexes. - Fixed a bug introduced in v1.9.0 where the embedded verifier incorrectly reported failure for collections with TTLs where From 5dbffe41de12c9ab5b883d3dbefe7fc7a0e06a73 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 15:32:33 -0600 Subject: [PATCH 15/19] Fixes per Johnny --- source/release-notes/1.10.txt | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index e1307dc24..f9a95e2de 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -53,7 +53,7 @@ Other Notes Fixed Issues: - Fixed a bug introduced in v1.3.0 where descending indexes with - key values between -1e-9 and 0 could be incorrectly migrated + key values between -1e-9 and 0 could incorrectly migrate as ascending. - Fixed a bug introduced in v1.9.0 where the embedded verifier @@ -61,10 +61,10 @@ Fixed Issues: the source cluster during a migration. - Fixed a bug introduced in v1.0.0 that caused unversioned - 2dsphere indexes to be migrated as v3 2dsphere indexes. + 2dsphere indexes to migrate as v3 2dsphere indexes. - Fixed a bug introduced in v1.9.0 where the embedded verifier - incorrectly reported failure for collections with TTLs where + incorrectly report failure for collections with TTLs where ``expireAfterSeconds: 0``. - Mitigated an issue introduced in v1.0.0 that could result in @@ -72,9 +72,10 @@ Fixed Issues: source collection and pre-splitting the corresponding destination collection. -- Added the number of empty source collections that mongosync - detects and creates on the destination to Atlas migration - metrics ``NumCollectionsTotal`` and ``NumCollections``. +- Added the number of empty source collections that + ``mongosync`` detects and creates on the destination to Atlas + migration metrics ``NumCollectionsTotal`` and + ``NumCollections``. New Features: From e2c7caa87373a40fcc511b03469a757de7b538be Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Tue, 28 Jan 2025 15:34:20 -0600 Subject: [PATCH 16/19] Fixes per Johnny --- source/release-notes/1.10.txt | 5 ----- 1 file changed, 5 deletions(-) diff --git a/source/release-notes/1.10.txt b/source/release-notes/1.10.txt index f9a95e2de..9d7cc5a68 100644 --- a/source/release-notes/1.10.txt +++ b/source/release-notes/1.10.txt @@ -72,11 +72,6 @@ Fixed Issues: source collection and pre-splitting the corresponding destination collection. -- Added the number of empty source collections that - ``mongosync`` detects and creates on the destination to Atlas - migration metrics ``NumCollectionsTotal`` and - ``NumCollections``. - New Features: - Added support for migrations with 4.4 and 5.0 source clusters. From 798494e072aea1efee0cb84ec0226d3f38623e0c Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Wed, 29 Jan 2025 11:02:52 -0600 Subject: [PATCH 17/19] Fixes per Evgeni --- .../includes/table-pre-6.0-compatibility.rst | 24 +++++++++---------- 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/source/includes/table-pre-6.0-compatibility.rst b/source/includes/table-pre-6.0-compatibility.rst index e002bd4fa..b060a2935 100644 --- a/source/includes/table-pre-6.0-compatibility.rst +++ b/source/includes/table-pre-6.0-compatibility.rst @@ -11,30 +11,30 @@ - **8.0 Destination** * - **4.4 Source** + - + - - √ - - √ - - √ - - √ - - √ + - + - * - **5.0 Source** + - + - - √ - √ - - √ - - √ - - √ + - * - **6.0 Source** - - √ - - √ + - + - - √ - √ - √ * - **7.0 Source** - - √ - - √ - - √ + - + - + - - √ - √ * - **8.0 Source** From e4498943501fd64e40f90a94e9243640cbe885a2 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Wed, 29 Jan 2025 11:40:43 -0600 Subject: [PATCH 18/19] Fixes per Evgeni --- source/includes/table-pre-6.0-compatibility.rst | 12 ------------ 1 file changed, 12 deletions(-) diff --git a/source/includes/table-pre-6.0-compatibility.rst b/source/includes/table-pre-6.0-compatibility.rst index b060a2935..6a7d5d073 100644 --- a/source/includes/table-pre-6.0-compatibility.rst +++ b/source/includes/table-pre-6.0-compatibility.rst @@ -4,36 +4,26 @@ :widths: 30 14 14 14 14 14 * - - - **4.4 Destination** - - **5.0 Destination** - **6.0 Destination** - **7.0 Destination** - **8.0 Destination** * - **4.4 Source** - - - - - √ - - * - **5.0 Source** - - - - - √ - √ - * - **6.0 Source** - - - - - √ - √ - √ * - **7.0 Source** - - - - - - √ - √ @@ -41,6 +31,4 @@ - - - - - - - From 79ceda05acea9c24721a4e5d9d274d92671b6365 Mon Sep 17 00:00:00 2001 From: "Kenneth P. J. Dyer" Date: Wed, 29 Jan 2025 11:41:20 -0600 Subject: [PATCH 19/19] Fixes build issue --- source/includes/table-pre-6.0-compatibility.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/source/includes/table-pre-6.0-compatibility.rst b/source/includes/table-pre-6.0-compatibility.rst index 6a7d5d073..c41cbf831 100644 --- a/source/includes/table-pre-6.0-compatibility.rst +++ b/source/includes/table-pre-6.0-compatibility.rst @@ -1,7 +1,7 @@ .. list-table:: :header-rows: 1 :stub-columns: 1 - :widths: 30 14 14 14 14 14 + :widths: 30 14 14 14 * - - **6.0 Destination**