You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
RDI requires that your Aurora MySQL database has at least one replica or reader node.
@@ -33,11 +39,19 @@ To add a reader node to an existing database, select **Add reader** from the **A
33
39
34
40
You can also create one during database creation by selecting **Create an Aurora Replica or Reader node in a different AZ (recommended for scaled availability)** under **Availability & durability > Multi-AZ deployment**.
35
41
36
-
## Create and apply parameter group
42
+
## <aid="aurora-create-and-apply-parameter-group"></a>Create and apply parameter group
37
43
38
44
RDI requires some changes to database parameters. On AWS Aurora, you change these parameters via a parameter group.
39
45
40
-
1. In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/),navigate to **Parameter groups > Create parameter group**. [Create a parameter group](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_WorkingWithParamGroups.Creating.html) with the following settings:
- [ ] [Create a parameter group](#aurora-create-a-parameter-group)
48
+
- [ ] [Apply the parameter group](#aurora-apply-the-parameter-group)
49
+
- [ ] [Apply the parameter group to the database](#aurora-apply-the-parameter-group-to-the-database)
50
+
- [ ] [Reboot the database instance](#aurora-reboot-the-database-instance)
51
+
```
52
+
53
+
1. <aid="aurora-create-a-parameter-group"></a>
54
+
In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/),navigate to **Parameter groups > Create parameter group**. [Create a parameter group](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_WorkingWithParamGroups.Creating.html) with the following settings:
41
55
42
56
| Name | Value |
43
57
| :-- | :-- |
@@ -49,7 +63,8 @@ RDI requires some changes to database parameters. On AWS Aurora, you change thes
49
63
50
64
Select **Create** to create the parameter group.
51
65
52
-
1. Navigate to **Parameter groups** in the console. Select the parameter group you have just created and then select **Edit**. Change the following parameters:
66
+
1. <aid="aurora-apply-the-parameter-group"></a>
67
+
Navigate to **Parameter groups** in the console. Select the parameter group you have just created and then select **Edit**. Change the following parameters:
53
68
54
69
| Name | Value |
55
70
| :-- | :-- |
@@ -60,22 +75,38 @@ RDI requires some changes to database parameters. On AWS Aurora, you change thes
60
75
61
76
Select **Save Changes** to apply the changes to the parameter group.
62
77
63
-
1. Go back to your target database on the RDS console, select **Modify** and then scroll down to **Additional Configuration**. Set the **DB Cluster Parameter Group** to the group you just created.
Go back to your target database on the RDS console, select **Modify** and then scroll down to **Additional Configuration**. Set the **DB Cluster Parameter Group** to the group you just created.
64
80
65
81
Select **Save changes** to apply the parameter group to the new database.
66
82
67
-
1. Reboot your database instance. See [Rebooting a DB instance within an Aurora cluster](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-reboot-db-instance.html) for more information.
Reboot your database instance. See [Rebooting a DB instance within an Aurora cluster](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-reboot-db-instance.html) for more information.
## <aid="rds-create-and-apply-parameter-group"></a>Create and apply parameter group
75
98
76
99
RDI requires some changes to database parameters. On AWS RDS, you change these parameters via a parameter group.
77
100
78
-
1. In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/),navigate to **Parameter groups > Create parameter group**. [Create a parameter group](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Creating.html) with the following settings:
- [ ] [Create a parameter group](#rds-create-a-parameter-group)
103
+
- [ ] [Apply the parameter group](#rds-apply-the-parameter-group)
104
+
- [ ] [Apply the parameter group to the database](#rds-apply-the-parameter-group-to-the-database)
105
+
- [ ] [Reboot the database instance](#rds-reboot-the-database-instance)
106
+
```
107
+
108
+
1. <aid="rds-create-a-parameter-group"></a>
109
+
In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/),navigate to **Parameter groups > Create parameter group**. [Create a parameter group](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithParamGroups.Creating.html) with the following settings:
79
110
80
111
| Name | Value |
81
112
| :-- | :-- |
@@ -86,7 +117,8 @@ RDI requires some changes to database parameters. On AWS RDS, you change these p
86
117
87
118
Select **Create** to create the parameter group.
88
119
89
-
1. Navigate to **Parameter groups** in the console. Select the parameter group you have just created and then select **Edit**. Change the following parameters:
120
+
1. <aid="rds-apply-the-parameter-group"></a>
121
+
Navigate to **Parameter groups** in the console. Select the parameter group you have just created and then select **Edit**. Change the following parameters:
90
122
91
123
| Name | Value |
92
124
| :-- | :-- |
@@ -95,11 +127,15 @@ RDI requires some changes to database parameters. On AWS RDS, you change these p
95
127
96
128
Select **Save Changes** to apply the changes to the parameter group.
97
129
98
-
1. Go back to your target database on the RDS console, select **Modify** and then scroll down to **Additional Configuration**. Set the **DB Cluster Parameter Group** to the group you just created.
Go back to your target database on the RDS console, select **Modify** and then scroll down to **Additional Configuration**. Set the **DB Cluster Parameter Group** to the group you just created.
99
132
100
133
Select **Save changes** to apply the parameter group to the new database.
101
134
102
-
1. Reboot your database instance. See [Rebooting a DB instance](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_RebootInstance.html) for more information.
135
+
1. <aid="rds-reboot-the-database-instance"></a>
136
+
Reboot your database instance. See [Rebooting a DB instance](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_RebootInstance.html) for more information.
RDI requires some changes to database parameters. On AWS RDS and AWS Aurora, you change these parameters via a parameter group.
29
34
30
-
1. In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/), navigate to **Parameter groups > Create parameter group**. [Create a parameter group](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_WorkingWithParamGroups.CreatingCluster.html) with the following settings:
- [ ] [Create a parameter group](#create-a-parameter-group)
37
+
- [ ] [Apply the parameter group](#apply-the-parameter-group)
38
+
- [ ] [Apply the parameter group to the database](#apply-the-parameter-group-to-the-database)
39
+
- [ ] [Reboot the database instance](#reboot-the-database-instance)
40
+
```
41
+
42
+
1. <aid="create-a-parameter-group"></a>
43
+
In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/), navigate to **Parameter groups > Create parameter group**. [Create a parameter group](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_WorkingWithParamGroups.CreatingCluster.html) with the following settings:
31
44
32
45
| Name | Value |
33
46
| :-- | :-- |
@@ -38,43 +51,55 @@ RDI requires some changes to database parameters. On AWS RDS and AWS Aurora, you
38
51
39
52
Select **Create** to create the parameter group.
40
53
41
-
1. Navigate to **Parameter groups** in the console. Select the group you have just created and then select **Edit**. Change the following parameters:
54
+
1. <aid="apply-the-parameter-group"></a>
55
+
Navigate to **Parameter groups** in the console. Select the group you have just created and then select **Edit**. Change the following parameters:
42
56
43
57
| Name | Value |
44
58
| :-- | :-- |
45
59
|`rds.logical_replication`|`1`|
46
60
47
61
Select **Save Changes** to apply the changes to the parameter group.
48
62
49
-
1. Go back to your database on the RDS console, select **Modify** and then scroll down to **Additional Configuration**. Set the **DB Cluster Parameter Group** to the group you just created.
Go back to your database on the RDS console, select **Modify** and then scroll down to **Additional Configuration**. Set the **DB Cluster Parameter Group** to the group you just created.
50
65
51
66
Select **Save changes** to apply the parameter group to your database.
52
67
53
-
1. Reboot your database instance. See [Rebooting a DB instance within an Aurora cluster](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-reboot-db-instance.html) or [Rebooting a DB instance (RDS)](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_RebootInstance.html) for more information.
68
+
1. <aid="reboot-the-database-instance"></a>
69
+
Reboot your database instance. See [Rebooting a DB instance within an Aurora cluster](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-reboot-db-instance.html) or [Rebooting a DB instance (RDS)](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_RebootInstance.html) for more information.
54
70
55
71
## Create Debezium user
56
72
57
73
The Debezium connector needs a user account to connect to PostgreSQL. This
58
74
user must have appropriate permissions on all databases where you want Debezium
59
75
to capture changes.
60
76
61
-
1. Connect to PostgreSQL as the `postgres` user and create a new user for the connector:
Copy file name to clipboardExpand all lines: content/integrate/redis-data-integration/data-pipelines/prepare-dbs/aws-aurora-rds/aws-rds-sqlserver.md
+26-5Lines changed: 26 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,13 +22,24 @@ Follow the steps in the sections below to prepare a [Microsoft SQL Server on AWS
22
22
Change Data Capture (CDC) is not supported on SQL Server Express Edition. Only the Standard, Enterprise, and Developer editions support CDC and are supported by RDI.
Copy file name to clipboardExpand all lines: content/integrate/redis-data-integration/data-pipelines/prepare-dbs/mongodb.md
+15-1Lines changed: 15 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,7 +25,7 @@ This guide describes the steps required to prepare a MongoDB database as a sourc
25
25
{{< note >}}The MongoDB connector is not capable of monitoring the changes of a standalone MongoDB server, since standalone servers do not have an oplog. The connector will work if the standalone server is converted to a replica set with one member.{{< /note >}}
26
26
## Summary
27
27
28
-
The following table summarizes the steps to prepare a MongoDB database for RDI. The sections below explain the steps in more detail.
28
+
The following table summarizes the considerations to prepare a MongoDB database for RDI.
@@ -37,6 +37,20 @@ The following table summarizes the steps to prepare a MongoDB database for RDI.
37
37
| MongoDB Atlas |**[SSL required](https://debezium.io/documentation/reference/stable/connectors/mongodb.html#mongodb-property-mongodb-ssl-enabled)**, provide root CA as `SOURCE_DB_CACERT` secret in RDI |
38
38
| Network | RDI Collector must reach all MongoDB nodes on required ports |
39
39
40
+
The following checklist shows the steps to prepare a MongoDB database for RDI,
41
+
with links to the sections that explain the steps in full detail.
42
+
You may find it helpful to track your progress with the checklist as you
- [ ] [Enable change streams and pre/post images (only if using a custom key)](#4-enable-change-streams-and-prepost-images-only-if-using-a-custom-key)
50
+
- [ ] [MongoDB Atlas specific requirements](#5-mongodb-atlas-specific-requirements)
51
+
- [ ] [Network and security](#6-network-and-security)
52
+
```
53
+
40
54
## 1. Configure oplog size
41
55
42
56
The Debezium MongoDB connector relies on the [oplog](https://www.mongodb.com/docs/manual/core/replica-set-oplog/) to capture changes from a replica set. The oplog is a fixed-size, capped collection. When it reaches its maximum size, it overwrites the oldest entries. If the connector is stopped and restarted, it attempts to resume from its last recorded position in the oplog. If that position has been overwritten, the connector may fail to start and report an invalid resume token error.
0 commit comments