Skip to content

Commit

Permalink
0005075: Elasticsearch Dialect Implementation
Browse files Browse the repository at this point in the history
Updated documentation based on OpenSearch AWS switch
  • Loading branch information
jakobvanmeter committed Oct 4, 2021
1 parent f79e916 commit df08661
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 6 deletions.
1 change: 1 addition & 0 deletions symmetric-assemble/src/asciidoc/appendix/databases.ad
Expand Up @@ -554,6 +554,7 @@ include::mariadb.ad[]
include::mongodb.ad[]
include::mssqlserver.ad[]
include::mysql.ad[]
include::opensearch.ad[]
include::oracle.ad[]
include::postgresql.ad[]
include::redshift.ad[]
Expand Down
9 changes: 3 additions & 6 deletions symmetric-assemble/src/asciidoc/appendix/elasticsearch.ad
@@ -1,28 +1,25 @@
ifndef::pro[]

=== Elasticsearch

Use `symadmin module install elasticsearch` to install driver files, or copy your own files into the `lib` sub-directory.

Send changes from your relational database to Elasticsearch in a variety of formats. An Elasticsearch node can be setup as a <<Load Only Node>> to receive changes from another node that is capturing changes.

Setup the Elasticsearch node by using the <<Add Node>> wizard and selecting Elasticsearch as the type. The URL will be the connection point to Elasticsearch. User and password are not needed (or used).
Setup the Elasticsearch node by using the <<Add Node>> wizard and selecting Elasticsearch as the type. The URL will be the connection point to Elasticsearch. If your Elasticsearch database has security enabled, please enter your username and password.

image::appendix/elasticsearch-node-setup.png[]

After hitting next you can setup advanced options for your Elasticsearch node.

image::appendix/elasticsearch-advanced-settings.png[]

You can also use an AWS Elasticsearch instance by providing the required information.

image::appendix/elasticsearch-advanced-settings-aws.png[]


==== Loading Data Into Elasticsearch


===== Setup reload channels for bulk loading.

Update any reload channels that will be used on the table triggers that will capture changes and send them to Elastic Search by setting the column data_loader_type to 'bulk'. It is also recommended to increase the batch size so that larger CSV files will be processed instead of the default size on reloads of 10,000 rows.
Update any reload channels that will be used on the table triggers that will capture changes and send them to Elasticsearch by setting the column data_loader_type to 'bulk'. It is also recommended to increase the batch size so that larger CSV files will be processed instead of the default size on reloads of 10,000 rows.

endif::pro[]

0 comments on commit df08661

Please sign in to comment.