Skip to content

Commit

Permalink
0005344: Documentation for Bulk Loading
Browse files Browse the repository at this point in the history
  • Loading branch information
JumpMind authored and JumpMind committed Jun 23, 2022
1 parent 3d58fc2 commit 30c4f62
Show file tree
Hide file tree
Showing 5 changed files with 76 additions and 10 deletions.
71 changes: 65 additions & 6 deletions symmetric-assemble/src/asciidoc/appendix/databases.ad
Expand Up @@ -6,7 +6,7 @@ feature coverage in SymmetricDS. The following table shows which features are a
by database.

.Support by Database
[cols="15,13,^12,^12,^12,^12,^12,^12,^12,^12", options="header"]
[cols="15,13,^12,^12,^12,^12,^12,^12,^12,^12,^12,^12", options="header"]
|===
|Database
|Versions
Expand All @@ -18,6 +18,8 @@ by database.
|BLOB Sync
|CLOB Sync
|Transactional DDL
|Supports Bulk Loading
|Supports Bulk Replace

|BigQuery *
|All
Expand All @@ -29,6 +31,8 @@ by database.
|
|
|
|?
|?

|DB2
|9.5
Expand All @@ -40,6 +44,8 @@ by database.
|✔
|✔
|✔
|?
|?

|DB2
|10,11
Expand All @@ -51,6 +57,8 @@ by database.
|✔
|✔
|✔
|?
|?

|DB2 for IBM i *
|6
Expand All @@ -62,6 +70,8 @@ by database.
|✔
|✔
|
|?
|?

|DB2 for IBM z/OS *
|10
Expand All @@ -73,6 +83,8 @@ by database.
|✔
|✔
|
|?
|?

|Derby
|10.3.2.1
Expand All @@ -84,6 +96,8 @@ by database.
|✔
|✔
|
|?
|?

|Elasticsearch *
|7.13.2
Expand All @@ -95,6 +109,8 @@ by database.
|
|
|
|?
|?

|Firebird
|2.0
Expand All @@ -106,6 +122,8 @@ by database.
|✔
|✔
|
|?
|?

|Greenplum
|8.2.15 and above
Expand All @@ -117,6 +135,8 @@ by database.
|
|
|
|?
|?

|H2
|1.x
Expand All @@ -128,6 +148,8 @@ by database.
|✔
|✔
|
|?
|?

|HSQLDB
|1.8
Expand All @@ -139,6 +161,8 @@ by database.
|✔
|✔
|
|?
|?

|HSQLDB
|2.0
Expand All @@ -150,6 +174,8 @@ by database.
|✔
|✔
|
|?
|?

|Informix
|11
Expand All @@ -161,6 +187,8 @@ by database.
|
|
|
|?
|?

|Ingres
|11 and above
Expand All @@ -172,6 +200,8 @@ by database.
|✔
|✔
|
|?
|?

|Interbase
|9.0
Expand All @@ -183,6 +213,8 @@ by database.
|✔
|✔
|
|?
|?

|MySQL
|5.0.2 and above
Expand All @@ -194,6 +226,8 @@ by database.
|✔
|✔
|
|?
|?

|MariaDB
|5.1 and above
Expand All @@ -205,6 +239,8 @@ by database.
|✔
|✔
|
|?
|?

|NuoDB
|2.6 and above
Expand All @@ -216,6 +252,8 @@ by database.
|
|✔
|
|?
|?

|Oracle
|10g and above
Expand All @@ -227,6 +265,8 @@ by database.
|✔
|✔
|
|?
|?

|PostgreSQL
|8.2.5 and above
Expand All @@ -238,6 +278,8 @@ by database.
|✔
|✔
|✔
|✔
|✔

|Redshift
|1.0
Expand All @@ -249,8 +291,9 @@ by database.
|
|
|
|?
|?

<<<<<<< HEAD
|Snowflake *
|6.13 and above
|
Expand All @@ -261,11 +304,11 @@ by database.
|
|
|
|✔
|✔


|SingleStore
=======
|SingleStore *
>>>>>>> 2490c8609... fix typos, add log mining
|All
|
|✔
Expand All @@ -275,6 +318,8 @@ by database.
|✔
|✔
|
|?
|?

|SQL Anywhere
|9
Expand All @@ -286,6 +331,8 @@ by database.
|✔
|✔
|
|?
|?

|SQL Server
|2005 and above
Expand All @@ -297,6 +344,8 @@ by database.
|✔
|✔
|✔
|✔
|✔

|SQL Server Azure
|Tested on 11.00.2065
Expand All @@ -308,6 +357,8 @@ by database.
|✔
|
|
|?
|?

|SQLite
|3.x
Expand All @@ -319,6 +370,8 @@ by database.
|✔
|✔
|
|?
|?

|Sybase ASE
|12.5
Expand All @@ -330,6 +383,8 @@ by database.
|✔
|✔
|
|?
|?

|Teradata
|15.10 and above
Expand All @@ -341,6 +396,8 @@ by database.
|
|
|
|?
|?

|Tibero
|6 and above
Expand All @@ -352,6 +409,8 @@ by database.
|✔
|✔
|
|?
|?

|===

Expand Down Expand Up @@ -590,7 +649,6 @@ include::{includedir}/appendix/interbase.ad[]
include::{includedir}/appendix/kafka.ad[]
include::{includedir}/appendix/mariadb.ad[]
include::{includedir}/appendix/mongodb.ad[]
include::{includedir}/appendix/mssqlserver.ad[]
include::{includedir}/appendix/mysql.ad[]
include::{includedir}/appendix/opensearch.ad[]
include::{includedir}/appendix/oracle.ad[]
Expand All @@ -599,6 +657,7 @@ include::{includedir}/appendix/redshift.ad[]
include::{includedir}/appendix/singlestore.ad[]
include::{includedir}/appendix/snowflake.ad[]
include::{includedir}/appendix/sqlite.ad[]
include::{includedir}/appendix/mssqlserver.ad[]
include::{includedir}/appendix/sybase-ase.ad[]
include::{includedir}/appendix/sybase-sqlanywhere.ad[]
include::{includedir}/appendix/S3.ad[]
Expand Down
4 changes: 4 additions & 0 deletions symmetric-assemble/src/asciidoc/appendix/mssqlserver.ad
Expand Up @@ -121,3 +121,7 @@ endif::pro[]
|Image|Yes
|Spatial Data Types|No
|===

==== Loading Data

When registering a SQL Server database with Symmetric, bulk loading will be be checked by default. In order to make use of bulk loading, the user must provide a path to a bcp executable (installation for this executable is linked in the Add Database Wizard when asked about bulk loading).
2 changes: 1 addition & 1 deletion symmetric-assemble/src/asciidoc/appendix/oracle.ad
Expand Up @@ -50,7 +50,7 @@ then set `use_capture_lobs` to 1 in the <<TRIGGER>> table and `contains_big_lobs
sym_data is cast to a clob which prevents truncation at 4k. There is overhead for both of these settings
* When multiple triggers are defined on the same table, then the order in which the triggers occur appears to be arbitrary

==== Bulk Loader
==== Loading Data
SymmetricDS has bulk loading capability available for Oracle. SymmetricDS specifies data loader types on a channel by channel basis.
To utilize Oracle Bulk loading versus straight JDBC insert, specify the Oracle Bulk Loader ("bulk") in the data_loader_type column of sym_channel.

Expand Down
5 changes: 4 additions & 1 deletion symmetric-assemble/src/asciidoc/appendix/postgresql.ad
Expand Up @@ -85,4 +85,7 @@ endif::pro[]
|Timestamp, Date, Time, Interval|Yes
|Enum|No
|Point, Lseg, Box, Path, Polygon, Circle|Yes
|===
|===

==== Loading Data
When registering a PostgreSQL database with Symmetric, bulk loading will be checked by default. If you wish to bulk load with PostgreSQL, all the user must do is leave this checked upon setup.
4 changes: 2 additions & 2 deletions symmetric-assemble/src/asciidoc/appendix/snowflake.ad
Expand Up @@ -30,7 +30,7 @@ target.db.password=<snowflake_password>

endif::pro[]

==== Loading Data Into Snowflake
==== Loading Data



Expand Down Expand Up @@ -144,4 +144,4 @@ GRANT CREATE TABLE ON SCHEMA <database>.<schema> TO ROLE SYMMETRIC;
GRANT CREATE FILE FORMAT ON SCHEMA SYMMETRIC_TEST.SYMMETRIC_TEST TO ROLE SYMMETRIC;
CREATE USER SYMMETRIC PASSWORD = 'symmetric' DEFAULT_ROLE = 'SYMMETRIC';
GRANT ROLE SYMMETRIC TO USER SYMMETRIC;
----
----

0 comments on commit 30c4f62

Please sign in to comment.