Skip to content

Commit

Permalink
3.0 data loader development. still need to make sure unit tests pass.
Browse files Browse the repository at this point in the history
  • Loading branch information
chenson42 committed Dec 22, 2011
1 parent e5aec5f commit 65f7b2b
Show file tree
Hide file tree
Showing 76 changed files with 1,977 additions and 815 deletions.
13 changes: 13 additions & 0 deletions symmetric/symmetric-assemble/.springBeans
@@ -0,0 +1,13 @@
<?xml version="1.0" encoding="UTF-8"?>
<beansProjectDescription>
<version>1</version>
<pluginVersion><![CDATA[2.8.1.201111220115-RELEASE]]></pluginVersion>
<configSuffixes>
<configSuffix><![CDATA[xml]]></configSuffix>
</configSuffixes>
<enableImports><![CDATA[false]]></enableImports>
<configs>
</configs>
<configSets>
</configSets>
</beansProjectDescription>
36 changes: 36 additions & 0 deletions symmetric/symmetric-assemble/TODO.txt
@@ -0,0 +1,36 @@

* Go through every class and fix javadoc, remove unused methods, follow conventions, and fix generics/warnings

* Setup build for 2.x and 3.x

* Port CsvLoader and DataLoaderTest over. Check-in and make sure all unit tests work.
+ Clean up statistics. Take a pass through each of the reader/writers and make sure stats are recorded
+ Delete IDataLoaderFilter, IBatchListener
+ Introduce handler for conflict resolution. Implement default handler to start with
+ Setting for whether to update all columns or only the columns that changed
+ plug in transform database writer
* LobHandler for Oracle
* Add settings to channel
* Lookup/choose datawriter based on channel settings
* clean up error handling in loader service
* add transform extensions back in

* Add table copy utility
* Clean up service tests
* Use data processor for extract
* Use data processor for streaming to file
* Implement batch mode
* What to do with SqlTemplate? Move sqltemplate into dbdialect
* Change the default server mode to multiserver
* Clean up symmetric.messages

Documentation
* Change getting started to instruct user to update properties in the engines directory (for multiserver mode)
* Update documentation for extension points

3.0 Change Notes:
* The db.metadata.ignore.case property is no long available. All configured database names will be case sensitive
* All data loader properties will be configurable by channel
* IDatabaseWriterFilter replaces IDataLoaderFilter
* IDatabaseWriterFilter replaces IBatchListener
* db.default.schema is no longer used
6 changes: 5 additions & 1 deletion symmetric/symmetric-db/pom.xml
Expand Up @@ -56,7 +56,7 @@
<dependency>
<groupId>org.jumpmind.symmetric</groupId>
<artifactId>symmetric-util</artifactId>
</dependency>
</dependency>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
Expand Down Expand Up @@ -91,6 +91,10 @@
<groupId>commons-collections</groupId>
<artifactId>commons-collections</artifactId>
</dependency>
<dependency>
<groupId>commons-codec</groupId>
<artifactId>commons-codec</artifactId>
</dependency>
<dependency>
<groupId>oro</groupId>
<artifactId>oro</artifactId>
Expand Down

0 comments on commit 65f7b2b

Please sign in to comment.