0.0.13

Luck number 0.0.13 contains the following changes versus 0.0.12:

• Store format mask, decimal & grouping symbols in record definition metadata
• preview toolbar icon & button in data catalog perspective
• Sort rows memory tuning option added. Bug fixes.
• Tuning guide
• Large synthetic data loading test-case (25M orders with data generator)
• Extra check for satellite sources vs hub bk source fields
• Implementation & docs for issue #33 : AI adviser

The associated project-0.0.13.zip download contains an Apache Hop project with different models and integration tests after initial load and updates. Please check file PROJECT.md to get started.

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.12

The following updates reached this version compared to 0.0.11:

• Issue #4 : CSV file sources support with initial importer.
• Issue #30 : Record definition in the catalog are read only
• Issue #31 : Parquet file support Record Definition Output transform to mass insert/update into a catalog
• Added support for Singlestore shard keys in DDL
• Usability improvements to importers
• update of DV Source information record definitions
• empty model message
• run model update from modeler
• bug fixes.

The associated project-0.0.12.zip download contains an Apache Hop project with 3 different models with unit tests after initial load and updates. Please check file PROJECT.md to get started.

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.11

Here are the main changes since the previous version:

• Added extra pre-update validations in the update action
• Extra test for link satellites with driving key
• Improved metrics logging
• Added Data Catalog with record definitions (first local file implementation)
• Added a new Data Catalog perspective
• Automated source table DDL generation in the project
• Made the update action publish target table metadata to a catalog
• Built a script to run all tests against Postgres, MySQL and Singlestore
• Updated documentation, README.md and project/PROJECT.md

The associated project-0.0.11.zip download contains an Apache Hop project with 3 different models with unit tests after initial load and updates. Please check file PROJECT.md to get started.

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.10

The following changes reached 0.0.10:

• Parallel pipeline execution support
• Create index for load end date use-case
• Parallel table loading support Pipeline execution logging support
• ELK layout support for pipelines, workflows and models
• Issue #10 : Status Tracking Satellite support with integration tests
• Staging folder cleanup after excution, bug fixes
• A detailed plan for a dimensional modeler in Hop.
• Issue #27 : Add extra data type validations
• Documentation updates

The associated project-0.0.10.zip download contains an Apache Hop project with 3 different models with unit tests after initial load and updates. Please check file PROJECT.md to get started.

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.9

New in this release:

• A new hash key transform convering the old check sum transform functionality + the usual extra options for prefixes, suffixes, separators, casing, trimming of business keys before hashing. (with a series of unit test pipelines in the project)
• A first stab at notes
• Copy/Cut/Paste/Delete functionality in the GUI
• Undo/Redo
• Fixed many change detections with corrected update of Hop GUI save toolbar icon, tab labeling, ...
• Improved dialogs all over the place with many more drop-down selectors for picking source fields, table names, ...
• Simplified Data Vault Source metadata
• A "Tables Importer" available when clicking on the model background and when creating a new Data Vault Source.
• A Preview button in the Data Vault Source editor
• Simplified Data Vault Configuration metadata (moved into the model with variables support there).
• A first pass of code cleanup to stop SonarQube from total breakdown.

The associated project-0.0.9.zip download contains an Apache Hop project with 3 different models with unit tests after initial load and updates. Please check file PROJECT.md to get started.

project-0.0.9.zip

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.8

New in this release:

• reworked the Update Data Vault action dialog (moved properties per category in tabs)
• Added support for specification and population/validition of Unknown and Invalid records in Satellite and Link tables
• Modified unit tests for the extra 2 records in the existing vault models.
• a multi-table importer for Data Vault Source (database).
• Support for load end dates in satellites (with extra test-model and validation)
• updated documentation

The associated project-0.0.8.zip download contains an Apache Hop project with 3 different models with unit tests after initial load and updates. Please check file PROJECT.md to get started.

project-0.0.8.zip

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.7

This release adds support for multi-active satellites and link satellites.

• lots of updates and bug fixes.

The associated project-0.0.7.zip download contains an Apache Hop project with 3 different models with unit tests after initial load and updates. Please check file PROJECT.md to get started.

project-0.0.7.zip

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.6

A lot of changes to the project

• Completed the complete test workflow
• 7 unit tests for the 7 tables after the initial load (load1)
• 7 unit tests for the 7 tables after the source updates (load2)

Install by unzip-ing in the plugins folder of your Hop distribution (remove older versions of this plugin first).

0.0.5

This version adds multi-source capabilities to Hubs and Links.
Documentation has been updated.
A sample project is provided in the source under project. See PROJECT.md for more information.

To install, unzip in the plugins folder (make sure to remove the old pre-0.0.5 jar file)

0.0.4

This releases completes the update of Hubs, Satellites and Links. It adds small GUI improvements and the first test-automation in the project/ folder.

To install, unzip file hop-datavault-0.0.4-SNAPSHOT.zip in the root of your Hop distribution.