@SameeraPriyathamTadikonda SameeraPriyathamTadikonda released this Jan 17, 2019 · 39 commits to master since this release

Assets 3

Release Notes for DHF 4.1.1

This is a bug fix and maintenance release

  • Better handling of nested objects as properties when property is not defined as a formal entity, array, or scalar value #1652
  • hubinit now creates a stub gradle-local.properties #1736
  • Flexrep config should now deploy for data-hub-FINAL #1724
  • You can call your mapping 'mapping' now (v4.1.0) #1710
  • You call your input flow "input" now (v4.1.0) #1709
  • You call your harmonize flow "harmonize" now (v4.1.0) #1708
  • Server namespaces now supported in your *-server.json config files #1631
  • Trace errors now output in a much more human readable format #1402
  • Several tutorial and documentation typos were fixed.

For more information on the bug fixes in this release, see the change log.

@aebadirad aebadirad released this Dec 19, 2018

Assets 3

Release Notes for DHF 4.1.0

The DHF project now aligns more closely with standard ml-gradle applications.

  • The directory structure and locations of configuration files remain the same as in DHF 4.0.x.

  • See Project Directory Structure for information on the ml-user-config and hub-internal-config directories.

  • See Gradle tasks for information about ml-gradle tasks specific to DHF.

  • Java deployment commands specific to the data hub were changed as follows:

    • Added:

      • DeployHubOtherServersCommand.java
      • HubDeployDatabaseCommandFactory.java
      • LoadHubSchemasCommand.java
    • Renamed:

      • from LoadUserStagingModulesCommand.java to LoadUserModulesCommand.java
    • Removed:

      • DeployHubDatabasesCommand.java
      • DeployHubFinalSchemasDatabaseCommand.java
      • DeployHubFinalTriggersDatabaseCommand.java
      • DeployHubOtherDatabasesCommand.java
      • DeployHubRolesCommand.java
      • DeployHubSchemasDatabaseCommand.java
      • DeployHubServersCommand.java
      • DeployHubStagingSchemasDatabaseCommand.java
      • DeployHubStagingTriggersDatabaseCommand.java
      • DeployHubTriggersDatabaseCommand.java
      • DeployHubUsersCommand.java
      • DeployUserRolesCommand.java
      • DeployUserServersCommand.java
      • DeployUserUsersCommand.java
  • Custom triggers must now be added to ml-config/databases/databasename/triggers. (In previous releases, triggers were added to hub-internal-config/triggers or ml-config/triggers.) See ml-grade Project Layout for more information on triggers.

DHF Java API changed to allow DHF to use the Spring Framework.

  • The Java HubConfig class now has a singleton scope.
  • See DHF Java Library for more information.

For more information on the bug fixes in this release, see the change log.

@itsshivaverma itsshivaverma released this Nov 19, 2018 · 198 commits to master since this release

Assets 3

This is a maintenance release with just bug fixes.

For more information on the bug fixes in this release, see the change log: https://github.com/marklogic/marklogic-data-hub/blob/master/CHANGELOG.md.

@grechaw grechaw released this Nov 6, 2018

Assets 3

This is a maintenance release with just bug fixes.

For more information on the bug fixes in this release, see the change log: https://github.com/marklogic/marklogic-data-hub/blob/master/CHANGELOG.md.

Nov 2, 2018

@grechaw grechaw released this Oct 5, 2018 · 314 commits to master since this release

Assets 3

This release prepares DHF for the environment of our Cloud-based Data Hub Service project, mainly by refactoring tests and deployment.

This is a minor release with just bugfixes, and testing changes.

See changelog https://github.com/marklogic/marklogic-data-hub/blob/master/CHANGELOG.md for information on bugs fixed

@grechaw grechaw released this Sep 12, 2018 · 424 commits to master since this release

Assets 3

This release takes care of many bugfixes and issues identified in previous versions of DHF, in addition to delivering new capabilities to the Operational Data Hub.

  • Security Model and Fixes
  • Project structure compatibility with ml-gradle
  • Installation of enode code from DHF jar
  • Declarative mapping of harmonization data flows, to automate basic steps in a Data Integration pipeline.
  • Sub-document identification and securing of Personally Identifiable Information.

Important Changes

  1. Security model update. DHF 4.0.0 has documented and tested its security model. Depending on how your projects were configured, you may have to revisit how your flows are configured, deployed, and run.
  2. For new projects created with DHF 4.0.0 there is no longer a TRACING database. The functions of jobs and traces have been merged to utilize a single database. Projects that are upgraded from DHF 3.0.0 will no longer use or deploy to their former TRACING database. The upgrade process does NOT remove the database, though.
  3. New projects created with DHF are compatible structure-wise with ml-gradle
  4. the MarkLogic XQuery and JavaScript code in DHF is now deployed as part of the install process, rather than shipped with MarkLogic Server.

Since 4.0.0 is a major release and there are some architectural changes, please refer to https://marklogic.github.io/marklogic-data-hub/docs/release-notes/ for more information on upgrading and what has changed.

@aebadirad aebadirad released this Aug 10, 2018

Assets 3

Maintenance Release

This is a bug fix focused release that addresses an issue whereby DHF can enter a condition where the output of harmonized flows appears as 'canceled', despite it successfully completing.

Change Log

v2.0.6 (2018-08-10)

Full Changelog

Fixed bugs:

  • DHF can enter a condition were harmonize flows return a status of canceled, even if they succeed. This release corrects that issue.

Closed issues:

  • Harmonize flow finishes with "CANCELED" status even though successful #1259
Aug 10, 2018

@aebadirad aebadirad released this Aug 10, 2018 · 2 commits to 2.0-master since this release

Assets 3

Maintenance Release

This is a bug fix focused release that addresses the issue of streaming large batches of URIs from the collector via the DHF to be memory efficient and properly queue the stream on disk. Please upgrade to this version if you harmonize against large batches.

Change Log

v2.0.5 (2018-08-10)

Full Changelog

Fixed bugs:

  • Huge URI/ID response from collector now properly streams with efficient memory use and excess queues on disk in system tmp

Closed issues:

  • Issue when using a collector on a huge amount of URIs #1201