Skip to content
Permalink
Branch: master
Find file Copy path
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
1715 lines (1344 sloc) 147 KB

Change Log

v4.3.1 (2019-04-16)

Fixed bugs:

  • [DHFPROD-1417] - Make the title field required on Entity editor
  • Enable namespace support in dhf #1580

Improvement

  • [DHFPROD-1417] - Adopt 3 new roles (Flow Dev, Flow Op, Data Hub Admin) to align with DHS roles

v4.2.2 (2019-03-13)

Fixed bugs:

  • empty collector result should be finished instead of failed job #1715
  • gradle hubRunFlow options does not lose dhf prefix #1536
  • [DHFPROD-1930] Data Hub Framework URI handling with diacritics
  • [DHFPROD-1929] Triggers dont get deployed to staging-triggers

v4.2.1 (2019-02-27)

Fixed bugs:

  • Unable to delete harmonize flow with the "trash" icon #1877
  • QuickStart - mlcp transform_param shows the wrong entity when defining input flow #1858
  • flow name no longer stored for errors #1845

Improvement

  • [DHFPROD-1819] - Generate ES-created entity schema

v4.2.0 (2019-02-14)

Full Changelog

Fixed bugs:

  • Quickstart Upgrade instructions link is malformed #1835
  • Unable to generate the TDE of an entity containing references to other entities (DHF 4.1.0) #1717
  • mlReloadSchemas task deletes all the final DB content (DHF 4.1.0) #1716
  • 4.1.0 RunWriters errors are not properly accounted. #1705
  • Modules fail to deploy #825
  • Gradle hubRunFlow required entityName to start with a capital letter #1827

Closed issues:

  • Error when resolving local entity reference #1811
  • Example :Single Step Ingest has error on DHF 4.1.x #1810
  • hubGenerateTDETemplates fails when there are relations between entities #1771
  • How to update a Hub Project link produces error #1754
  • Tutorial is still 3.x #1733
  • Javascript trace errorCount stuck at 1 #1721
  • hubGenerateTDETemplates only generates TDE's for staging database (v4.0.3) #1618
  • 4.0.0 - "How to update a Hub Project" link returns 404 #1371

Merged pull requests:

JIRA Issues

Bug

[DHFPROD-1619] - Ran into writeTraceError when running harmonization flow for 2.0.4 project upgraded to 4.1 
[DHFPROD-1643] - Entity name and case-sensitive issue while running flow
[DHFPROD-1662] - Don't override app name if a user has set it
[DHFPROD-1667] - 4.1.0 RunWriters errors are not properly accounted
[DHFPROD-1675] - mlReloadSchemas task deletes all the final DB content
[DHFPROD-1680] - Javascript trace errorCount stuck at 1
[DHFPROD-1730] - QuickStart: In "Congratulations on updating ...", "How to update..." link points to localhost:8080/null
[DHFPROD-1745] - Primary key is not displayed on mapping entity table
[DHFPROD-1746] - hubGenerateTDETemplates fails when there are relations between entities
[DHFPROD-1754] - Quickstart install, uninstall, and redeploy hub take a long time
[DHFPROD-1760] - module deploy timestamp is not environment specific
[DHFPROD-1772] - Example :Single Step Ingest has error on DHF 4.1.x
[DHFPROD-1774] - Cannot upgrade from 4.1.0 to 4.x
[DHFPROD-1788] - Triggers from es-alignment do not generate tde for already nested entity

Improvement

[DHFPROD-1428] - Improve the usability of text input elements

Sub-task

[DHFPROD-1688] - Add Mock API framework for node.js

Story

[DHFPROD-1553] - Make DHF reliant on Entity Services for entity model generation
[DHFPROD-1604] - Update Quickstart tutorial for DHF 4.x
[DHFPROD-1692] - Technical story: Update ml-gradle to 3.11
[DHFPROD-1734] - Address high security vulnerability from github
[DHFPROD-1758] - Document new 'hubDeployUserArtifacts' ml-gradle command

v4.1.1 (2019-01-15)

Full Changelog

Implemented enhancements:

  • Better handling of nested objects as properties when property is not defined as a formal entity, array, or scalar value #1652

Confirmed fixed bugs:

  • mlFinalForestsPerHost is ignored #1596
  • mlDeployDatabases ignores config files under entity-config #1437
  • mlWatch doesn't load from src/main/ml-modules #1429
  • certificate-templates and external-security config not being deployed from ml-config #1384
  • DHF 4.0.0: mlDeployDatabases not deploying config from src/main/ml-config (same for mlDeploySecurity) #1382
  • DHF 4.0.0: mlDeploy fails (in some conditions) if project contains REST extension in ml-config #1378
  • Modules location and deployment in DHF400 #1362

Closed issues:

  • hubinit task should create a "stub" gradle-local.properties #1736
  • Require workaround for deploying flexrep for data-hub-FINAL #1724
  • if you call your mapping "mapping", it doesn't work (v4.1.0) #1710
  • If you call your input flow "input", it doesn't work (v4.1.0) #1709
  • If you call your harmonize flow "harmonize", it doesn't work (v4.1.0) #1708
  • Adding server namespaces in final-server.json breaks redeployment #1631
  • mlLoadSchemas only loads to data-hub-staging-SCHEMAS #1619
  • Tutorial Documentation: Wrong Product Ingest folder? #1578
  • [WORKAROUND] DHF does not deploy REST extensions #1574
  • Support for mlConfigPaths and mlModulePaths properties like ml-gradle has #1464
  • Traces not capturing error message or stack #1402

Merged pull requests:

v4.1.0 (2018-12-19)

Bug

[DHFPROD-1193] - #1261 ⁃ "gradle createEntity" does not create an entity descriptor file
[DHFPROD-1263] - DataHub.runPreInstallCheck() returning incorrect results
[DHFPROD-1304] - mlDeploySecurity is not deploying protected-paths and query-rolesets
[DHFPROD-1328] - Able to create duplicate flow (input or harmonize)
[DHFPROD-1400] - Gradle Tasks using incorrect datahub.isInstalled() check to verify DHF installation
[DHFPROD-1433] - QuickStart entity editor: too many properties, buttons are hidden
[DHFPROD-1557] - Memory leak on gradle runFlow
[DHFPROD-1561] - DataHub installation fails
[DHFPROD-1576] - ./gradlew build fails with no user provided error
[DHFPROD-1592] - hubUpdate should work even when the project fails an initialization check
[DHFPROD-1595] - mlDeploy fails post hubUpdate in 4.1-rc1 DHF version
[DHFPROD-1601] - Deploy fails when mlModulePermissions does not exist in gradle.properties
[DHFPROD-1605] - mlDeploy fails when an amp exists under src/main/ml-config
[DHFPROD-1608] - QuickStart 4.1.0-rc fails to display flows
[DHFPROD-1615] - Upgrade issues in DHF with versions 4.0.x
[DHFPROD-1617] - Update documentation for 4.1.0 
[DHFPROD-1636] - hubGeneratePii task is failing
[DHFPROD-1637] - Docs: "Independent STAGING and FINAL App Server Stacks Stacks" link redirection error
[DHFPROD-1640] - Triggers config from hub-internal-config is making post request to data-hub-final-TRIGGERS database
[DHFPROD-1645] - 4.1.0 'mlUpdateIndexes' command is giving error with in provisioned environment
[DHFPROD-1646] - Deployment fails with non default hub admin role and user

Story

[DHFPROD-1338] - Create spring application context and make properties file a singleton configuration
[DHFPROD-1339] - Rework application architecture to use Spring IoC
[DHFPROD-1422] - Clarify through the QuickStart UI the origin of the source URI field in the Mapping Screen
[DHFPROD-1436] - Upgrade to Java 10 and OpenJDK
[DHFPROD-1518] - Design the ml-gradle solution
[DHFPROD-1519] - Separation of DHF override code from vanilla ml-gradle tasks
[DHFPROD-1524] - Stitch together quick-start Spring Context with core .
[DHFPROD-1554] - Release Notes and Upgrade guidance for 4.1

v4.0.3 (2018-11-19)

Bug

[DHFPROD-1512] - #1462 ⁃ SSL with mlRedeploy/mlReloadModules doesn't work

v4.0.2 (2018-11-05)

Bug

[DHFPROD-1095] - #1152 ⁃ Trace content plugin on harmonized data is broken
[DHFPROD-1246] - 'data-hub-user' able to deploy flows
[DHFPROD-1306] - HubInit command does not generate mlSecurityUserName and mlSecurityPassword place holders
[DHFPROD-1401] - Unable to save and update indexes using gradle tasks
[DHFPROD-978] - Verify fix: #1062 ⁃ Online shopping tutorial repository code missing an element index in Order entity
[DHFPROD-1307] - hubPreInstallCheck command displays object hashcode
[DHFPROD-1418] - DHS documentation has incorrect values for 'mUsername' and 'mlManageUSername'
[DHFPROD-1420] - Bad link to upgrade instructions.
[DHFPROD-1448] - data-hub-MODULES is hard-coded somewhere
[DHFPROD-1483] - hubPreInstallCheck returning incorrect result
[DHFPROD-1495] - every mlcp job from quick start throws an error
[DHFPROD-1502] - Unable to redeploy hub
[DHFPROD-1302] - Issues in trace UI rendering in 4.0

v4.0.1 (2018-10-05)

Bug

[DHFPROD-653] - #799 ⁃ Tests failing on AWS if host is set to ELB host
[DHFPROD-760] - #873 ⁃ RFE: Single location for all resource configuration
[DHFPROD-789] - FlowManager.getFlow() and Mlcp flows failing with ELB
[DHFPROD-1045] - #1120 ⁃ On Harmonize flow page, the plus sign for Options is not aligned
[DHFPROD-1126] - #1183 ⁃ Outdated references to dhf.xqy
[DHFPROD-1175] - gradle mlUndeploy is throwing 401 unauthorized error
[DHFPROD-1248] - LoadUserModules not loading mappings if force load is set to 'false'
[DHFPROD-1250] - #1279 ⁃ main.sjs not properly updated during upgrade
[DHFPROD-1278] - QuickStart uninstall status is delayed
[DHFPROD-1299] - Installation/Uninstallation fails when App-Services set to ssl/cert-auth
[DHFPROD-1343] - QuickStart install has 404 not found error message when changing the data-hub modules db name
[DHFPROD-1346] - Test failures in VPC environment in AWS
[DHFPROD-1368] - Incompatibility between DHF and DHaaS with respect to usage of 'finalClient'
[DHFPROD-1374] - Unable to load user modules from gradle
[DHFPROD-1376] - Unable to create flows with "FlowDeveloper" role
[DHFPROD-1378] - Unable to getFlow()
[DHFPROD-1399] - DHS - hubRunFlowTask is failing as final AppServer details are MISSING
[DHFPROD-1402] - DHS - hubExportJobs and hubDeleteJobs are failing due to missing indexes in Jobs Database

Task

[DHFPROD-1373] - Unable to load hub modules in DHaaS environment
[DHFPROD-1375] - Specify permissions for modules in gradle.properties
[DHFPROD-1380] - Replace java client api static binary to publicly available one

Sub-task

[DHFPROD-1329] - On upgrade, new databases created should not have default names

Epic

[DHFPROD-1084] - Upgrade improvements - Doc and e-node changes

Story

[DHFPROD-1085] - Upgrade to 3.0 overall guidance
[DHFPROD-1087] - Upgrade instructions
[DHFPROD-1228] - Integrated Testing for DHaaS in a simulated environment
[DHFPROD-1229] - Install DHF via lambda/appdeployer task
[DHFPROD-1234] - Create roles and test DHF with hardened RBAC model for DHaaS
[DHFPROD-1240] - Release DHaaS-related work as 4.0.1
[DHFPROD-1251] - Integrated Testing for DHaaS in a 'real' environment
[DHFPROD-1261] - Document differences in managing a data hub on-prem. vs in DHaaS
[DHFPROD-1310] - Refactor DHF to use a single modules database (again)
[DHFPROD-1335] - Deprecate mlLoadBalancerHosts with error checking

v4.0.0 (2018-09-11)

Bugs

[DHFPROD-859] - #989 ⁃ DHF 3.0 upgrade path not clear
[DHFPROD-890] - #1009 ⁃ 9.0-5 Upgrade : make sure to update the path of the rewriter on the Trace Server
[DHFPROD-1100] - #1155 ⁃ Upgrading in Quickstart (with Quickstart.war) doesn't always work
[DHFPROD-1174] - Running input flow after fresh install from a DHF project doesnt surface all the previously saved maps
[DHFPROD-1252] - XDMP-NOSUCHDB error on running hubUpdate task to upgrade to 4.0.0
[DHFPROD-1254] - QuickStart project needs to be initialized although DHF is already installed
[DHFPROD-1298] - Installation fails with non default staging modules db
[DHFPROD-1308] - Traces are created after disabling traces
[DHFPROD-1309] - Incorrect content.sjs generated for input flows when 'requireEs' set to true

[DHFPROD-434] - #458 ⁃ Document the roles available and what each one does
[DHFPROD-495] - #673 ⁃ Problem with clipboard button
[DHFPROD-651] - #796 ⁃ Hub tracing fails (silently) if XQuery plugins return XML
[DHFPROD-774] - Compatibiilty -- quickstart 3.0 to 3.1
[DHFPROD-788] - #893 ⁃ accept header ignored by /v1/resources/flow
[DHFPROD-790] - #894 ⁃ Clearer documentation with respect to the Java prerequisite
[DHFPROD-791] - gradlew hubInfo task returns garbage
[DHFPROD-797] - #902 ⁃ xml options in entity-config get saved with JSON content and fail to deploy
[DHFPROD-844] - #976 ⁃ add mldeploy step
[DHFPROD-847] - #979 ⁃ list ports in use by dhf
[DHFPROD-848] - #977 ⁃ explain databases created by dhf project
[DHFPROD-850] - #980 ⁃ Update documentation for transform renames
[DHFPROD-872] - #1000 ⁃ XML Processing Instructions break DHF ingest
[DHFPROD-927] - #1029 ⁃ The total number of jobs is incorrect after running a flow
[DHFPROD-931] - #1034 ⁃ UI messaging on entity that has no properties on Map
[DHFPROD-933] - #1036 ⁃ Unable to save map
[DHFPROD-942] - #1051 ⁃ On mapping, a data that starts with a number then followed by non-number character is interpreted as number
[DHFPROD-944] - #1052 ⁃ Scaffolding allows white space in the Entity properties.
[DHFPROD-945] - #1053 ⁃ incorrect label for triggers db setting in QS advanced options.
[DHFPROD-948] - #1057 ⁃ Trace UI is showing nothing on ingested xml document
[DHFPROD-958] - #1061 ⁃ DHF is not being installed from quick-start UI
[DHFPROD-1001] - Unable to set different SSL context for (staging, final)client and (staging, final)manageclient
[DHFPROD-1008] - TrustManager is not set when creating client objects
[DHFPROD-1017] - #1104 ⁃ Some icons on QuickStart UI login page are missing if you start QuickStart war
[DHFPROD-1033] - Differences in <attachments> content in the envelope generated by xqy and sjs
[DHFPROD-1034] - Unmapped properties shows up as null with mapping generated content.sjs
[DHFPROD-1045] - #1120 ⁃ On Harmonize flow page, the plus sign for Options is not aligned
[DHFPROD-1046] - The source xpath returns incorrect result with mapping generated content.sjs
[DHFPROD-1051] - #1124 ⁃ Map doesn't retain the properties if you change the source (on map revisit)
[DHFPROD-1061] - #1134 ⁃ Unable to create a harmonize flow that uses the mapping if not redeploying the modules
[DHFPROD-1062] - #1135 ⁃ After creating and modeling the map, the first mapping property on content.sjs is not indented
[DHFPROD-1065] - #1138 ⁃ Performance decrease if you have multiple maps
[DHFPROD-1074] - #1144 ⁃ Able to save an entity with duplicate property names
[DHFPROD-1082] - #1146 ⁃ Harmonized flow with mapping on second entity is broken
[DHFPROD-1094] - #1151 ⁃ Cannot edit the source of an already existing map
[DHFPROD-1096] - #1153 ⁃ HTTP 500: Internal Server Error while retrieving a map with a name
[DHFPROD-1097] - #1154 ⁃ Overlapped facet counts if it has 4 digits or more
[DHFPROD-1110] - #1165 ⁃ content.sjs creates incorrect variables for properties having underscore in the entity
[DHFPROD-1112] - #1166 ⁃ Hub Graphic corrupted / missing
[DHFPROD-1113] - #1168 ⁃ content.xqy generates extract-instance-X() with empty mapping
[DHFPROD-1114] - #1170 ⁃ Mapping doesnt allow to save an edited version of a map
[DHFPROD-1118] - Mapping generates incorrect content
[DHFPROD-1119] - #1175 ⁃ Click of + button for entity 2 mapping when on a map for entity 1 doesnt bring up the new-map modal
[DHFPROD-1120] - #1176 ⁃ Able to create maps with duplicate names
[DHFPROD-1122] - #1179 ⁃ Map created from QuickStart should not be deployed to Modules database until map is saved
[DHFPROD-1124] - #1180 ⁃ Updating description of a mapping should prompt to Save the map again
[DHFPROD-1125] - #1181 ⁃ Using an invalid source URI should first check for validity before resetting existing selection/mapping
[DHFPROD-1127] - #1184 ⁃ Input flow/mlcp failing in QuickStart when any datatype other than string is used
[DHFPROD-1131] - source xpath generates JS content with syntax error
[DHFPROD-1151] - #1201 ⁃ Issue when using a collector on a huge amount of URIs
[DHFPROD-1159] - #1217 ⁃ ResourceNotFound exception if mapping name contains whitespace
[DHFPROD-1164] - Overflowing mapping value if it's too long
[DHFPROD-1165] - #1229 ⁃ Tracing database exist on DHF Upgrade from 3.0.0 to 3.1.0

Task

[DHFPROD-964] - Upgrade testing from DHF-3.0.0 to DHF-3.1.0
[DHFPROD-225] - Design and implement security model to preempt needs for PII story
[DHFPROD-338] - Atomic return value as a response header
[DHFPROD-640] - JSON Schema for API First function declaration
[DHFPROD-909] - Create E2E test Plan for Flat Model-to-Model mapping
[DHFPROD-911] - Create test plan for Security policy
[DHFPROD-924] - Investigate and create POC to create framework to run unit and integration tests for sprint boot layer API's
[DHFPROD-1056] - Document PII support

Epic

[DHFPROD-234] - Flat model-to-model mapping
[DHFPROD-1084] - Upgrade improvements - Doc and e-node changes

Story

[DHFPROD-1078] - Update tutorial to showcase model-to-model mapping
[DHFPROD-1085] - Upgrade to 3.0 overall guidance
[DHFPROD-1087] - Upgrade instructions
[DHFPROD-1101] - Technical story: Understand the upgrade path
[DHFPROD-1103] - Documentation for model-to-model mapping
[DHFPROD-1133] - Execute the DHF Release (4.0)
[DHFPROD-1168] - Release notes for 4.0
[DHFPROD-1192] - Return e-node modules to modules db
[DHFPROD-1194] - Provide modules, schemas and triggers databases for FINAL
[DHFPROD-254] - Document Error Codes
[DHFPROD-278] - API Service Developer can generate Java database function
[DHFPROD-279] - Data Service Developer can support proxy requests in the appserver
[DHFPROD-307] - Data Architect manipulates the mapping of property-to-property
[DHFPROD-308] - Data Architect can run flow
[DHFPROD-311] - API Service Developer can generate simplest Java proxy function
[DHFPROD-341] - Mapping experience for long lists of attributes
[DHFPROD-346] - API Service Developer can generate a Java proxy with payloads
[DHFPROD-350] - API Service Developer can generate a class from a bundle
[DHFPROD-351] - PII Configuration artifacts get deployed to data hub
[DHFPROD-583] - Default document permissions (read) for harmonized entities
[DHFPROD-606] - Default document permissions (update) for harmonized entities
[DHFPROD-607] - API Service Developer can generate a Java database function with multipart payloads
[DHFPROD-608] - Build a demo that showcases pii
[DHFPROD-612] - API Service Developer can map Java datatypes to server datatypes
[DHFPROD-615] - API Service Developer can call a database function from AWS middle tier
[DHFPROD-619] - Move base support for generated classes into the Java API
[DHFPROD-625] - Toggle PII on entity property as part of modeling UI activities
[DHFPROD-666] - Data Service Developer can opt into efficient but constrained HTTP transport
[DHFPROD-678] - Determine what is PII
[DHFPROD-816] - CLONE - Default document permissions (read + write) for harmonized entities
[DHFPROD-819] - CLONE - Default document permissions (update) for harmonized entities
[DHFPROD-839] - Security vulnerability in package-lock.json
[DHFPROD-949] - Ability to change source doc
[DHFPROD-956] - Execute the code generation from Gradle
[DHFPROD-1024] - Orient example in tutorial to current model to model mapping scenario (eg all same source doc)

v3.0.0 (2018-05-03)

Full Changelog

Implemented enhancements:

  • Update Spring Batch example to version 1.4.0 #622
  • Update writers to be batched vs individualized - delete/dupe #617
  • Quickstart data hub job status/error popup needs word wrap #582
  • Export traces #571
  • Create gradle command to generate a TDE Template #551
  • Allow specifying flow options for harmonization flows run from quickstart #504
  • Migration guidance from 1.0 (8) to 2.0 (9) #373

Fixed bugs:

  • Loading documents through input flow is failing #883
  • gradlew quick-start:e2eLaunch could not find or load main class com.marklogic.quickstart.Application #877
  • Tutorial: version numbers don't match #852
  • Example in documentation is incorrect #845
  • README.md link to "Data Hub Framework website" in "Advanced Hub Usage" is broken #837
  • defaults are missing on hub init tab #833
  • Getting Started Tutorial: More issues #818
  • Running input flow produces error "MISSING_CURRENT_TRACE" and the documents are not loaded #814
  • Missing dhf.sjs when creating a new flow (blocker) #813
  • Upgrade npmVersion to 5.6.0 on build.gradle to avoid error on Windows #804
  • Tutorial link hard coded to old (2.0.3) release #801
  • Reverse DB EndToEndFlowTests fail on AWS #800
  • quickstart harmonize flow view elides tab labels to meaninglessness #798
  • QuickStart Browse Data throws XDMP-LEXVAL #797
  • Documents are not shown under Browse Data STAGING database after running the input flow #788
  • Remove mimetypes from gradle config #780
  • Install screen on quickstart is broken, unable to install hub [blocker] #778
  • Run undeploy tasks with configured mlManageUsername #766
  • Error when running gradlew mlUndeploy #762
  • MLCPBean doesn't have -ssl option #760
  • mlDeploy fails when run by an LDAP user with full admin rights #759
  • QuickStart won't connect to HTTPS-enabled App Services #752
  • Search results on jobs page is showing the wrong results when searching for "input" jobs #746
  • Trace view is not displayed after clicking the trace link #738
  • One entity's indexes configurations clobber all the others' #711
  • When modeling Order entity, needs to add element range index on "id" property #705
  • Quickstart tutorial doesn't have $version on content.sjs, but the screenshots have it #701
  • QuickStart harmonize flow settings not persisted during browser session #684
  • Primary key is not retained if it's clicked first when adding a property #679
  • Huge ID lists from a collector fail with FRAGTOOLARGE if Tracing is on #658
  • Old entity name is still retained on property entities type #651
  • run-flow rest extension is not setting a default job-id #620
  • Tutorial - Can not create "Harmonize Orders" flow #602
  • Collector's disk queue is filling up #601
  • QuickStart Project Initialize does not recognize change to hostname #585
  • Object type changed after upgrade to Hub 2.0 so fields are missing or undefined #583
  • The mlUndeploy task does not completely remove a data hub #580
  • MLCP failing on INPUT FLOW after upgrade #579
  • info block for JSON #577
  • QuickStart - Browse Data does not display content for certain URIs #557
  • Add Spring-Batch jobRepo configuration to data-hub-JOBS database & app-server? #493
  • Added Price, but didn't see it in the Product entity #408
  • A trace is created with an invalid format #397
  • Hub (un)install time on windows is horrible #253
  • Add --disable-host-check to allow external access #773 (wooldridge)

Closed issues:

  • Some broken links on docs-3.0 DHF Tutorial #930
  • Data Hub Framework website links still refer to old marklogic-community address #899
  • Error when harmonising literal in triple #878
  • One of the links to the data hub framework website on readme.md is broken #864
  • Tutorial: need a goal #854
  • Clean up inconsistencies in content/instance in documentation #848
  • Error when trying to run mlDeploy from online store example on development branch #835
  • Include verb in example curl command #808
  • Code edited externally not updating on quickstart editor windows #795
  • Harmonization fails #756
  • Missing custom webservices in DHF #716
  • problem with instance-json-from document when extracting array of string #708
  • Final content.sjs is out of date in tutorial #676
  • Add documentation for gradle task to uninstall data-hub #670
  • Clarify docs: REST resources can be added without being connected to an entity #629
  • Update Hub ES code to get inline with newer ES features #553
  • Example: Single-step ingest #476
  • Invoking harmonize flow via post-commit trigger fails with non-admin user #378
  • Getting Started tutorial shows a stack trace for step 8, sub-step 6 #316
  • Refine JavaDocs #222
  • Epic: MDM support #126

Merged pull requests:

v2.0.4 (2018-02-13)

Full Changelog

Implemented enhancements:

  • Need ability to specify cluster hostnames in configuration, override automatic host detection #662
  • Allow me to set custom SSL Context and Hostname verifiers #647
  • Stream uris list #633

Fixed bugs:

  • Collector throws null pointer exception when there is nothing to process #735
  • SSL not working with collector #734
  • Browse Data Entities Only Error #726
  • Setting up QuickStart UI takes me to the update screen, then vicious cycle #698
  • Performance example gradle hubinit task throws a directory error on windows #674
  • deleting an entity property causes quickstart to forget the existing primary key/range index/required field settings #616
  • DataMovementServices is holdover from DHF 1.0 #613
  • Quickstart runs in 2.0 mode only for version 9, not > 9.x #591

Closed issues:

  • Put min ML version in docs and error message #229
  • publish javadocs to a website #212

Merged pull requests:

2.0.3 (2018-01-30)

Full Changelog

v2.0.3 (2018-01-30)

Full Changelog

Implemented enhancements:

  • Deprecate ML8 support #618
  • MLCP options: Add ability to select individual files #413
  • Long collection names wrap (ugly) #409

Fixed bugs:

  • Dollar ($) sign on title and version on final document #704
  • Quickstart doesn't have "Delimited Text Options" anymore, the documentation and tutorial should be changed #683
  • Unable to load data on Input Flows #682
  • double parent XML elements created when serializing complex type #619
  • setting sourceDB in custom task extending RunFlowTaks in v2.0.2 fails #608
  • Fixes to closing input stream as recommended @paxtonhare also clean u… #700 (aebadirad)
  • Fixed #616 #627 (aebadirad)

Closed issues:

  • Having issue in ingesting data via MLCP, with transform_module #667
  • No job document after running input flow thru MLCP #665
  • Unable to create Harmonize Flow #637
  • Error on Harmonize batch on a F5 LB #632
  • dhf.makeEnvelope does not include $version and $type #626
  • gradle tasks broken in 2.0.1 #599

Merged pull requests:

v2.0.2 (2017-12-04)

Full Changelog

Implemented enhancements:

  • Update hubCreateEntity task to use ES too #547
  • Delete old jobs #534

Fixed bugs:

  • Main is executed in staging db even when setting -PsourceDB=Final #565
  • Blank harmonization page #558

Closed issues:

  • Add e2e tests for Quickstart #555

Merged pull requests:

2.0.1 (2017-11-20)

Full Changelog

Implemented enhancements:

  • Browse Data: Reset search when changing databases #535

Fixed bugs:

  • Harmonization code generation fails for a relationships where entities hold mutual references #544
  • Out of memory when flow has too many errors #543
  • admin role required for quick start login #542
  • mlWatch broken for deploying REST extensions #538
  • Options not deployed for Final #529

Closed issues:

  • Add README.md at top of examples folder #549
  • Quickstart build fails #541
  • hubPreinstallCheck, AdminConfig ignores SSL setting #539
  • Enhance command line to build entity indexes via entity JSON descriptors #526

v2.0.1 (2017-11-20)

Full Changelog

Implemented enhancements:

  • Harmonize Writer could benefit from more context like $type #564
  • Update 2.x version checker to omit pre-release version #485

Fixed bugs:

  • Error running sample product-catalog example #560
  • Entity definition partially written, everything hosed #435

Closed issues:

  • REST search options deployed to wrong location in modules db #567
  • Getting MISSING_FLOW error when invoking from DMSDK #552
  • Add support for mlcp -input_file_pattern #550
  • Browse Data: not obvious that I needed to click Search #530
  • Add detailed documentation on traces #527
  • incorrect scaffolding #525
  • Issue upgrade from rc1 to rc2 #511
  • Create Performance Sample #492
  • Prevent install if ports are in use #477
  • MLCP fails if no "jobId" parameter specified even with trace off #426
  • Test deploy against ssl enabled server #417
  • Epic - error handling #289

Merged pull requests:

v2.0.0 (2017-10-02)

Full Changelog

Fixed bugs:

  • mlWatch is deploying Flow XMLs on every iteration #522
  • Can't login to quickstart with data-hub-user #519
  • Error when settings gradle properties from task definition #518
  • Basic auth not working #517
  • Debug of run-flow transform breaks multipart requests and can't be turned off #516
  • Bug in deploying Flows to MarkLogic #512
  • Writer trace is firing twice #510
  • Error loading XSD schemas #509

Closed issues:

  • Can't run flows with spaces in the names from MLCP #523
  • Better error handling on gradle hubRunFlow #514
  • Move the Input Flow writer trace into main.(sjs|xqy) #513
  • Links need updating #508
  • Update to latest ml-gradle #505
  • Input flow (mlcp) options aren't saved #481

v2.0.0-rc.2 (2017-09-12)

Full Changelog

Implemented enhancements:

  • Add Fastload support for MLCP #490
  • Refactor to use main.xqy #484
  • Refactor classes that break openjdk #482

Fixed bugs:

  • Next button not working when browsing to new hub project directory #502
  • Quickstart gets stuck in Loading... with js error #501
  • scaffolded flow from empty ES model has errors #495
  • Need to properly escape the path for RegEx #494
  • Files are being locked on Windows #450

Closed issues:

  • Increase gradleVersion to 3.4 for the wrapper task #499
  • MLCP 9.0.2 isn't backwards compatible #498
  • Example: Make a barebones example for cmd line ninjas #497
  • ML behind Firewall + different ports #489
  • Ports 8010 and 8011 conflicting with Ops-Director #447

Merged pull requests:

v1.1.5 (2017-08-14)

Full Changelog

Implemented enhancements:

  • Update Quickstart Ready message #478
  • Example: Migrating a RDBMS to Data Hub using Spring Batch #473

Fixed bugs:

  • Providing different source/dest DB for the hubRunFlow does not work #488
  • Path to code has wrong slash on Windows #467
  • Job status stuck on STARTED for Input Flows #466
  • File not saving properly from quickstart to fix a bug #430
  • Error on initial run of QuickStart GUI #394
  • Error saving entity - collation not legal #337

Closed issues:

  • collection name is hard coded in online store example #474
  • add (rest-extension-user,read) to XML documents in modules-db #470
  • column-width, or tooltip with full "Identifier" in traces table #469
  • Initializing DHF Project against existing DB is dropping indexes #468
  • Saving the changes in a flow code never finishes *sometimes* #462
  • Sometimes a trace for a failed Harmonize job is not available/not existing #461
  • Unable to ingest image (.png) documents using DHF Quick-Start application #420
  • Load files into the data hub schemas database #288
  • Ability to override uri for input flows #182
  • Create concept of a domain #82

Merged pull requests:

v1.1.4 (2017-07-25)

Full Changelog

v2.0.0-rc.1 (2017-07-24)

Full Changelog

Implemented enhancements:

  • Cannot specify default permissions for data-hub-staging-MODULES db #434

Fixed bugs:

  • MlcpRunner is being started improperly #452
  • Code deploy fails when An entity is deleted #451
  • error during data hub workshop #437
  • when scaffolding code for an array, have it be empty list [] rather than null #432
  • gradlew is generated without execute permission #428
  • RunFlowTask using dyslexic string for hub key #419

Closed issues:

  • Upgrade quick-start to mlcp 9.0.2 #465
  • QuickStart app doesn't work on Internet Explorer 11 #463
  • Redeploy modules removes trace and debugging settings #460
  • Quickstart Application not working on Internet Explorer #456
  • Envelope instance created does not include "info" #455
  • Error when creating a harmonize flow based on entity definition #454
  • tutorial link is 404: https://marklogic.github.io/marklogic-data-hub/ #449
  • Changes to $options not persisting if set in headers or triples in Harmonization flow #448
  • Input flow job (load-acme-tech) failing on 2.0.0-beta.1 #446
  • Fix AppVeyor CI #445
  • consider using windows compatible line breaks #444
  • RFE: support setting log level #442
  • Setting replica forest data path #441
  • Replica forests not created from quick-start #439
  • Error in documentation for the REST transform #433
  • Harmonization hits maximum document size in collector output #427
  • Create a checklist for making DHF releases #424
  • Expose the ability to set the writer plugin's target database in gradle #423
  • Document all gradle hub tasks #402
  • Document query-only mode for plugins #368
  • Generated code template from Entity for nested item hides vars (v2/Entities) #353
  • Control what runs in update mode to minimize locking #300
  • Library Modules not being autodeployed #299
  • Uninstall doesn't always finish on the UI #266
  • Consider name and description for data hub framework and tooling #175

v2.0.0-beta.1 (2017-05-31)

Full Changelog

Implemented enhancements:

  • Add a code editor #418

Fixed bugs:

  • Entity properties starting with a capital generate templates with a preceding dash in var names #350

v1.1.3 (2017-05-24)

Full Changelog

Implemented enhancements:

  • Expose the ability to pass custom properties via gradle #416
  • Add gradle wrapper to scaffolded project #415
  • Entity view: show "Loading entities..." rather than "You don't have any entities yet" #411
  • Better default document format for input flow #410
  • Add button to sync indexes #393
  • ugly scrollbars appear on project list in quickstart #385
  • Handle Batch Flow Errors #379
  • Default the harmonize collector to only get items in a standard input collection #344
  • Add ability to specify source/target database for a Harmonize flow #319

Fixed bugs:

  • MLCP options: Output URI Replace is not working as expected #414
  • Can't do load on Windows #407
  • Illegal/unsupported escape sequence in Windows 10 when creating entities #406
  • Better feedback for client-side validation failures #398
  • XQuery bug detected but not shown on QuickStart GUI #395
  • Save Options in Input Flow doesn't save changes to 'Output URI Replace' #390
  • Default forests are created/attached even with custom forest JSON definitions #389
  • mlReloadModules may not work #386
  • Can't run harmonize on 2.0.0-alpha.2 #382
  • Compile issue #381
  • When one item fails in a harmonize batch run, other items in the chunk do not get processed #279

Closed issues:

  • Need to update my forest location while setting up the datahub framework; #356
  • Harmonization flow not hitting staging port defined in gradle.properties #342
  • gradle commands for flow creation #339
  • gradle hubInit failing #307
  • QuickStart App data loaded to incorrect directory? #251
  • Allow Ingest to feed directly to conform w/o storing data #186
  • DataHub::isInstalled() is not sufficient #165
  • Auto Generate Indexes based on entity defs #105
  • Allow Exploration on the staged, raw data #2

Merged pull requests:

  • display a "Loading" message while retrieving entities #412 (dmcassel)
  • disabled frame options in quickstart so it can be run inside an iframe #364 (ryan321)

v2.0.0-alpha.4 (2017-05-12)

Full Changelog

v2.0.0-alpha.3 (2017-05-08)

Full Changelog

v1.1.2 (2017-04-12)

Full Changelog

Fixed bugs:

  • null pointer exception on logout #383

Closed issues:

  • gradle version check fails on multiple dots #384
  • QuickStart Template Compile Error 2.0-alpha.2 #380

v1.1.1 (2017-03-20)

Full Changelog

Implemented enhancements:

  • customize session name to avoid conflicts #369
  • Change Java Client API dependency to stable build #358
  • Update Hub to use latest ml-gradle #355

Closed issues:

  • Entities and custom modules fail to deploy - v1.1.0 #377
  • See if we can bail if the gradle version is too low #376
  • Unable to login marklogic using hub frame work received "500 Internal Server Error" #374
  • gradle plugin gets confused about users #371
  • can't put binary inside envelope #366
  • MLCP can't find /etc/hadooop #365
  • Add CLA requirement to CONTRIBUTING #361
  • Bug: QuickStart Login screen: Long paths aren't completely visible in Chrome #354

Merged pull requests:

v2.0.0-alpha.2 (2017-01-16)

Full Changelog

Implemented enhancements:

  • Allow exernal data to be passed in to a flow's options-map #334
  • Integrate with Entity Services #283
  • show traces for a given flow #277

Fixed bugs:

  • Returning json:object() isn't invoking ES serialization in flow #345

Closed issues:

  • "No message available" when following Quick Start #352
  • Add job-id to harmonized documents #351
  • Entity modeling rendering incorrectly #347

v1.1.0 (2016-12-16)

Full Changelog

Implemented enhancements:

  • Detect when running upgraded hub #322

Fixed bugs:

  • if MarkLogic is not started, login reports "invalid username or password" #343
  • Need gradle variables for Auth method for final, staging, etc #340
  • Pagination not implemented on jobs page #320

Closed issues:

  • Directory slashes when typing in paths #341
  • Scaffolding generation failed #338
  • Investigating slow performance in loading modules on Windows #336
  • Input Flow - Output URI replace configuration doesn't stick on windows #335
  • Keep user database settings separate from hub database settings #325
  • Create a non-admin user for doing hub stuff #200

v2.0.0-alpha.1 (2016-11-30)

Full Changelog

Implemented enhancements:

  • Visual entity type model editor #286

v1.0.2 (2016-11-22)

Full Changelog

Fixed bugs:

  • mlcp load from QuickStart GUI not loading data #331

Closed issues:

  • Possible typo on wiki page #333
  • Tutorial instruction - create entity "Employees" instead of "Employee" #330
  • mlcp job is not getting run + console log button not showing #329
  • Error Extension hubstats does not exist. #328

v1.0.1 (2016-11-08)

Full Changelog

Fixed bugs:

  • Responsive CSS is hiding the menu bar #321
  • Redeploy button is wiping out hub modules #318

Closed issues:

  • Log out why isInstalled() is failing #324
  • Provide Build instructions for developers #323
  • Add Link to the ML On Demand Courses #315
  • upgrading RC5 to RC6 #306
  • Allow users to clear out corrupt install #304

v1.0.0 (2016-10-25)

Full Changelog

Fixed bugs:

  • DeployViewSchemasCommand is failing installs #312
  • File change watcher fires multiple times on Windows #308
  • Clean Target database directory ? is confusing not working #305

Closed issues:

  • Gradle Daemon causing working directory issues #314
  • marklogic spring batch requires additional date sort operator #311
  • Handling tab-delimited files #310
  • Add issue template to the repo #309
  • Last deployed time sometimes says 47 years ago #303

v1.0.0-rc.6 (2016-10-17)

Full Changelog

Fixed bugs:

  • Deadlock when evaling from writer #231

Closed issues:

  • Update Trace UI in Trace server #302
  • Trace enhancement: Not logging enough for error trace #301
  • ArrayIndexOutOfBoundsException #298
  • Getting Started Tutorial - Sample code for Acme Tech header plugin does not update 'latest' variable #297
  • Not all data is processed in harmonize flow when thread count is greater than 1 #296
  • New Mlcp Error grabbing has false positives on windows #295
  • Clarify that ML DHF is FOSS and not supported MarkLogic product #294
  • custom thread count throws parsing error #292
  • RC5: the ingest steps in quick start gives a exception and is not runned #291
  • fix gradle tasks for run flow #290
  • When exception is thrown, not all flow traces are persisted. #278
  • Add ability to clear the Staging or Final database #198
  • mlcp_transform needs profiling #162

v1.0.0-rc.5 (2016-09-27)

Full Changelog

Implemented enhancements:

  • Allow plugins to know then name of the entity #271
  • Mark mlcp jobs with errors as failed? #268

Fixed bugs:

  • Tooltip comment for mlcp option wrong #270
  • TimeAgo #267

Closed issues:

  • chore: update java dependencies #287
  • Github pages link error #285
  • Module watch fails when you switch projects #284
  • chore: fix appveyor build #282
  • Lots of cache warnings #281
  • Trace settings gets wiped out when content database is cleared #280
  • Better distinguish between Entities and Flows #275
  • Exception in Quick Start #274
  • Setting up on Mac causes an issue with .war file #273
  • rc4 - input flow UI jacked up on chrome/windows #272
  • MLCP command is using deprecated command line flags #265
  • QuickStart App: Status indicator on installation screen is out of view when text is enlarged #262
  • Run Flow buttons inconsistent b/c Harmonize runs immediately #257
  • QuickStart App data not loaded to correct collection #250

v1.0.0-rc.4 (2016-09-02)

Full Changelog

Implemented enhancements:

  • Add Spring Batch Example #263

Closed issues:

  • MLCP Command for CSV files is generated incorrectly #261
  • update examples now that rc.2 is out #247
  • UI rework based on new screen designs #70

v1.0.0-rc.3 (2016-08-25)

Full Changelog

Fixed bugs:

  • Better support for mixed flow and file type #228

Closed issues:

  • better support for binaries #259
  • Get traces is super slow #258
  • Job Output window stuck and not close-able #256
  • mlcp uri replace is busted when run from cygwin #255
  • Enable tracing by default #254
  • Clear modules / Redeploy #252
  • quickstart should be deployable to an appserver under a subdir #249
  • Install status window too narrow #248
  • gradle tasks need to force deploy content #246
  • Running MLCP on non-existing flow causes error #243
  • Loading GlobalCorp dataset results in deadlocks #225
  • Deploy modules button should clear out the modules first #214
  • Better error handling for failed hub install #176

v1.0.0-rc.2 (2016-08-10)

Full Changelog

Closed issues:

  • gradle isn't deploying modules properly #244
  • Remove Tweets Example #234

v1.0.0-rc.1 (2016-08-04)

Full Changelog

Fixed bugs:

  • Error in writer caused exception with tracing #235
  • Failed test : DataHubTest.testInstallUserModules #106

Closed issues:

  • Unable to run the harmonize flows #242
  • ML Version is unnaceptable #241
  • rename config to marklogic-config #239
  • Allow many developers to share a server, each with their own Data Hub #237
  • Change colors and icons to match other MarkLogic content/GUIs #236
  • isInstalled fails on 9 nightly #216
  • Tracing UI #210
  • During install, list the artifacts being created #194
  • Performance tracing #193
  • Refactor the Spring Boot API #145
  • Support index configuration as a part of pushbutton deploy. #10

v1.0.0-beta.6 (2016-06-20)

Full Changelog

Fixed bugs:

  • Need to specify collation in query in trace-lib.xqy #230

Closed issues:

  • Better gradle integration #232
  • Add example project for advanced gradle #185

Merged pull requests:

v1.0.0-beta.5 (2016-05-03)

Full Changelog

Fixed bugs:

  • Fix bugs in load data feature #219
  • Error running hadoop #121

Closed issues:

  • Refactor to Auto deploy code #197

Merged pull requests:

v1.0.0-beta.4 (2016-04-21)

Full Changelog

Implemented enhancements:

  • Minor improvements to Load Data Feature #205

Fixed bugs:

  • File permission error running hadoop to do data load #89

Closed issues:

  • Rename conform/conformance to harmonize #201
  • Errors only flash on the GUI for a short time #192
  • Investigate MLCP UI for creating MLCP cmd line options #164
  • Examples need demo scripts #99
  • DataHub.installUserModules should be "syncUserModules" #45

Merged pull requests:

v1.0.0-beta.3 (2016-04-15)

Full Changelog

Closed issues:

  • Enable Tracing in the Hub #199

Merged pull requests:

v1.0.0-beta.2 (2016-04-13)

Full Changelog

Implemented enhancements:

  • Handle duplicate REST service extensions and transforms #143

Fixed bugs:

  • Bug deploying rest services - maybe missing <hub:plugins> config ? #187
  • Session invalidated bug #109

Closed issues:

  • REST folder is being deployed as assets #189
  • Create Hub example for simple gradle integration #184
  • Error while loading data #179
  • Uninstall hub results in error #177
  • Define different func signatures for simple vs advanced Flows #174
  • Revisit comments in plugin template files #168
  • Add writer to scaffolding for conformance flow #115
  • Make UI code more angular #104
  • Swagger UI #75
  • Swagger JSON Endpoint #74
  • gradle plugin to run hub functions from a gradle project #58

Merged pull requests:

v1.0.0-beta.1 (2016-04-01)

Full Changelog

Closed issues:

  • JsHint Error on Build #170
  • Better error handling when session has expired #166
  • Identifier ending up in json files #159
  • conform content plugins don't work on json #158
  • Automatically assign a collection to docs based on flow and entity names #142
  • Remember latest load data parameter per flow #130
  • Docs overhaul #103
  • Add REST scaffolding #102
  • Change detection should pick up REST changes #101

Merged pull requests:

v1.0.0-alpha.4 (2016-03-25)

Full Changelog

Closed issues:

  • HTTP Calls are cached in IE #156
  • add sample data for tweets #154
  • get_content transform not working for json files #152
  • Support loading of compressed archives #149
  • Don't reset User Prefs on logout #146
  • Vet plugins isn't quite right #140
  • for hl7 example change patientRecord to Patient #137
  • Create Conformance flow not working #135
  • Error on New Flow #133
  • Hub wide modules folder for xqy/sjs #129
  • Fix delay after deploying modules #114
  • Detect (vet) bad user plugins #91
  • Better file browsing on load-data #88
  • Input Flow doesn't report back failures #67

Merged pull requests:

v1.0.0-alpha.3 (2016-03-15)

Full Changelog

Closed issues:

  • Add staging and final REST port as input during login #117
  • New Flow button doesn't work #100
  • Better summary on releases page #98
  • Add Changelog #97
  • remove explicit references to "hub in a box" and use "dhib" #85
  • Create a build process #81
  • When inserting a document from java, allow a flow to run #79
  • Build an HL7 Hub #71

Merged pull requests:

v1.0.0-alpha.2 (2016-03-09)

Full Changelog

Fixed bugs:

  • Misleading stack trace about missing get-content.xml #87

Closed issues:

  • Add ability to specify some MLCP attributes on import #94
  • Epic: batch tracking and control #92

Merged pull requests:

v1.0.0-alpha.1 (2016-03-08)

Full Changelog

Implemented enhancements:

  • Add a button to deploy a User's hub modules #24
  • Allow user to specify where local hub modules are located #23
  • If installed, skip setup screen #22
  • Allow the user to provide ML config info in a properties file or command line #21
  • Determine whether or not hub is installed immediately after login #20

Closed issues:

  • Standard Rest transform to get content only #76
  • Update dir tree to reflect where REST stuff lives #73
  • Ability to define search options #72
  • Use Spring batch for batch running #62
  • Prompt user to determine if they want sjs or xquery plugins #57
  • Create a staging and tranformed database #56
  • Add scaffolding for sjs, xslt #55
  • Support JSON envelopes #54
  • Domains should be called Entities #53
  • Build jar instead of war for quickstart #52
  • Scaffolding should distinguish between input and conformance flows #51
  • add support for travis builds #47
  • As a user I want to be able to cancel a running flow because I just want to do it for the lulz #44
  • path for conformance plugins is wrong in xquery #41
  • Need UI feedback when performing long-running tasks #40
  • Quickstart is caching server state #39
  • Update QuickStart to use Scaffolding class from data-hub jar #38
  • Change INPUT and CANONICAL to lowercase #34
  • Make the Input and Canonical flows optional #33
  • Fix Hub Install and Uninstall in DataHub class #30
  • As a developer or admin, from Quickstart Application, I want to deploy DHIB components to MarkLogic so that I can get started quickly and easily. #14
  • As a data hub admin or developer, I want to setup the QuickStart application so that I can deploy and manage data hub via GUI #13
  • Create a Spring Boot deployer to set up Tomcat #12
  • define the Java Api #11
  • Plugins should always have an overall function implementation #9
  • Support config driven 'Collectors' to drive the list of transform tasks (like corb URIs query) #8
  • Provide a spec for plugin or plugins. #5
  • Pushbutton deploy - Allow easy deployment to different environments. #4
  • Stage the data from source systems as raw documents in MarkLogic database #1

Merged pull requests:

* This Change Log was automatically generated by github_changelog_generator

You can’t perform that action at this time.