github-actions
released this
13 Mar 14:50
·
5 commits
to release/2.3
since this release
Release notes
- These release notes provide information about new features, fixes, and updates that are included in the latest update release.
- We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon
ADB to Purview Connector Solution Accelerator - Version 2.3.1
Version 2.3.1
Features
- Rolled back support of Delta Merge statement. There was a false positive in our test suite but additional tests were added and verified that Delta Merge is still not supported due to proprietary implementation from Databricks.
Major Bug Fixes
- Fixed issue with Library definition in Job Tasks causing deserialization error (#177)
- Fixed issue where mount points refer to nested folder (#175)
Other
- Added a utility for removing spaces from OlToPurviewMapping.json
./deployment/util/mappings-remove-spaces.py
Upgrade from 2.3.0 to 2.3.1
OpenLineage / Databricks Installation
- No changes to the OpenLineage / Databricks Installation
Changes to Function App Settings
- Update
OlToPurviewMappings
with the latest mappings found in the deployment/infra/OlToPurviewMappings.json file.
Changes to Function App
You will need to deploy the updated function code to Azure. You can do so with either of the following:
- Cloning the repo and deploying via VS code's Azure Functions Extension.
- Using the Azure CLI to do a zip push deployment with the 2.3.0 zip release artifact.
az functionapp deployment source config-zip \
-g <RESOURCE_GROUP_NAME> \
-n <FUNCTION_SERVICE_NAME> \
--src <PATH_TO_RELEASE_ZIP_FILE>