2.1.1

Release notes

• These release notes provide information about new features, fixes, and updates that are included in the latest update release.
• We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon

ADB to Purview Connector Solution Accelerator - Version 2.1.1

Version 2.1.1

Features

• No new features in this release.

Major Bug Fixes

• If your mount points overlapped (e.g. /mnt/x and /mnt/x/y) the solution accelerator would find only the shortest path (/mnt/x/`) even if you were specifying the longer path in your code. Now, the solution accelerator will match on the longest (in terms of folder hierarchy) path first.
• When using managed Hive tables in Databricks (i.e. default database pointing to the default DBFS location of /usr/hive/warehouse), the solution accelerator may match to the wrong entity given Purview's inability to handle @ in the query string. Now the solution accelerator can more accurately find match tables or create a placeholder entity if the hive metastore has not been scanned.
  • This requires that the spark.openlineage.namespace is set to the pattern adb-<workspace-id>#<cluster-id>

Other Updates

• The demo environment has been updated to support the hive managed tables scenario out of the box.

Upgrade from 2.1.0 to 2.1.1

You will need to deploy the updated function code to Azure. You can do so by:

• Cloning the repo and deploying via VS code's Azure Functions Extension.
• Using the Azure CLI to do a zip push deployment with the 2.1.1 zip release artifact.

What's Changed

• Add additional troubleshooting guidance from August 2022 by @wjohnson in #94
• Mount Point matching should look for the longest string match by @wjohnson in #108
• Hotfix/tests and output with notebook2 1 by @wjohnson in #109
• Enable Hive Managed Tables in Demo Environment by @wjohnson in #110

Full Changelog: 2.1.0...2.1.1