2.0.3

Release notes

• These release notes provide information about new features, fixes, and updates that are included in the latest update release.
• We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon

ADB to Purview Connector Solution Accelerator - Version 2.0.3

Version 2.0.3

Bug Fixes

All fixes are around the demo deployment. If you are using the connector only deployment or have already deployed the solution accelerator, there is no action for you to take in this release.

For those who were having an issue with the demo deployment, please checkout this release and deploy the demo.

• Added a retry attempt for the ARM template deployment if there is an intermittent error causing the deployment to fail.
• Fixed Key Vault Access Policy Assignment for end user doing deployment.
• Fixed Storage Blob Data Reader role assignment for Purview Managed Service Identity.

Full Changelog: 2.0.2...2.0.3

2.0.2

Merge pull request #67 from microsoft/hotfix/entitysearchinpurview

Hotfix/entitysearchinpurview

2.0.1

Release notes

• These release notes provide information about new features, fixes, and updates that are included in the latest update release.
• We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon

ADB to Purview Connector Solution Accelerator - Version 2.0.1

Version 2.0.1

Bug Fixes

• The demo deployment had a malformed spark configuration due to missing quotation marks.
• Made the ARM Template use a secure string for Client Secret.
• Fixed broken README links

Full Changelog: 2.0.0...2.0.1

2.0.0

Release notes

• These release notes provide information about new features, fixes, and updates that are included in the latest update release.
• We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon

ADB to Purview Connector Solution Accelerator - Version 2.0

Version 2.0

Features

• Support for Databricks runtime version 10.4
• Support for certificate based authentication for Microsoft Purview and/or Azure Databricks
• Change to default SQL source behavior, table information with a dot in the string will be interpreted as a custom schema and table name by default. In past versions, a name string like this "table.name" from Open Lineage would translate to a Purview entity name containing "dbo.table.name". We did some polling and determined that customers are more likely to use this pattern to denote a custom schema, rather than having table names containing dots. Going forward, the default installed configuration will treat such strings as schema.tablename. If you wish to shift back to the old behavior, you can delete the "azureSQLNonDboNoDotsInNames" section in the OlToPurviewMappings function configuration.

Bug Fixes

• Filter duplicate Open Lineage Messages

Other

• Improved documentation of base install scenario
• More detailed description of the contribution process
• New troubleshooting and limitation scenarios added to documentation
• Other documentation changes / additions

Upgrade from 1.1 to 2.0

OpenLineage / Databricks Installation

• Remove the openlineage-spark-0.8.2.jar and install the openlineage-spark-0.11.0.jar

Changes to Spark Configuration on Your Cluster(s)

• spark.openlineage.version should be set to v1

Changes to Function App Settings

• AuthEndPoint should be removed.
• ResourceUri should be removed.
• Update OlToPurviewMappings with the latest mappings found in the deployment/infra/OlToPurviewMappings.json file.

Auto-Generated What's Changed

What's Changed

• Support OpenLineage 0.11.0 by @wjohnson in #10
• Test changes for new SQL non-dbo with no brackets by @marktayl1 in #38
• Bug/parser-remove-dups by @marktayl1 in #37
• Feature/configure ms purview end point by @rodrigomonteiro-gbb in #26
• Update CONTRIBUTING.md by @wjohnson in #41
• Support Certificate based auth for Databricks API. by @wjohnson in #44
• support dot notation for custom sql schema by @marktayl1 in #43
• Troubleshooting highlighted in July 2022 by @wjohnson in #49
• Clean Up for Release 2 by @wjohnson in #51
• Travis hilbert patch 2 by @TravisHilbert in #52

Full Changelog: 1.1.0...2.0.0

1.1.0

Hotfix Release notes

• These release notes provide information about new features, fixes, and updates that are included in the latest update release.
• We often roll out features (and sometimes even fixes) to Current over a period of time. If you don’t see something described below right away, you can expect it soon

ADB to Purview Connector Solution Accelerator - Version 1.0.1 RC: June 6th

Version 1.0.1 RC

Bug Fixes

Qualified name change to support the new ADB meta model

Other

documentation changes / additions
Doc / deploy changes to support the hotfix

Auto-Generated What's Changed

What's Changed

• fix openlineage link by @isantillan1 in #11
• Cleanup Unnecessary FunctionApp.zip file by @wjohnson in #16
• Describe the Steps to Connect SP to Az Databricks by @wjohnson in #23
• Updating limitations based on recent questions during June 2022 by @wjohnson in #22
• Clone versions and MS Docs slug by @mattsavarino in #21
• Single Build, Integration, and Release Pipeline by @wjohnson in #17
• Replaced IDs by @mattsavarino in #25
• Integration Tests Deploy Function App and App Settings by @wjohnson in #27
• Update openlineage-deployment.sh by @TravisHilbert in #33
• Clarified note about nightly builds by @mattsavarino in #31
• No out of the box support for Private Endpoint backed Purview by @wjohnson in #34
• Use Built-In Types and QualifiedNames by @wjohnson in #18
• Update deploy-demo.md by @TravisHilbert in #35
• Release/1.1.0 by @TravisHilbert in #36

New Contributors

• @isantillan1 made their first contribution in #11

Full Changelog: 1.0.0...1.1.0

1.0.0

Release Deprecated

Due to newly supported Azure Databricks types within Microsoft Purview, this release is deprecated and should not be used.