Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filtering out inventory database from loading into tables and filtering out the same from grant detail view #705

Merged
merged 3 commits into from
Dec 19, 2023

Conversation

prajin-29
Copy link
Contributor

Filtering out inventory database from loading into tables and filtering out the same from grant detail view.
may close #665

Copy link

codecov bot commented Dec 19, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (e1b7a27) 78.60% compared to head (4eaaf0a) 78.60%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #705   +/-   ##
=======================================
  Coverage   78.60%   78.60%           
=======================================
  Files          41       41           
  Lines        4272     4272           
  Branches      800      800           
=======================================
  Hits         3358     3358           
  Misses        711      711           
  Partials      203      203           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@@ -79,7 +79,7 @@ def getInventoryDatabase(): String={
}

val inventoryDatabase = getInventoryDatabase()
var df = metadataForAllTables(spark.sharedState.externalCatalog.listDatabases(), failures)
var df = metadataForAllTables(spark.sharedState.externalCatalog.listDatabases().filter(_ != s"$inventoryDatabase"), failures)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
var df = metadataForAllTables(spark.sharedState.externalCatalog.listDatabases().filter(_ != s"$inventoryDatabase"), failures)
var df = metadataForAllTables(spark.sharedState.externalCatalog.listDatabases().filter(_ != inventoryDatabase), failures)

check if this works

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested the same and the table was not having the inventory database.Working as expected

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do you need to interpolate a string within another string? inventoryDatabase is a string already.

FROM $inventory.grants where database != split("$inventory",'[.]')[1]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are you sure this is the right logic? $inventory won't have dots

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

inventory comes with "hive_metastore.database_name" here. I tested the same.

@@ -79,7 +79,7 @@ def getInventoryDatabase(): String={
}

val inventoryDatabase = getInventoryDatabase()
var df = metadataForAllTables(spark.sharedState.externalCatalog.listDatabases(), failures)
var df = metadataForAllTables(spark.sharedState.externalCatalog.listDatabases().filter(_ != s"$inventoryDatabase"), failures)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do you need to interpolate a string within another string? inventoryDatabase is a string already.

@nfx nfx changed the title Feature/inventary tables assessment Filtering out inventory database from loading into tables and filtering out the same from grant detail view Dec 19, 2023
@nfx nfx merged commit 2cea22f into main Dec 19, 2023
6 of 7 checks passed
@nfx nfx deleted the feature/inventary_tables_assessment branch December 19, 2023 15:55
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
@nfx nfx mentioned this pull request Dec 21, 2023
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
@nfx nfx mentioned this pull request Dec 21, 2023
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for cli ([#715](#715)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
@nfx nfx mentioned this pull request Dec 21, 2023
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands ([#708](#708)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed secret scope apply task to raise ValueError ([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration testing issues ([#722](#722)).
* Fixed some flaky integration tests ([#700](#700)).
* New CLI command for workspace mapping ([#678](#678)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs
ucx manual-workspace-info` commands for CLI
([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands
([#708](#708)).
* Added `databricks labs ucx installations` command
([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to
mark table/schema for skipping in the table migration process
([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for
cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants
([#653](#653)).
* Added cluster override and handle case of write protected DBFS
([#610](#610)).
* Added cluster policy selector in the installer
([#655](#655)).
* Added detailed UCX pre-requisite information to README.md
([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command
([#657](#657)).
* Added more granular error retry logic
([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up
assessment workflow
([#691](#691)).
* Added retry on workspace listing
([#659](#659)).
* Added support for mapping workspace group to account group by
prefix/suffix/regex/external id
([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as
`crawl_tables` was failing when run on non-UC Workspace in No Isolation
mode with unable to access the config file
([#661](#661)).
* Changed the fields of the table "Tables" to lower case
([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations
([#677](#677)).
* Enforced `mypy` validation
([#713](#713)).
* Filtering out inventory database from loading into tables and
filtering out the same from grant detail view
([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and
updated `CONTRIBUTING.md` guide
([#654](#654)).
* Fixed secret scope apply task to raise ValueError
([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration
testing issues ([#722](#722)).
* Fixed some flaky integration tests
([#700](#700)).
* New CLI command for workspace mapping
([#678](#678)).
* Reduce server load for getting workspace groups and their members
([#666](#666)).
* Throwing ManyError on migrate-groups tasks
([#710](#710)).
* Updated installation documentation to use Databricks CLI
([#686](#686)).

Dependency updates:

* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0
([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0
([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0
([#712](#712)).
FastLee pushed a commit that referenced this pull request Jan 19, 2024
* Added `databricks labs ucx create-table-mapping` and `databricks labs
ucx manual-workspace-info` commands for CLI
([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands
([#708](#708)).
* Added `databricks labs ucx installations` command
([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to
mark table/schema for skipping in the table migration process
([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for
cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants
([#653](#653)).
* Added cluster override and handle case of write protected DBFS
([#610](#610)).
* Added cluster policy selector in the installer
([#655](#655)).
* Added detailed UCX pre-requisite information to README.md
([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command
([#657](#657)).
* Added more granular error retry logic
([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up
assessment workflow
([#691](#691)).
* Added retry on workspace listing
([#659](#659)).
* Added support for mapping workspace group to account group by
prefix/suffix/regex/external id
([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as
`crawl_tables` was failing when run on non-UC Workspace in No Isolation
mode with unable to access the config file
([#661](#661)).
* Changed the fields of the table "Tables" to lower case
([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations
([#677](#677)).
* Enforced `mypy` validation
([#713](#713)).
* Filtering out inventory database from loading into tables and
filtering out the same from grant detail view
([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and
updated `CONTRIBUTING.md` guide
([#654](#654)).
* Fixed secret scope apply task to raise ValueError
([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration
testing issues ([#722](#722)).
* Fixed some flaky integration tests
([#700](#700)).
* New CLI command for workspace mapping
([#678](#678)).
* Reduce server load for getting workspace groups and their members
([#666](#666)).
* Throwing ManyError on migrate-groups tasks
([#710](#710)).
* Updated installation documentation to use Databricks CLI
([#686](#686)).

Dependency updates:

* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0
([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0
([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0
([#712](#712)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Assessment job/dashboard reports on tables it creates during the assessment process
2 participants