Skip to content

Release v0.27.1 #1900

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 12, 2024
Merged

Release v0.27.1 #1900

merged 1 commit into from
Jun 12, 2024

Conversation

@nfx
Copy link
Collaborator

@nfx nfx commented Jun 12, 2024

  • Fixed typo in known.json (#1899). A fix has been implemented to correct a typo in the known.json file, an essential configuration file that specifies dependencies for various components of the project. The typo was identified in the gast dependency, which was promptly rectified by modifying an incorrect character. This adjustment guarantees precise specification of dependencies, thereby ensuring the correct functioning of affected components and maintaining the overall reliability of the open-source library.

@nfx
Release v0.27.1
43454ac 
* Fixed typo in `known.json` ([#1899](#1899)). A fix has been implemented to correct a typo in the `known.json` file, an essential configuration file that specifies dependencies for various components of the project. The typo was identified in the `gast` dependency, which was promptly rectified by modifying an incorrect character. This adjustment guarantees precise specification of dependencies, thereby ensuring the correct functioning of affected components and maintaining the overall reliability of the open-source library.
@nfx nfx requested review from a team and aminmovahed-db June 12, 2024 23:34
@nfx nfx merged commit 9e70b60 into main Jun 12, 2024
@nfx nfx deleted the prepare/0.27.1 branch June 12, 2024 23:35
@github-actions
Copy link

github-actions bot commented Jun 13, 2024

❌ 193/194 passed, 1 flaky, 1 failed, 24 skipped, 3h46m33s total

❌ test_running_real_validate_groups_permissions_job_fails: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: ResourceDoesNotExist: Scope sdk-UehG does not exist! (3m4.003s) 
databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: ResourceDoesNotExist: Scope sdk-UehG does not exist!
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-rax0hhqz@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rax0hhqz@example.com')], entitlements=[], external_id=None, groups=[], id='455999263526638', name=Name(family_name=None, given_name='sdk-rax0hhqz@example.com'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='sdk-rax0hhqz@example.com')
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_G4v9g: https://DATABRICKS_HOST#setting/accounts/groups/1019793257671876
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_G4v9g', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1019793257671876', members=[ComplexValue(display='sdk-rax0hhqz@example.com', primary=None, ref='Users/455999263526638', type=None, value='455999263526638')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_G4v9g: https://accounts.CLOUD_ENVdatabricks.net/users/groups/827583276234752/members
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_G4v9g', entitlements=[], external_id=None, groups=[], id='827583276234752', members=[ComplexValue(display='sdk-rax0hhqz@example.com', primary=None, ref='Users/455999263526638', type=None, value='455999263526638')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001C697121E95BD2
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001C697121E95BD2')
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001C697121E95BD2 [group_name admins CAN_USE] -> [group_name ucx_G4v9g CAN_USE]
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_shgcy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_shgcy
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_shgcy', metastore_id=None, name='ucx_shgcy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:53 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN/config.yml) doesn't exist.
23:53 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
23:53 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
23:53 INFO [databricks.labs.ucx.install] Fetching installations...
23:53 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
23:53 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:53 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:54 INFO [databricks.labs.ucx.install] Installing UCX v0.27.1+320240612235400
23:54 INFO [databricks.labs.ucx.install] Creating ucx schemas...
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
23:54 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN/README for the next steps.
23:54 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed clusters in 0:00:00.078136
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.055516
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed instance-pools in 0:00:00.072671
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed sql/warehouses in 0:00:00.056091
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed jobs in 0:00:00.520609
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed pipelines in 0:00:00.059487
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed serving-endpoints in 0:00:00.705491
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed experiments in 0:00:00.574540
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.520922
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.000004
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed authorization in 0:00:00.000005
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.040813
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.000004
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.workspace_objects] fetching workspace_objects inventory
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.workspace_objects] crawling new batch for workspace_objects
23:54 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing started at 2024-06-12 23:54:49.439716
23:54 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN, found 1 sub-directories and 6 other objects
23:54 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN/wheels, found 0 sub-directories and 2 other objects
23:54 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing finished at 2024-06-12 23:54:49.600832. Total time taken for workspace listing: 0:00:00.161126
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.workspace_objects] found 10 new records for workspace_objects
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.grants] fetching grants inventory
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.grants] crawling new batch for grants
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.tables] fetching tables inventory
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.tables] crawling new batch for tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6ybo] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s7g5t] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sfwr7] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjp3f] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjrn2] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sqoko] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srtv5] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ajs_grant_testing] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.foo] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.some] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t08ek] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t7mgw] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tiixw] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkbmh] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkgro] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tlodc] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tloia] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twblz] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twmnr] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_ty0j0] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt.avro_serde_asyqt] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt.orc_serde_asyqt] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt.parquet_serde_asyqt] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m.avro_serde_b3b9m] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m.orc_serde_b3b9m] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m.parquet_serde_b3b9m] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri.avro_serde_smiri] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri.orc_serde_smiri] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri.parquet_serde_smiri] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6ybo.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s7g5t.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sfwr7.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.permissions] fetching table metadata
23:55 WARNING [databricks.labs.ucx.hive_metastore.tables] Schema hive_metastore.ucx_sfwr7 no longer existed
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjp3f.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjrn2.ucx_t5tlw] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.tables] found 218 new records for tables
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.udfs] fetching udfs inventory
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.udfs] crawling new batch for udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_asyqt] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_b3b9m] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_smiri] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s6uux] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s6ybo] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s7doq] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s8z7s] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sf1ap] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sgy1n] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_shgcy] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sjp3f] listing udfs
23:55 WARNING [databricks.labs.ucx.hive_metastore.udfs] Schema hive_metastore.ucx_sjp3f no longer existed
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sjrn2] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhcm] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_snzzu] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sqoko] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_srtv5] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sscad] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_swg1z] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.convert_f_to_c] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudaf] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudtf] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.testudf] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.udfs] found 4 new records for udfs
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s6ybo no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s7g5t no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sfwr7 no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sjp3f no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sjp3f no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s7g5t no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s6ybo no longer existed
23:56 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.grants] found 230 new records for grants
23:56 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 2578
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] removed on backend: authorization passwords
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object authorization passwords doesn't have any permissions
23:56 ERROR [databricks.labs.blueprint.parallel] crawl permissions(SecretScope(backend_type=<ScopeBackendType.DATABRICKS: 'DATABRICKS'>, keyvault_metadata=None, name='sdk-UehG')) task failed: Scope sdk-UehG does not exist!
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/secrets.py", line 37, in _crawler_task
    acl_items = self._ws.secrets.list_acls(scope.name)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/workspace.py", line 1995, in list_acls
    json = self._api.do('GET', '/api/2.0/secrets/acls/list', query=query, headers=headers)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 131, in do
    response = retryable(self._perform)(method,
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper
    raise err
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper
    return func(*args, **kwargs)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 242, in _perform
    raise self._make_nicer_error(response=response, **payload) from None
databricks.sdk.errors.platform.ResourceDoesNotExist: Scope sdk-UehG does not exist!
23:56 WARNING [databricks.labs.blueprint.parallel] Some 'crawl permissions' tasks failed: 100% results available (2568/2578). Took 0:00:26.277557
23:56 ERROR [databricks.labs.ucx.workspace_access.manager] Error while crawling permissions: Scope sdk-UehG does not exist!
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-rax0hhqz@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rax0hhqz@example.com')], entitlements=[], external_id=None, groups=[], id='455999263526638', name=Name(family_name=None, given_name='sdk-rax0hhqz@example.com'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='sdk-rax0hhqz@example.com')
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_G4v9g: https://DATABRICKS_HOST#setting/accounts/groups/1019793257671876
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_G4v9g', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1019793257671876', members=[ComplexValue(display='sdk-rax0hhqz@example.com', primary=None, ref='Users/455999263526638', type=None, value='455999263526638')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_G4v9g: https://accounts.CLOUD_ENVdatabricks.net/users/groups/827583276234752/members
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_G4v9g', entitlements=[], external_id=None, groups=[], id='827583276234752', members=[ComplexValue(display='sdk-rax0hhqz@example.com', primary=None, ref='Users/455999263526638', type=None, value='455999263526638')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001C697121E95BD2
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001C697121E95BD2')
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001C697121E95BD2 [group_name admins CAN_USE] -> [group_name ucx_G4v9g CAN_USE]
23:53 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_shgcy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_shgcy
23:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_shgcy', metastore_id=None, name='ucx_shgcy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:53 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN/config.yml) doesn't exist.
23:53 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
23:53 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
23:53 INFO [databricks.labs.ucx.install] Fetching installations...
23:53 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
23:53 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:53 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:54 INFO [databricks.labs.ucx.install] Installing UCX v0.27.1+320240612235400
23:54 INFO [databricks.labs.ucx.install] Creating ucx schemas...
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
23:54 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
23:54 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN/README for the next steps.
23:54 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed clusters in 0:00:00.078136
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.055516
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed instance-pools in 0:00:00.072671
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed sql/warehouses in 0:00:00.056091
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed jobs in 0:00:00.520609
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed pipelines in 0:00:00.059487
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed serving-endpoints in 0:00:00.705491
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed experiments in 0:00:00.574540
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.520922
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.000004
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed authorization in 0:00:00.000005
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.040813
23:54 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.000004
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.workspace_objects] fetching workspace_objects inventory
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.workspace_objects] crawling new batch for workspace_objects
23:54 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing started at 2024-06-12 23:54:49.439716
23:54 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN, found 1 sub-directories and 6 other objects
23:54 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pFN/wheels, found 0 sub-directories and 2 other objects
23:54 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing finished at 2024-06-12 23:54:49.600832. Total time taken for workspace listing: 0:00:00.161126
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.workspace_objects] found 10 new records for workspace_objects
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.grants] fetching grants inventory
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.grants] crawling new batch for grants
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.tables] fetching tables inventory
23:54 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.tables] crawling new batch for tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6ybo] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s7g5t] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sfwr7] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjp3f] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjrn2] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm] listing tables
23:54 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sqoko] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srtv5] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z] listing tables
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ajs_grant_testing] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.foo] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.some] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t08ek] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t7mgw] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tiixw] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkbmh] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkgro] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tlodc] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tloia] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twblz] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twmnr] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_ty0j0] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt.avro_serde_asyqt] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt.orc_serde_asyqt] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_asyqt.parquet_serde_asyqt] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m.avro_serde_b3b9m] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m.orc_serde_b3b9m] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_b3b9m.parquet_serde_b3b9m] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri.avro_serde_smiri] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri.orc_serde_smiri] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_smiri.parquet_serde_smiri] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6uux.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s6ybo.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s7g5t.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s8z7s.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sf1ap.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sfwr7.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.permissions] fetching table metadata
23:55 WARNING [databricks.labs.ucx.hive_metastore.tables] Schema hive_metastore.ucx_sfwr7 no longer existed
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_shgcy.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjp3f.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjrn2.ucx_t5tlw] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhcm.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_snzzu.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sscad.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.CLOUD_ENV_service_principals] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.clusters] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.code_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.external_locations] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.global_init_scripts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.grant_detail] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.grants] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.groups] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.jobs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.logs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.migration_status] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.misc_patterns] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.mounts] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.permissions] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.pipelines] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.policies] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.recon_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.reconciliation_results] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.submit_runs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.table_estimates] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.table_failures] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.table_size] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.tables] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.udfs] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.workflow_problems] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_swg1z.workspace_objects] fetching table metadata
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.tables] found 218 new records for tables
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.udfs] fetching udfs inventory
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.udfs] crawling new batch for udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_asyqt] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_b3b9m] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_smiri] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s6uux] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s6ybo] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s7doq] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s8z7s] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sf1ap] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sgy1n] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_shgcy] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sjp3f] listing udfs
23:55 WARNING [databricks.labs.ucx.hive_metastore.udfs] Schema hive_metastore.ucx_sjp3f no longer existed
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sjrn2] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhcm] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_snzzu] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sqoko] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_srtv5] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sscad] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_swg1z] listing udfs
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.convert_f_to_c] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudaf] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudtf] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.testudf] fetching udf metadata
23:55 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.udfs] found 4 new records for udfs
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s6ybo no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s7g5t no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sfwr7 no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sjp3f no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sjp3f no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:55 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s7g5t no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_snzzu no longer existed
23:56 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_s6ybo no longer existed
23:56 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shgcy.grants] found 230 new records for grants
23:56 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 2578
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] removed on backend: authorization passwords
23:56 WARNING [databricks.labs.ucx.workspace_access.generic] Object authorization passwords doesn't have any permissions
23:56 ERROR [databricks.labs.blueprint.parallel] crawl permissions(SecretScope(backend_type=<ScopeBackendType.DATABRICKS: 'DATABRICKS'>, keyvault_metadata=None, name='sdk-UehG')) task failed: Scope sdk-UehG does not exist!
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/secrets.py", line 37, in _crawler_task
    acl_items = self._ws.secrets.list_acls(scope.name)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/workspace.py", line 1995, in list_acls
    json = self._api.do('GET', '/api/2.0/secrets/acls/list', query=query, headers=headers)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 131, in do
    response = retryable(self._perform)(method,
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper
    raise err
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper
    return func(*args, **kwargs)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 242, in _perform
    raise self._make_nicer_error(response=response, **payload) from None
databricks.sdk.errors.platform.ResourceDoesNotExist: Scope sdk-UehG does not exist!
23:56 WARNING [databricks.labs.blueprint.parallel] Some 'crawl permissions' tasks failed: 100% results available (2568/2578). Took 0:00:26.277557
23:56 ERROR [databricks.labs.ucx.workspace_access.manager] Error while crawling permissions: Scope sdk-UehG does not exist!
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001C697121E95BD2 [group_name admins CAN_USE] -> [group_name ucx_G4v9g CAN_USE]
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001C697121E95BD2')
23:56 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.1+320240612235400 from https://DATABRICKS_HOST
23:56 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_shgcy
23:56 INFO [databricks.labs.ucx.install] Deleting jobs
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=87538095278052.
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=681119578469960.
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=515942403298342.
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1020644697282732.
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=335862614721865.
23:56 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=516498866055959.
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=328456185916157.
23:56 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=515057569197741.
23:56 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1105815856125746.
23:56 INFO [databricks.labs.ucx.install] Deleting assessment job_id=708047610772762.
23:56 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=492421365719510.
23:56 INFO [databricks.labs.ucx.install] Deleting failing job_id=14725435664041.
23:56 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=798164653102941.
23:56 INFO [databricks.labs.ucx.install] Deleting cluster policy
23:56 INFO [databricks.labs.ucx.install] Deleting secret scope
23:56 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-rax0hhqz@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rax0hhqz@example.com')], entitlements=[], external_id=None, groups=[], id='455999263526638', name=Name(family_name=None, given_name='sdk-rax0hhqz@example.com'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='sdk-rax0hhqz@example.com')
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_G4v9g', entitlements=[], external_id=None, groups=[], id='827583276234752', members=[ComplexValue(display='sdk-rax0hhqz@example.com', primary=None, ref='Users/455999263526638', type=None, value='455999263526638')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_G4v9g', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1019793257671876', members=[ComplexValue(display='sdk-rax0hhqz@example.com', primary=None, ref='Users/455999263526638', type=None, value='455999263526638')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
23:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_shgcy', metastore_id=None, name='ucx_shgcy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Flaky tests:

  • 🤪 test_create_account_level_groups (9m54.915s)

Running from acceptance #3913

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@aminmovahed-db aminmovahed-db Awaiting requested review from aminmovahed-db

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@nfx