`crawl_tables` goes into an infinite loop

[renardeinside]

• aeltcc_dev database is, in fact, empty
• env: Azure. running it as a job on a job cluster.

due to this, crawl_tables goes into an infinite loop.

09:29 DEBUG [d.s] [init_runtime_native_auth] runtime native auth configured
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SHOW DATABASES
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] fetching tables inventory
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SELECT * FROM hive_metastore.ucx.tables WHERE catalog = "hive_metastore" AND database = "aeltcc_dev"
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] crawling new batch for tables
09:29 DEBUG [d.l.ucx.hive_metastore.tables] [hive_metastore.aeltcc_dev] listing tables
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SHOW TABLES FROM hive_metastore.aeltcc_dev
09:29 DEBUG [d.l.ucx.framework.parallel] Starting 0 tasks in 4 threads
09:29 DEBUG [d.l.ucx.framework.parallel] Collecting the results from threaded execution
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] fetching tables inventory
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SELECT * FROM hive_metastore.ucx.tables WHERE catalog = "hive_metastore" AND database = "aeltcc_dev"
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] crawling new batch for tables
09:29 DEBUG [d.l.ucx.hive_metastore.tables] [hive_metastore.aeltcc_dev] listing tables
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SHOW TABLES FROM hive_metastore.aeltcc_dev
09:29 DEBUG [d.l.ucx.framework.parallel] Starting 0 tasks in 4 threads
09:29 DEBUG [d.l.ucx.framework.parallel] Collecting the results from threaded execution
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] fetching tables inventory
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SELECT * FROM hive_metastore.ucx.tables WHERE catalog = "hive_metastore" AND database = "aeltcc_dev"
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] crawling new batch for tables
09:29 DEBUG [d.l.ucx.hive_metastore.tables] [hive_metastore.aeltcc_dev] listing tables
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SHOW TABLES FROM hive_metastore.aeltcc_dev
09:29 DEBUG [d.l.ucx.framework.parallel] Starting 0 tasks in 4 threads
09:29 DEBUG [d.l.ucx.framework.parallel] Collecting the results from threaded execution
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] fetching tables inventory
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SELECT * FROM hive_metastore.ucx.tables WHERE catalog = "hive_metastore" AND database = "aeltcc_dev"
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] crawling new batch for tables
09:29 DEBUG [d.l.ucx.hive_metastore.tables] [hive_metastore.aeltcc_dev] listing tables
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SHOW TABLES FROM hive_metastore.aeltcc_dev
09:29 DEBUG [d.l.ucx.framework.parallel] Starting 0 tasks in 4 threads
09:29 DEBUG [d.l.ucx.framework.parallel] Collecting the results from threaded execution
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] fetching tables inventory
09:29 DEBUG [d.l.ucx.framework.crawlers] [spark][fetch] SELECT * FROM hive_metastore.ucx.tables WHERE catalog = "hive_metastore" AND database = "aeltcc_dev"
09:29 DEBUG [d.l.ucx.framework.crawlers] [hive_metastore.ucx.tables] crawling new batch for tables
09:29 DEBUG [d.l.ucx.hive_metastore.tables] [hive_metastore.aeltcc_dev] listing tables

[nfx]

Thanks for raising this issue!