Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HIVE-25782: Added client capabilites in the dry run call for the CTAS… #2858

Merged
merged 2 commits into from Dec 16, 2021

Conversation

saihemanth-cloudera
Copy link
Contributor

… query

What changes were proposed in this pull request?

Added client capabilities in the dry run for CTAS query.

Why are the changes needed?

The changes are required so that managed tables can be created with client capabilities.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Local machine, Remote cluster.

kgyrtkirk
kgyrtkirk previously approved these changes Dec 9, 2021
JeongDaeKim pushed a commit to JeongDaeKim/hive that referenced this pull request Dec 9, 2021
* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Add table-level JVM lock on commits (apache#2547)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Move ClientPool and ClientPoolImpl to core (apache#2491)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Improve code style (apache#2641)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Style: Delete blank line of CachedClientPool.java (apache#2787)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix some message typos in HiveCatalog: Matastore => Metastore (apache#2950)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix toString NPE with recommended constructor (apache#3021)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Upgrade to Gradle 7.x (apache#2826)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Ensure tableLevelMutex is unlocked when uncommitted metadata delete fails (apache#3264)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Doc: refactor Hive documentation with catalog loading examples (apache#2544)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: unify catalog experience across engines (apache#2565)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Add HadoopConfigurable interface to serialize custom FileIO (apache#2678)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Move Assert.assertTrue(..) instance checks to AssertJ assertions (apache#2756)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Support multiple specs in OutputFileFactory (apache#2858)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - MR: Use SerializableTable in IcebergSplit (apache#2988)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Fix exception exception message in IcebergInputFormat (apache#3153)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Data: Fix equality deletes with date/time types (apache#3135)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Fix ErrorProne UnnecessarilyQualified warnings (apache#3262)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Fix ErrorProne NewHashMapInt warnings (apache#3260)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Fail if both Catalog type and catalog-impl are configured (apache#3162)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - MR: Support imported data in InputFormat using name mapping (apache#3312)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix Catalog initialization without Configuration (apache#3252)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Switch to RetryingHMSClient (allows configuration of retryDelays and retries) (apache#3099)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix Catalogs.hiveCatalog method for default catalogs (apache#3338)
@kgyrtkirk
Copy link
Member

@saihemanth-cloudera there are no tests in this changeset - please add some

HarshitGupta11 pushed a commit to HarshitGupta11/hive that referenced this pull request Dec 12, 2021
* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Add table-level JVM lock on commits (apache#2547)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Move ClientPool and ClientPoolImpl to core (apache#2491)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Improve code style (apache#2641)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Style: Delete blank line of CachedClientPool.java (apache#2787)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix some message typos in HiveCatalog: Matastore => Metastore (apache#2950)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix toString NPE with recommended constructor (apache#3021)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Upgrade to Gradle 7.x (apache#2826)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Ensure tableLevelMutex is unlocked when uncommitted metadata delete fails (apache#3264)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Doc: refactor Hive documentation with catalog loading examples (apache#2544)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: unify catalog experience across engines (apache#2565)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Add HadoopConfigurable interface to serialize custom FileIO (apache#2678)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Move Assert.assertTrue(..) instance checks to AssertJ assertions (apache#2756)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Support multiple specs in OutputFileFactory (apache#2858)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - MR: Use SerializableTable in IcebergSplit (apache#2988)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Fix exception exception message in IcebergInputFormat (apache#3153)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Data: Fix equality deletes with date/time types (apache#3135)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Fix ErrorProne UnnecessarilyQualified warnings (apache#3262)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Fix ErrorProne NewHashMapInt warnings (apache#3260)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Fail if both Catalog type and catalog-impl are configured (apache#3162)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - MR: Support imported data in InputFormat using name mapping (apache#3312)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix Catalog initialization without Configuration (apache#3252)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Switch to RetryingHMSClient (allows configuration of retryDelays and retries) (apache#3099)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix Catalogs.hiveCatalog method for default catalogs (apache#3338)
@kgyrtkirk
Copy link
Member

the reported issue was that an unexpected exception was thrown - please add a test to check for that

@kgyrtkirk kgyrtkirk closed this Dec 13, 2021
@kgyrtkirk kgyrtkirk reopened this Dec 13, 2021
Copy link
Member

@kgyrtkirk kgyrtkirk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the attached test to the jira is still failing

@kgyrtkirk kgyrtkirk merged commit decd725 into apache:master Dec 16, 2021
dengzhhu653 pushed a commit to dengzhhu653/hive that referenced this pull request Dec 15, 2022
* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Add table-level JVM lock on commits (apache#2547)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Move ClientPool and ClientPoolImpl to core (apache#2491)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Improve code style (apache#2641)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Style: Delete blank line of CachedClientPool.java (apache#2787)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix some message typos in HiveCatalog: Matastore => Metastore (apache#2950)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix toString NPE with recommended constructor (apache#3021)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Upgrade to Gradle 7.x (apache#2826)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Ensure tableLevelMutex is unlocked when uncommitted metadata delete fails (apache#3264)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Doc: refactor Hive documentation with catalog loading examples (apache#2544)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: unify catalog experience across engines (apache#2565)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Add HadoopConfigurable interface to serialize custom FileIO (apache#2678)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Move Assert.assertTrue(..) instance checks to AssertJ assertions (apache#2756)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Support multiple specs in OutputFileFactory (apache#2858)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - MR: Use SerializableTable in IcebergSplit (apache#2988)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Fix exception exception message in IcebergInputFormat (apache#3153)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Data: Fix equality deletes with date/time types (apache#3135)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Fix ErrorProne UnnecessarilyQualified warnings (apache#3262)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Build: Fix ErrorProne NewHashMapInt warnings (apache#3260)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Core: Fail if both Catalog type and catalog-impl are configured (apache#3162)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - MR: Support imported data in InputFormat using name mapping (apache#3312)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix Catalog initialization without Configuration (apache#3252)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Switch to RetryingHMSClient (allows configuration of retryDelays and retries) (apache#3099)

* HIVE-25613: Port Iceberg Hive fixes to the iceberg module
Source Iceberg PR - Hive: Fix Catalogs.hiveCatalog method for default catalogs (apache#3338)
dengzhhu653 pushed a commit to dengzhhu653/hive that referenced this pull request Dec 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants