Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-41798][BUILD] Upgrade hive-storage-api to 2.8.1 #39322

Closed
wants to merge 2 commits into from
Closed

[SPARK-41798][BUILD] Upgrade hive-storage-api to 2.8.1 #39322

wants to merge 2 commits into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Dec 31, 2022

What changes were proposed in this pull request?

This PR aims to upgrade hive-storage-api to 2.8.1 for Apache Spark 3.4.0.

HIVE-24458 changed toString output and provides toOldString to get an old style output. This PR adjusts the test suite.

Why are the changes needed?

This is consistent with Apache ORC 1.7+ and required to use new ORC features like ORC-744.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

@github-actions github-actions bot added the BUILD label Dec 31, 2022
@github-actions github-actions bot added the SQL label Dec 31, 2022
@dongjoon-hyun
Copy link
Member Author

Thank you for review, @Yikun . A few test failures was due to HIVE-24458. I adjusted the test suite to use the legacy output toOldString.

@dongjoon-hyun
Copy link
Member Author

All tests passed. Merged to master for Apache Spark 3.4.0.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-41798 branch December 31, 2022 11:32
@LuciferYang
Copy link
Contributor

late LGTM

@dongjoon-hyun
Copy link
Member Author

Thank you, @LuciferYang .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants