New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-37977][BUILD][3.2] Upgrade ORC to 1.6.13 #35266
Conversation
cc @huaxingao since she is a release manager of Apache Spark 3.2.1. |
Thank you, @HyukjinKwon . |
Thank you, @huaxingao . |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM (non-binding)
Merged to branch-3.2. |
### What changes were proposed in this pull request? This PR aims to upgrade ORC to 1.6.3 in branch-3.2 for Apache Spark 3.2.2. ### Why are the changes needed? To bring the following bug fixes: - ORC-1065: Fix IndexOutOfBoundsException in ReaderImpl.extractFileTail - ORC-1078: Row group end offset doesn't accommodate all the blocks The following is the full list. - https://github.com/apache/orc/milestone/5?closed=1 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. (FYI, this is tested in RC stage via ORC https://github.com/dongjoon-hyun/spark/pull/79) Closes #35266 from dongjoon-hyun/SPARK-37977. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Thank you all (including @LuciferYang )! |
What changes were proposed in this pull request?
This PR aims to upgrade ORC to 1.6.3 in branch-3.2 for Apache Spark 3.2.2.
Why are the changes needed?
To bring the following bug fixes:
The following is the full list.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Pass the CIs.
(FYI, this is tested in RC stage via ORC
https://github.com/dongjoon-hyun/spark/pull/79)