[MINOR][Testing][DO NOT MERGE] 0.15.0 RC testing#11227
Closed
yihua wants to merge 121 commits intoapache:branch-0.xfrom
Closed
[MINOR][Testing][DO NOT MERGE] 0.15.0 RC testing#11227yihua wants to merge 121 commits intoapache:branch-0.xfrom
yihua wants to merge 121 commits intoapache:branch-0.xfrom
Conversation
…d clustering (apache#11000) --------- Co-authored-by: rmahindra123 <rmahindra@Rajeshs-MacBook-Pro.local>
…e#11022) Co-authored-by: Vova Kolmakov <kolmakov.vladimir@huawei-partners.com>
…#10962) Co-authored-by: Vova Kolmakov <kolmakov.vladimir@huawei-partners.com>
…e new thread of timeline service threadpool (apache#11039)
…rage (apache#11048) This PR adds `getDefaultBlockSize` and `openSeekable` APIs to `HoodieStorage` and implements these APIs in `HoodieHadoopStorage`. The implementation follows the same logic of creating seekable input stream for log file reading, and `openSeekable` will be used by the log reading logic. A few util methods are moved from `FSUtils` and `HoodieLogFileReader` classes to `HadoopFSUtilsclass`.
…mmon module (apache#10591) This commit makes the changes to replace most `FileSystem`, `Path`, and `FileStatus` usage with `HoodieStorage`, `StoragePath` and `StoragePathInfo` (introduced in apache#10567, renamed in apache#10672) in `hudi-common` module, to remove dependency on Hadoop FS abstraction which is not essential to most Hudi core read and write logic. This commit still keeps using the Hadoop FileSystem-based implementation under the hood. A follow-up PR will make `HoodieStorage` and I/O implementation pluggable.
…teImmutableFileInPath (apache#11052)
…di error table, and timestamp key generator to configuration listing (apache#11057)
…pache#11054) Co-authored-by: Vova Kolmakov <kolmakov.vladimir@huawei-partners.com>
…when writing to Spark (apache#11005)
…che#11070) Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
…ncrSource (apache#10900) Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com> Co-authored-by: Sagar Sumit <sagarsumit09@gmail.com>
Co-authored-by: Jonathan Vexler <=> Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
…he#11192) Co-authored-by: Jonathan Vexler <=> Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
Co-authored-by: Jonathan Vexler <=>
…e#11208) Co-authored-by: Jonathan Vexler <=>
…er (apache#10922) Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
…reamSync (apache#11014) Co-authored-by: sivabalan <n.siva.b@gmail.com>
…S3/GCS (apache#10918) Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
* [HUDI-7749] Bump Spark version 3.3.1 to 3.3.4 * cdcFileReader should return batches for CDC reads only when batch read is supported for the schema
…ead of just base files while initializing (apache#11153) Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
…pache#10763) Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com> Co-authored-by: Jonathan Vexler <=>
…11220) Co-authored-by: Jonathan Vexler <=>
…tDeltaCommitsSinceLatestCompaction (apache#10915) * Fixing schedule compaction bug * Addressing comments * Fixing CDC tests
github-actions
bot
added
size:S
github-actions
bot
added
size:XL
Collaborator
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Change Logs
As abvove.
Impact
Testing only.
Risk level
none
Documentation Update
none
Contributor's checklist