Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HUDI-3232] auto-reload active timeline incrementally #4686

Closed
wants to merge 4 commits into from

Conversation

YannByron
Copy link
Contributor

this pr is about:

  1. load the latest active timeline automatically. do not need to call reloadActiveTimeline or reload explicitly at all.
  2. for the new layout version, load the latest instant incrementally.

@YannByron YannByron marked this pull request as draft January 25, 2022 16:06
@YannByron YannByron force-pushed the master_3232 branch 3 times, most recently from 7ae90ff to 9a743a5 Compare January 26, 2022 16:18
@nsivabalan nsivabalan added this to Under Discussion PRs in PR Tracker Board via automation Feb 3, 2022
@nsivabalan nsivabalan moved this from Under Discussion PRs to WIP in PR Tracker Board Feb 3, 2022
@nsivabalan
Copy link
Contributor

@YannByron : may I know when do you plan to revive this? looks like we have interests from the community on this patch. for large tables w/ async table services, timeline refreshes reaches 1sec or more. So, incremental load will definitely help such cases.

@YannByron
Copy link
Contributor Author

@nsivabalan I also think how to implement this better and will renew this asap, targeting to the next version, maybe 0.12 i think.

@hudi-bot
Copy link

hudi-bot commented Mar 1, 2022

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@YannByron YannByron closed this Mar 10, 2022
PR Tracker Board automation moved this from WIP to Done Mar 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

None yet

3 participants