Skip to content

[HUDI-6834] Fixing time travel queries when overlaps with cleaner and archival time window#9666

Merged
codope merged 3 commits intoapache:masterfrom
nsivabalan:timeTravelCleanerFix
Sep 12, 2023
Merged

[HUDI-6834] Fixing time travel queries when overlaps with cleaner and archival time window#9666
codope merged 3 commits intoapache:masterfrom
nsivabalan:timeTravelCleanerFix

Conversation

@nsivabalan
Copy link
Contributor

@nsivabalan nsivabalan commented Sep 8, 2023

Change Logs

When time travel query overlaps with cleaner or archival window, we should explicitly fail the query. If not, we might end up serving partial/wrong results or empty rows.

Impact

When time travel query overlaps with cleaner or archival window, we should explicitly fail the query. If not, we might end up serving partial/wrong results or empty rows.

Risk level (write none, low medium or high below)

low

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change

  • The config description must be updated if new configs are added or the default value of the configs are changed
  • Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
    ticket number here and follow the instruction to make
    changes to the website.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@nsivabalan nsivabalan added priority:blocker Production down; release blocker release-0.14.0 labels Sep 8, 2023
@nsivabalan
Copy link
Contributor Author

@hudi-bot run azure

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@lokeshj1703
Copy link
Collaborator

image

@codope codope merged commit c84ecf2 into apache:master Sep 12, 2023
prashantwason pushed a commit that referenced this pull request Sep 13, 2023
… archival time window (#9666)

When time travel query overlaps with cleaner or archival window, we should explicitly fail the query. 
If not, we might end up serving partial/wrong results or empty rows.
leosanqing pushed a commit to leosanqing/hudi that referenced this pull request Sep 13, 2023
… archival time window (apache#9666)

When time travel query overlaps with cleaner or archival window, we should explicitly fail the query. 
If not, we might end up serving partial/wrong results or empty rows.
TheR1sing3un pushed a commit to TheR1sing3un/hudi that referenced this pull request Feb 12, 2025
… archival time window (apache#9666)

When time travel query overlaps with cleaner or archival window, we should explicitly fail the query. 
If not, we might end up serving partial/wrong results or empty rows.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority:blocker Production down; release blocker release-0.14.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants