docs(blog): flink async instant generation blog#17818
Merged
xushiyan merged 1 commit intoapache:asf-sitefrom Jan 9, 2026
Merged
docs(blog): flink async instant generation blog#17818xushiyan merged 1 commit intoapache:asf-sitefrom
xushiyan merged 1 commit intoapache:asf-sitefrom
Conversation
There was a problem hiding this comment.
Pull request overview
This PR adds a new blog post about Apache Hudi 1.1's async instant time generation feature for Flink writers, including supporting image assets.
Key Changes:
- New blog post explaining the asynchronous instant generation mechanism that eliminates throughput fluctuations in streaming ingestion
- Addition of 4 PNG image files illustrating timeline concepts, file slicing mechanisms, TrueTime architecture, and async instant generation workflow
Reviewed changes
Copilot reviewed 1 out of 9 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
website/blog/2026-01-09-hudi-11-deep-dive-flink-async-instant-gen.md |
Main blog post covering background, instant time concepts, completion time, TrueTime API, and async instant generation for Flink writers |
website/static/assets/images/blog/2026-01-09-hudi-11-deep-dive-flink-async-instant-gen/truetime.png |
Image illustrating TrueTime architecture and distributed clock synchronization |
website/static/assets/images/blog/2026-01-09-hudi-11-deep-dive-flink-async-instant-gen/file-slicing-instant-time.png |
Image showing file slicing based on instant time |
website/static/assets/images/blog/2026-01-09-hudi-11-deep-dive-flink-async-instant-gen/file-slicing-completion-time.png |
Image showing file slicing based on completion time |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
|
|
||
| To address these issues, starting from version 1.0, Hudi introduced a new file slicing model based on a time interval defined by requested time and completion time. In release 1.x, each commit has two important time concepts: requested time and completion time. All generated timestamps are globally monotonically increasing. The timestamp in the log file name is no longer the base instant time, but rather the requested instant time of the write operation. During the file slicing process, Hudi looks up the completion time for each log file using its instant time and applies a new file slicing rule: | ||
|
|
||
| > _A log file belongs to the file slice with the maximum base requested time that is less than or equal to the log file's completion time._ [5] |
There was a problem hiding this comment.
Missing space between the period and the citation. Should be "time. [5]" instead of "time._[5]"
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.