Skip to content

Add single-writer validation if concurrency control is not enabled #15330

@hudi-bot

Description

@hudi-bot

In case of misconfiguration or unintended deployment model, where multiple writers write to the same table without concurrency control, the writer should be able to detect that through what's on the storage, e.g., the Hudi timeline, and abort the commit.  If we can enforce a pre-commit check leveraging the timeline (in single-writer case, there should not be new complete/inflight commits this writer is unaware of), an accidental multi-writer case should fail one writer and prevent the table from corrupted.

JIRA info

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions