Skip to content

feat(blob): Support null blob and multiple blob fields write and commit#286

Merged
lxy-9602 merged 11 commits into
alibaba:mainfrom
lxy-9602:support-multi-blob-write
May 19, 2026
Merged

feat(blob): Support null blob and multiple blob fields write and commit#286
lxy-9602 merged 11 commits into
alibaba:mainfrom
lxy-9602:support-multi-blob-write

Conversation

@lxy-9602
Copy link
Copy Markdown
Collaborator

@lxy-9602 lxy-9602 commented May 17, 2026

Purpose

Linked issue: #283

This PR adds support for writing and committing tables with null blob and multiple blob fields.
It also supports committing with row-tracking.partition-group-on-commit options.
Previously only a single non-null blob field was supported.

TODO: Reading multiple blob fields.

Tests

SchemaValidationTest.TestWithBlobField
BlobTableInteTest.TestAppendTableWriteWithMultipleBlobFields
WriteInteTest.TestAppendTableWriteWithMultipleBlobFields
WriteInteTest.TestRowTrackingPartitionGroupOnCommit
WriteInteTest.TestRowTrackingPartitionGroupOnCommitDisabled
WriteInteTest.TestMultipleBlobFieldsSplitByTargetSize
BlobTableInteTest.TestAppendWriteWithNullBlob

API and Format

Add row-tracking.partition-group-on-commit, blob-field options.

Documentation

Generative AI tooling

Generated-by: Claude-4.6-Opus

@zjw1111 zjw1111 requested a review from Copilot May 18, 2026 03:46
@zjw1111 zjw1111 requested review from Copilot and removed request for Copilot May 18, 2026 06:07
@lxy-9602 lxy-9602 changed the title feat(blob): Support multiple blob fields write and commit feat(blob): Support null blob and multiple blob fields write and commit May 18, 2026
@zjw1111
Copy link
Copy Markdown
Collaborator

zjw1111 commented May 18, 2026

@lxy-9602 Hi, due to some temporary issues with GitHub Copilot, the Copilot review results could not be displayed directly. I extracted the review results from the Copilot logs for your reference.
image
image
image
image

@zjw1111 zjw1111 requested review from Copilot and removed request for Copilot May 18, 2026 09:38
Comment thread src/paimon/core/io/multiple_blob_file_writer.h Outdated
Comment thread src/paimon/core/io/multiple_blob_file_writer.cpp Outdated
Comment thread src/paimon/core/io/multiple_blob_file_writer.h
Comment thread src/paimon/core/io/multiple_blob_file_writer.cpp
@lxy-9602 lxy-9602 merged commit 2d8e7cc into alibaba:main May 19, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants