Skip to content

feat(go): add postpone fixed-bucket write bindings - #722

Open
XiaoHongbo-Hope wants to merge 3 commits into
apache:mainfrom
XiaoHongbo-Hope:codex/go-postpone-fixed-bucket-binding
Open

feat(go): add postpone fixed-bucket write bindings#722
XiaoHongbo-Hope wants to merge 3 commits into
apache:mainfrom
XiaoHongbo-Hope:codex/go-postpone-fixed-bucket-binding

Conversation

@XiaoHongbo-Hope

Copy link
Copy Markdown
Contributor

Purpose

Expose the dedicated postpone fixed-bucket write path to Go.

Changes

  • Add typed builder, writer, commit-message, and committer APIs.
  • Require a resolved partition-to-bucket-count plan.
  • Reuse the Arrow ownership handling from the standard Go write binding.
  • Add a same-process multi-writer integration test and usage documentation.

Scope

This API writes real buckets for bucket = -2 tables. Planning, shuffling,
preclustering, and cross-process commit-message serialization remain the
integration's responsibility. Writers sharing one commit must use the same plan
and commit user, with one owner per (partition, bucket).

This PR adds Go bindings for the Rust/C primitives introduced by #659 and does
not change the storage format.

Expose the dedicated fixed-bucket write path for bucket = -2 tables
through typed builder, writer, commit-message, and committer handles so
they cannot be mixed with the standard write path. The caller supplies a
resolved partition-to-bucket-count plan; Go performs no planning.
@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as draft August 17, 2026 05:49
XiaoHongbo-Hope and others added 2 commits August 17, 2026 00:16
Collapse the bucket-plan helper into an inline example and merge the
constraint prose. Same coverage, fewer words.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Extend the example through WriteArrowBatch, PrepareCommit, NewCommit, and
Commit so it is runnable as-is, and drop the now-redundant lifecycle
reference. Per review feedback on apache#722.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as ready for review August 17, 2026 07:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant