Skip to content

feat(table): add incremental append scan - #1702

Open
fallintoplace wants to merge 7 commits into
apache:mainfrom
fallintoplace:feat/incremental-append-scan
Open

feat(table): add incremental append scan#1702
fallintoplace wants to merge 7 commits into
apache:mainfrom
fallintoplace:feat/incremental-append-scan

Conversation

@fallintoplace

@fallintoplace fallintoplace commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds an incremental append scan through Table.NewIncrementalAppendScan.

  • Plans data files added by append snapshots between a starting snapshot and an end snapshot.
  • Supports inclusive and exclusive starting boundaries plus snapshot ID and as-of selectors.
  • Validates snapshot ancestry while preserving the existing file-scan task shape.

Tests

  • go test ./table
  • Covers default starts, snapshot ID and as-of selectors, inclusive and exclusive boundaries, expired exclusive parents, ancestry validation, and append-only snapshot selection.

Scope

This is an append-only incremental scan. Broader changelog scanning and row-level change tracking are out of scope. Branch and tag selectors can be added separately.

@fallintoplace
fallintoplace marked this pull request as ready for review August 8, 2026 14:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant