Skip to content

feat(scan): support deletion vector cardinality#200

Merged
JingsongLi merged 1 commit intoapache:mainfrom
luoyuxia:support-deletion-cardinality
Apr 3, 2026
Merged

feat(scan): support deletion vector cardinality#200
JingsongLi merged 1 commit intoapache:mainfrom
luoyuxia:support-deletion-cardinality

Conversation

@luoyuxia
Copy link
Copy Markdown
Contributor

@luoyuxia luoyuxia commented Apr 3, 2026

Purpose

Linked issue: close #201

Support deletion vector cardinality in index manifest metadata so scan planning can preserve the value when building deletion files.

Brief change log

  • introduce DeletionVectorMeta to replace the raw (offset, length) tuple used by deletion vector ranges
  • deserialize and serialize optional _CARDINALITY from index manifest metadata
  • propagate deletion vector cardinality into DeletionFile during table scan planning
  • add a unit test for cardinality propagation and refresh the index manifest fixture test to use the production reader and current fixture data

Tests

  • cargo test -p paimon spec::index_manifest::tests -- --nocapture

API and Format

  • no public API changes
  • extends index manifest metadata handling to preserve optional deletion vector cardinality when present in storage

Documentation

  • N/A

Copy link
Copy Markdown
Contributor

@JingsongLi JingsongLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit 38830ef into apache:main Apr 3, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

support deletion vector cardinality

2 participants