Skip to content

[core] Support full-text indexes on DV tables - #9031

Merged
JingsongLi merged 1 commit into
apache:masterfrom
XiaoHongbo-Hope:codex/support-fulltext-dv-snapshot
Aug 5, 2026
Merged

[core] Support full-text indexes on DV tables#9031
JingsongLi merged 1 commit into
apache:masterfrom
XiaoHongbo-Hope:codex/support-fulltext-dv-snapshot

Conversation

@XiaoHongbo-Hope

Copy link
Copy Markdown
Contributor

Purpose

Follow-up to #8930 and #8930 (comment).

Full-text scans select index files at one snapshot, but data-evolution reads previously evaluated deletion-vector live rows and raw fallback data against the latest snapshot. A materialized-deletion compaction between planning and reading could therefore combine old index row IDs with rewritten row IDs and return incomplete or incorrect top-K results.

This change carries the planned snapshot through FullTextScan.Plan, uses it for live-row filtering and raw fallback reads, and forwards the snapshot already pinned by hybrid search into data-evolution full-text scans. Raw fallback uses copyWithoutTimeTravel so the resolved read schema is preserved.

Tests

  • FullTextSearchBuilderTest, including plan -> DV commit -> read
  • FullTextSearchBuilderTest, including plan -> materialized-deletion compaction -> raw fallback read
  • PrimaryKeyFullTextReadTest
  • PrimaryKeyFullTextScanTest

All 34 tests passed with checkstyle, Spotless, and Maven enforcer enabled.

@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 1155e12 into apache:master Aug 5, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants