fix: handle non-contiguous RowRanges when resolving global row IDs

[zhf999]

Purpose

• Fix a correctness bug where upper layers assumed returned batch rows are continuous and derived file row IDs as previous_batch_start + offset.
• Introduce unified usage of GetPreviousBatchFileRowId(batch_row_id) to resolve the file row ID for a row index inside the current batch.
• In PrefetchFileBatchReaderImpl, cache the actual file row IDs for each returned batch and keep row-id mapping aligned when a batch is sliced by read_range.
• For Parquet, add target row-range union and per-batch row mapping logic:
  • Merge filtered target ranges into a file target row set.
  • Build batch_row_id -> file_row_id mapping in NextBatch().
  • Keep GetPreviousBatchFileRowId() correct under non-contiguous rows caused by predicate + bitmap filtering.
• Update upper-layer consumers to query per-row file IDs directly (deletion vectors, bitmap index filtering, _ROW_ID field conversion, KeyValue iteration positions).

Tests

• Updated and adapted reader tests to the new interface and semantics:
  • src/paimon/format/avro/avro_file_batch_reader_test.cpp
  • src/paimon/format/blob/blob_file_batch_reader_test.cpp
  • src/paimon/format/lance/lance_format_reader_writer_test.cpp
  • src/paimon/format/orc/orc_file_batch_reader_test.cpp
  • src/paimon/format/parquet/parquet_file_batch_reader_test.cpp
  • src/paimon/common/reader/prefetch_file_batch_reader_impl_test.cpp
• Added/extended coverage in Parquet with TestRowMapping to validate file row mapping across non-contiguous ranges.
• Remaining changes are interface migration plus consistency updates of call sites and assertions.

API and Format

• Public reader API change: FileBatchReader and implementations now use GetPreviousBatchFileRowId(uint64_t batch_row_id).
• Semantic change: returns the file row ID for the batch_row_id inside the current batch (instead of deriving by batch start + offset under contiguous assumptions).
• Storage format and on-disk protocol are unchanged.

Documentation

No.

Generative AI tooling

gpt-5.3-codex

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

[zjw1111]

Thanks for the well-structured fix! The approach of replacing GetPreviousBatchFirstRowNumber() with per-row GetPreviousBatchFileRowId(batch_row_id) is a clean solution to the non-contiguous row problem under page-level predicate pushdown. The Parquet GenerateRowMapping logic correctly handles range gaps, and the test coverage (TestRowMapping*) is thorough.

A few items below for your consideration.

[zjw1111]

LGTM

[zjw1111]

Two minor non-blocking nits — feel free to address in a follow-up commit.

[lxy-9602]

+1