Skip to content

test: compare native arrow reader with pyarrow scans#6

Draft
abnobdoss wants to merge 1 commit into
aba-166-native-equality-delete-parityfrom
aba-167-native-arrow-read-integration-tests
Draft

test: compare native arrow reader with pyarrow scans#6
abnobdoss wants to merge 1 commit into
aba-166-native-equality-delete-parityfrom
aba-167-native-arrow-read-integration-tests

Conversation

@abnobdoss
Copy link
Copy Markdown
Owner

Stack position: Python PR after #5 (ABA-167).

Adds integration-style comparisons between default PyArrow scans and opt-in native Arrow batch reader scans.

Validation reported by implementer:

  • python compilation check
  • collection/skip behavior where pyiceberg-core scan modules are missing

Current status: draft, under Codex red-team review. Known red-team focus: env var semantics, whether to_arrow() is actually native, fixture reliability, skip/import placement, and comparison robustness.

@abnobdoss abnobdoss force-pushed the aba-167-native-arrow-read-integration-tests branch from 00b1cc9 to 4ae56ff Compare May 25, 2026 02:08
@abnobdoss abnobdoss force-pushed the aba-166-native-equality-delete-parity branch from 3163619 to a4ccc0e Compare May 25, 2026 02:21
@abnobdoss abnobdoss force-pushed the aba-167-native-arrow-read-integration-tests branch from 4ae56ff to 443819e Compare May 25, 2026 02:22
@abnobdoss abnobdoss force-pushed the aba-166-native-equality-delete-parity branch from a4ccc0e to 67c4bf9 Compare May 25, 2026 02:44
@abnobdoss abnobdoss force-pushed the aba-167-native-arrow-read-integration-tests branch from 443819e to abe8da0 Compare May 25, 2026 02:44
@abnobdoss abnobdoss force-pushed the aba-166-native-equality-delete-parity branch from 67c4bf9 to 5b181ea Compare May 25, 2026 02:58
@abnobdoss abnobdoss force-pushed the aba-167-native-arrow-read-integration-tests branch from abe8da0 to bb205f9 Compare May 25, 2026 02:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant