Skip to content

[core] Support IsNaN predicate pushdown with Parquet#7875

Merged
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/predicate-isnan
May 18, 2026
Merged

[core] Support IsNaN predicate pushdown with Parquet#7875
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/predicate-isnan

Conversation

@ArnavBalyan
Copy link
Copy Markdown
Member

@ArnavBalyan ArnavBalyan commented May 16, 2026

Purpose

  • Paimon has no IsNaN predicate today, add support for the same with Paimon evaluation and parquet pushdown
  • Add IsNaN as a new LeafUnaryFunction, which can evaluate rows and pushdown to Parquet for double and float
  • ParquetFilters pushes down to Parquet via new UserDefinedPredicate.

Tests

  • UT

@ArnavBalyan
Copy link
Copy Markdown
Member Author

cc @JingsongLi thanks!

Copy link
Copy Markdown
Contributor

@JingsongLi JingsongLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit b9eaf05 into apache:master May 18, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants