This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

DPP is not working on DS V2 on Spark 321 #797

Open

zhouyuan opened this issue Mar 24, 2022 · 1 comment

Labels

bug

Collaborator

zhouyuan commented Mar 24, 2022

Describe the bug
DPP is broken, here's the example on TPC-DS Q1

To Reproduce
run TPC-DS Q1

Expected behavior
fix the DPP feature

Additional context
Add any other context about the problem here.

zhouyuan added the bug label

github-actions bot mentioned this issue

[NSE-797] Filter partitions in ColumnarBatchScan according to runtimeFilters #813

Closed

Collaborator

PHILO-HE commented May 16, 2022

The below link has some tests for this feature, according to the feedback of the feature author. I will have a try.
https://github.com/apache/iceberg/blob/master/spark/v3.2/spark/src/test/java/org/apache/iceberg/spark/source/TestRuntimeFiltering.java

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.