Skip to content

Conversation

@suibianwanwank
Copy link

@adriangb I added several tests related to multiple columns and found that the current implementation returns incorrect results.
I've made some fixes and attempted to streamline the test code. However, it seems there may still be room for further optimization. Could you please review the changes. :)

@github-actions github-actions bot added the core label Mar 26, 2025
Copy link
Member

@adriangb adriangb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice this looks great, thanks so much for pushing this forward!

Let's merge this and keep on iterating. I think the test that's going to be super valuable here is a fuzz like test that tests multiple combinations of columns, orders, types, number of partitions, etc. and compares the results with and without the dynamic pushdown feature flag enabled since the end results should always match.

@suibianwanwank
Copy link
Author

Thanks! 100% agree — this is a great next step.

@adriangb adriangb merged commit 0c01830 into pydantic:topk-filter Mar 26, 2025
26 of 27 checks passed
adriangb pushed a commit that referenced this pull request Mar 27, 2025
adriangb pushed a commit that referenced this pull request Mar 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants