Skip to content

[query, bugfix] TableAggregate interpret supports globals in init op#14673

Merged
hail-ci-robot merged 1 commit intomainfrom
ps-09-05-fix_TableAggregate_bug
Sep 19, 2024
Merged

[query, bugfix] TableAggregate interpret supports globals in init op#14673
hail-ci-robot merged 1 commit intomainfrom
ps-09-05-fix_TableAggregate_bug

Conversation

@patrick-schultz
Copy link
Member

@patrick-schultz patrick-schultz commented Sep 6, 2024

There was a typo in the Interpret rule for TableAggregate which had it refer to the row instead of the globals inside the init op.

I tried to add a test for this, but it's frustratingly difficult to force the compiler to go through this code path. Even when using an InterpretOnly compilation, the lowering pipeline often lifts TableAggregate to a RelationalLet, and then evaluates it, using the compiler not the interpreter. This is a deeper issue we should address, but a user is currently blocked on this bug so I don't want to hold it up.

Copy link
Member Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @patrick-schultz and the rest of your teammates on Graphite Graphite

@patrick-schultz patrick-schultz changed the title fix TableAggregate bug [query, bugfix] TableAggregate interpret supports globals in init op Sep 6, 2024
@patrick-schultz patrick-schultz force-pushed the ps-09-05-fix_TableAggregate_bug branch from 86dccbd to 2247c23 Compare September 6, 2024 20:00
@patrick-schultz patrick-schultz marked this pull request as ready for review September 6, 2024 20:05
Copy link
Collaborator

@chrisvittal chrisvittal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Glad the fix was simple

ehigham

This comment was marked as outdated.

@ehigham ehigham dismissed their stale review September 9, 2024 17:13

approved by mistake

Copy link
Member

@ehigham ehigham left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you lock down this behaviour with a test?

Copy link
Member Author

Can you lock down this behaviour with a test?

As I said in the description, I tried hard to write a test, but I couldn't manage to find a way to exercise this with a targeted test. And this bug is currently blocking a user, so I want to get it released asap. I can try again, but I suspect it would end up being a day or two of extra work, and would likely still end up brittle and unsatisfactory. I'd rather spend my effort getting back into the line of work that would eventually make it much easier to target specific compiler code paths.

Copy link
Member

@ehigham ehigham left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry for not reading description!

@hail-ci-robot hail-ci-robot merged commit e80b0a7 into main Sep 19, 2024
@hail-ci-robot hail-ci-robot deleted the ps-09-05-fix_TableAggregate_bug branch September 19, 2024 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants