Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix 2.8 crash, and enable load after filter #3808

Merged
merged 6 commits into from Aug 31, 2023

Conversation

GuyAv46
Copy link
Collaborator

@GuyAv46 GuyAv46 commented Aug 30, 2023

Describe the changes in the pull request

This PR is an alternative fix for #3809 and #3790. It is keeping the behavior of keeping FILTER steps in the coordinator but enables other steps that come after a FILTER step to move to the shards, if possible.
This fixes a bug that caused a LOAD step after a FILTER step to stay in the coordinator plan and later caused a crash on 2.8.

Which issues this PR fixes

  1. MOD-5267
  2. MOD-5745

Mark if applicable

  • This PR introduces API changes
  • This PR introduces serialization changes

@GuyAv46 GuyAv46 requested a review from oshadmi August 31, 2023 13:59
@GuyAv46 GuyAv46 marked this pull request as ready for review August 31, 2023 13:59
@@ -250,6 +250,53 @@ def testFilter(self):
self.env.assertLess(int(row['count']), 5)
self.env.assertGreater(int(row['count']), 2)

def testFilterBeforeLoad(self):
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Previously, this caused a crash

@codecov
Copy link

codecov bot commented Aug 31, 2023

Codecov Report

Patch coverage: 100.00% and project coverage change: +0.04% 🎉

Comparison is base (8c14679) 82.75% compared to head (c97f76d) 82.80%.
Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3808      +/-   ##
==========================================
+ Coverage   82.75%   82.80%   +0.04%     
==========================================
  Files         192      192              
  Lines       32540    32544       +4     
==========================================
+ Hits        26930    26948      +18     
+ Misses       5610     5596      -14     
Files Changed Coverage Δ
coord/src/dist_aggregate.c 91.54% <100.00%> (ø)
coord/src/dist_plan.cpp 92.33% <100.00%> (-0.96%) ⬇️

... and 5 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@GuyAv46 GuyAv46 merged commit 94dd5b7 into master Aug 31, 2023
12 of 14 checks passed
@GuyAv46 GuyAv46 deleted the guyav-fix_filter_on_coordinator_crash_only branch August 31, 2023 18:09
GuyAv46 added a commit that referenced this pull request Sep 1, 2023
* fix 2.8 crash, and enable load after filter

* added a test

* revert temporary test lines
GuyAv46 added a commit that referenced this pull request Sep 1, 2023
* fix 2.8 crash, and enable load after filter

* added a test

* revert temporary test lines
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants