Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Arrow] Guarantee threads don't call get_next after stream is done. #4712

Merged
merged 2 commits into from
Sep 16, 2022

Conversation

pdet
Copy link
Contributor

@pdet pdet commented Sep 14, 2022

@paleolimbot can you try the Arrow CI on this PR?

Potentially fixes: #4656

@paleolimbot
Copy link
Contributor

CI job kicked off! apache/arrow@45a78c3

@paleolimbot
Copy link
Contributor

I'll kick off a few more jobs to make sure, but everything I've run with this duckdb branch has a clean check 🚀 🚀 🚀 !

@paleolimbot
Copy link
Contributor

Is this a workaround you feel comfortable including in a release? The root of the problem is probably somewhere in the scanner; however, the error message doesn't give us much to go on and nobody can replicate the error anyway.

@pdet
Copy link
Contributor Author

pdet commented Sep 15, 2022

Im fine with that. @Mytherin any thoughts?

@Mytherin
Copy link
Collaborator

That's fine by me.

@Mytherin Mytherin merged commit a59d382 into duckdb:master Sep 16, 2022
nealrichardson pushed a commit to apache/arrow that referenced this pull request Sep 16, 2022
#14065 experimented with ways to solve this from Arrow's end; however, the fix in duckdb/duckdb#4712 is probably more robust. Even if that fix doesn't make it in to the next DuckDB release, when that happens this test will start failing again in case we/I forget to check.

Authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
zagto pushed a commit to zagto/arrow that referenced this pull request Oct 7, 2022
…e#14149)

apache#14065 experimented with ways to solve this from Arrow's end; however, the fix in duckdb/duckdb#4712 is probably more robust. Even if that fix doesn't make it in to the next DuckDB release, when that happens this test will start failing again in case we/I forget to check.

Authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
fatemehp pushed a commit to fatemehp/arrow that referenced this pull request Oct 17, 2022
…e#14149)

apache#14065 experimented with ways to solve this from Arrow's end; however, the fix in duckdb/duckdb#4712 is probably more robust. Even if that fix doesn't make it in to the next DuckDB release, when that happens this test will start failing again in case we/I forget to check.

Authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Arrow's to_duckb() intermittently fails after 0.5.0 release
3 participants