Skip to content

ARROW-9726: [Rust] [DataFusion] Do not create parquet reader thread until execute is called#7961

Closed
andygrove wants to merge 1 commit intoapache:masterfrom
andygrove:ARROW-9726
Closed

ARROW-9726: [Rust] [DataFusion] Do not create parquet reader thread until execute is called#7961
andygrove wants to merge 1 commit intoapache:masterfrom
andygrove:ARROW-9726

Conversation

@andygrove
Copy link
Copy Markdown
Member

@andygrove andygrove commented Aug 13, 2020 •
edited
Loading

  • ParquetScanExec was creating the reader threads prematurely, on the creation of the partition structs and not when they were executed.
  • Also improved an error message

@andygrove
Copy link
Copy Markdown
Member Author

andygrove commented Aug 13, 2020

@jorgecarleitao @alamb fyi

@github-actions
Copy link
Copy Markdown

github-actions bot commented Aug 13, 2020

https://issues.apache.org/jira/browse/ARROW-9726

@andygrove andygrove mentioned this pull request Aug 14, 2020
Closed
@andygrove andygrove closed this in ecba35c Aug 14, 2020
alamb
alamb reviewed Aug 14, 2020
View reviewed changes
Copy link
Copy Markdown
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@asfimport asfimport mentioned this pull request Aug 14, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@alamb alamb alamb left review comments

Assignees

No one assigned

Labels

Component: Rust - DataFusion Component: Rust

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@andygrove @alamb