Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-11489: [Rust][DataFusion] Make DataFrame be Send + Sync #9406

Closed
wants to merge 1 commit into from

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Feb 3, 2021

Inspired by a question on the mailing list link

Things need to be Send + Sync in order to be sent between threads (or async tasks). Thus we should make DataFrame require Send + Sync as well so as to be usable in async applications.

@github-actions
Copy link

github-actions bot commented Feb 3, 2021

Thanks for opening a pull request!

Could you open an issue for this pull request on JIRA?
https://issues.apache.org/jira/browse/ARROW

Then could you also rename pull request title in the following format?

ARROW-${JIRA_ID}: [${COMPONENT}] ${SUMMARY}

See also:

@seddonm1
Copy link
Contributor

seddonm1 commented Feb 3, 2021

I did this in my personal fork and was planning to raise it with Andy. Glad this will be done 👍

@alamb alamb changed the title [Rust] Make DataFrame also be Send+Sync [Experiment] ARROW-11489: [Rust][DataFusion] Make DataFrame be Send + Sync Feb 3, 2021
@alamb
Copy link
Contributor Author

alamb commented Feb 3, 2021

fyi @jorgecarleitao / @andygrove / @Dandandan

@github-actions
Copy link

github-actions bot commented Feb 3, 2021

Copy link
Member

@jorgecarleitao jorgecarleitao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for the quick reaction on this!

Copy link
Contributor

@Dandandan Dandandan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@alamb alamb closed this in 4bacb4c Feb 6, 2021
nevi-me pushed a commit to nevi-me/arrow that referenced this pull request Feb 13, 2021
Inspired by a question on the mailing list [link](
https://lists.apache.org/thread.html/r8f81fae08346817fa283804037ed79a4309bb54aa8ed77c354d7baf0%40%3Cuser.arrow.apache.org%3E)

Things need to be `Send` + `Sync` in order to be sent between threads (or async tasks). Thus we should make `DataFrame` require `Send` + `Sync` as well so as to be usable in async applications.

Closes apache#9406 from alamb/alamb/dataframe_send_sync

Authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
maxburke pushed a commit to urbanlogiq/arrow that referenced this pull request Mar 11, 2021
Inspired by a question on the mailing list [link](
https://lists.apache.org/thread.html/r8f81fae08346817fa283804037ed79a4309bb54aa8ed77c354d7baf0%40%3Cuser.arrow.apache.org%3E)

Things need to be `Send` + `Sync` in order to be sent between threads (or async tasks). Thus we should make `DataFrame` require `Send` + `Sync` as well so as to be usable in async applications.

Closes apache#9406 from alamb/alamb/dataframe_send_sync

Authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
GeorgeAp pushed a commit to sirensolutions/arrow that referenced this pull request Jun 7, 2021
Inspired by a question on the mailing list [link](
https://lists.apache.org/thread.html/r8f81fae08346817fa283804037ed79a4309bb54aa8ed77c354d7baf0%40%3Cuser.arrow.apache.org%3E)

Things need to be `Send` + `Sync` in order to be sent between threads (or async tasks). Thus we should make `DataFrame` require `Send` + `Sync` as well so as to be usable in async applications.

Closes apache#9406 from alamb/alamb/dataframe_send_sync

Authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
michalursa pushed a commit to michalursa/arrow that referenced this pull request Jun 13, 2021
Inspired by a question on the mailing list [link](
https://lists.apache.org/thread.html/r8f81fae08346817fa283804037ed79a4309bb54aa8ed77c354d7baf0%40%3Cuser.arrow.apache.org%3E)

Things need to be `Send` + `Sync` in order to be sent between threads (or async tasks). Thus we should make `DataFrame` require `Send` + `Sync` as well so as to be usable in async applications.

Closes apache#9406 from alamb/alamb/dataframe_send_sync

Authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants