Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: distributed rdataframe is not yet support #3087

Conversation

ianna
Copy link
Collaborator

@ianna ianna commented Apr 19, 2024

add a clear message

@ianna
Copy link
Collaborator Author

ianna commented Apr 19, 2024

@jpivarski - is someone looking into pypy segfaults? Thanks

@jpivarski
Copy link
Member

@jpivarski - is someone looking into pypy segfaults? Thanks

Not at the moment. If you have a chance to look into #2971, that would be great.

@ianna ianna requested a review from jpivarski April 25, 2024 12:32
Copy link
Collaborator Author

@ianna ianna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jpivarski - as discussed yesterday we are making it clear that distributed RDataFrame is not supported yet.

Copy link
Member

@jpivarski jpivarski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If only distributed RDataFrames have the proxied_node attribute, this is a good way to catch it. It sounds like that might be true, but would checking the data type be more robust? E.g.

if type(data_frame).__name__ == "DistributedRDataFrame":

or something similar?

Either way, this is good to merge. I'll let you decide how to handle it.

@ianna ianna merged commit 76cb66b into main Apr 25, 2024
40 of 41 checks passed
@ianna ianna deleted the ianna/3061-from_rdataframe-does-not-work-for-distributed-rdataframe branch April 25, 2024 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

from_rdataframe does not work for distributed rdataframe
2 participants