Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QST]: Saving cugraph object #3114

Closed
2 tasks done
acjones27 opened this issue Jan 6, 2023 · 2 comments
Closed
2 tasks done

[QST]: Saving cugraph object #3114

acjones27 opened this issue Jan 6, 2023 · 2 comments
Labels
question Further information is requested
Milestone

Comments

@acjones27
Copy link

What is your question?

Hi,

I was wondering if anyone knows how to save a Graph object after it's been created? I'm creating a large DiGraph (1.7 billion edges), so I would preferably like to save the output once it has been created. Is this possible? I looked into pickle and joblib but got errors "cannot pickle 'socket' object" and "TypeError: cannot pickle 'TaskStepMethWrapper' object", respectively

Code of Conduct

  • I agree to follow cuGraph's Code of Conduct
  • I have searched the open issues and have found no duplicates for this question
@acjones27 acjones27 added the question Further information is requested label Jan 6, 2023
@BradReesWork
Copy link
Member

BradReesWork commented Jan 6, 2023

You can get the edge data from the graph, which is a cuDF DataFrame and then use the save features offered by cuDF.
cuDF support saving as CSV, Parquet, JSON, or ORC. https://docs.rapids.ai/api/cudf/stable/user_guide/io.html

@BradReesWork BradReesWork added this to the 23.02 milestone Jan 6, 2023
@acjones27
Copy link
Author

Hi @BradReesWork, thanks for the suggestion. Could you be more specific about the edge data? Do you mean the edgelist? If so, wouldn't I still have to rebuild the graph from scratch each time? Also, I already have the edge data since that's how I built the graph to begin with so I guess it's the same thing (apologies if I'm missing something)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants