Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT][GraphAr] Add API to python client to enable loading graph from gar files or archive graph to gar files #2588

Merged
merged 9 commits into from May 10, 2023

Conversation

acezen
Copy link
Collaborator

@acezen acezen commented Apr 4, 2023

What do these changes do?

  • Add API to python client to enable loading graph from gar files or archive graph to gar files

🤖 Generated by Copilot at dfdff8a

This pull request adds a new feature to load and archive graphs in the GAR format, which is a compressed and portable format for graph data. It modifies the GrapeInstance, PropertyGraphUtils, and PropertyGraphFrame classes in the analytical engine to handle the ARCHIVE_GRAPH operation and the GAR files. It also updates the coordinator and the Python API to support graph archiving and loading from GAR files. It adds new enum values to types.proto and a conditional compilation flag to CMakeLists.txt to enable the feature.

Related issue number

issue apache/incubator-graphar#41

@yecol yecol changed the title [FEATURE][GraphAr] Add API to python client to enable loading graph from gar files or archive graph to gar files [FEAT][GraphAr] Add API to python client to enable loading graph from gar files or archive graph to gar files Apr 10, 2023
@yecol yecol self-requested a review April 10, 2023 03:10
@codecov-commenter
Copy link

codecov-commenter commented Apr 12, 2023

Codecov Report

Merging #2588 (cbcbf96) into main (909b3c4) will increase coverage by 32.22%.
The diff coverage is 95.45%.

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff             @@
##             main    #2588       +/-   ##
===========================================
+ Coverage   41.48%   73.70%   +32.22%     
===========================================
  Files          98       99        +1     
  Lines       10306    10361       +55     
===========================================
+ Hits         4275     7637     +3362     
+ Misses       6031     2724     -3307     
Impacted Files Coverage Δ
python/graphscope/framework/graph_builder.py 88.88% <90.00%> (+0.31%) ⬆️
python/graphscope/framework/graph.py 85.43% <92.85%> (+14.37%) ⬆️
python/graphscope/__init__.py 82.35% <100.00%> (+0.53%) ⬆️
python/graphscope/client/session.py 77.65% <100.00%> (+11.90%) ⬆️
python/graphscope/framework/dag_utils.py 66.44% <100.00%> (+22.40%) ⬆️
python/graphscope/tests/unittest/test_gar.py 100.00% <100.00%> (ø)

... and 52 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 909b3c4...cbcbf96. Read the comment docs.

@acezen acezen marked this pull request as ready for review April 14, 2023 01:44
@acezen acezen requested a review from sighingnow May 10, 2023 06:32
@acezen
Copy link
Collaborator Author

acezen commented May 10, 2023

@sighingnow The ci of gar has passed, only networkx ci failed which is not related to this change, can we merge the pr?

@sighingnow sighingnow merged commit 03165eb into alibaba:main May 10, 2023
14 of 15 checks passed
@sighingnow sighingnow deleted the acezen/add_gar branch May 10, 2023 13:05
acezen added a commit to acezen/GraphScope that referenced this pull request Mar 13, 2024
… gar files or archive graph to gar files (alibaba#2588)

## What do these changes do?

- Add API to python client to enable loading graph from gar files or
archive graph to gar files

## Related issue number
issue apache/incubator-graphar#41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants