Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable perfect hash support in GAE #2959

Merged
merged 1 commit into from Jul 18, 2023

Conversation

sighingnow
Copy link
Collaborator

No description provided.

siyuan0322
siyuan0322 previously approved these changes Jul 3, 2023
@@ -265,7 +268,8 @@ def __init__(
Defaults to global.
compact_edges (bool, optional): Compact edges (CSR) using varint and delta encoding. Defaults to False.
Note that compact edges helps to half the memory usage of edges in graph data structure, but may cause
at most 10%~20% performance degeneration in some algorithms.
at most 10%~20% performance degeneration in some algorithms. Defaults to False.
use_perfect_hash (bool, optional): Use perfect hash in vertex map to optimize the memory usage. Defaults to False.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a comment saying it only works for oid type int64_t? It I understand correctly.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or just check the oid and log error.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Works for string oid as well.

Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
@codecov-commenter
Copy link

codecov-commenter commented Jul 17, 2023

Codecov Report

Merging #2959 (ba1b528) into main (cc48248) will increase coverage by 30.91%.
The diff coverage is n/a.

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff             @@
##             main    #2959       +/-   ##
===========================================
+ Coverage   42.40%   73.31%   +30.91%     
===========================================
  Files          99       99               
  Lines       10699    10733       +34     
===========================================
+ Hits         4537     7869     +3332     
+ Misses       6162     2864     -3298     
Impacted Files Coverage Δ
python/graphscope/client/session.py 76.16% <ø> (+9.77%) ⬆️
python/graphscope/framework/dag_utils.py 67.09% <ø> (+23.30%) ⬆️
python/graphscope/framework/graph.py 84.29% <ø> (+14.52%) ⬆️
python/graphscope/framework/graph_builder.py 86.00% <ø> (+17.25%) ⬆️
python/graphscope/tests/conftest.py 86.68% <ø> (+38.69%) ⬆️
...on/graphscope/tests/kubernetes/test_demo_script.py 84.06% <ø> (ø)
python/graphscope/tests/minitest/test_min.py 0.00% <ø> (ø)
python/graphscope/tests/unittest/test_app.py 96.77% <ø> (+96.77%) ⬆️

... and 50 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8da9e1c...ba1b528. Read the comment docs.

@sighingnow sighingnow merged commit aabda62 into alibaba:main Jul 18, 2023
24 of 28 checks passed
@sighingnow sighingnow deleted the ht/use-perfect-hash branch July 18, 2023 01:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants