Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GIE-GAIA] Profiling for GAIA #2056

Merged
merged 12 commits into from
Sep 27, 2022
Merged

[GIE-GAIA] Profiling for GAIA #2056

merged 12 commits into from
Sep 27, 2022

Conversation

BingqingLyu
Copy link
Collaborator

What do these changes do?

  • Provide profile tools in GAIA-IR, to show information of time cost, number of intermediate results in each operator, etc.
  • Provide graphviz to visualize the profiling results

Related issue number

Fixes #1805

@CLAassistant
Copy link

CLAassistant commented Sep 21, 2022

CLA assistant check
All committers have signed the CLA.

@codecov-commenter
Copy link

codecov-commenter commented Sep 21, 2022

Codecov Report

Merging #2056 (8216acf) into main (2d57a3d) will decrease coverage by 3.77%.
The diff coverage is n/a.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #2056      +/-   ##
==========================================
- Coverage   43.83%   40.06%   -3.78%     
==========================================
  Files          87       87              
  Lines        9835     9835              
==========================================
- Hits         4311     3940     -371     
- Misses       5524     5895     +371     
Impacted Files Coverage Δ
python/graphscope/tests/unittest/test_java_app.py 0.00% <0.00%> (-100.00%) ⬇️
python/graphscope/deploy/hosts/cluster.py 29.41% <0.00%> (-58.83%) ⬇️
python/graphscope/analytical/app/java_app.py 24.36% <0.00%> (-44.68%) ⬇️
python/graphscope/framework/utils.py 40.10% <0.00%> (-14.85%) ⬇️
python/graphscope/framework/app.py 69.95% <0.00%> (-10.33%) ⬇️
python/graphscope/framework/graph_schema.py 52.73% <0.00%> (-6.63%) ⬇️
python/graphscope/tests/conftest.py 48.81% <0.00%> (-4.41%) ⬇️
python/graphscope/client/rpc.py 86.11% <0.00%> (-3.71%) ⬇️
python/graphscope/analytical/udf/utils.py 36.17% <0.00%> (-3.20%) ⬇️
python/graphscope/client/session.py 63.76% <0.00%> (-3.02%) ⬇️
... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2d57a3d...8216acf. Read the comment docs.

@@ -0,0 +1,190 @@
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
#
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

感觉这个脚本放在这里也不是很合适。

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved into engine/pegasus/scripts.

@BingqingLyu BingqingLyu merged commit 28809dd into alibaba:main Sep 27, 2022
@BingqingLyu BingqingLyu deleted the ir_profile branch September 27, 2022 05:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[GAIA-IR] Profiling in GAIA-IR
5 participants