Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GIE/Physical] Introduce new physical operators (in proto) and physical plan builder #2411

Merged
merged 12 commits into from
Feb 10, 2023

Conversation

BingqingLyu
Copy link
Collaborator

@BingqingLyu BingqingLyu commented Feb 6, 2023

What do these changes do?

  1. Define new physical operators & plan in physical.proto;
  2. Define new DataType for operators in type.proto;
  3. Provide new physical plan builder.

Related issue number

#2417

@codecov-commenter
Copy link

codecov-commenter commented Feb 6, 2023

Codecov Report

Merging #2411 (d6cc5a4) into main (7a48d25) will decrease coverage by 32.09%.
The diff coverage is n/a.

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff             @@
##             main    #2411       +/-   ##
===========================================
- Coverage   72.01%   39.93%   -32.09%     
===========================================
  Files          88       88               
  Lines       10120     9771      -349     
===========================================
- Hits         7288     3902     -3386     
- Misses       2832     5869     +3037     
Impacted Files Coverage Δ
python/graphscope/tests/unittest/test_java_app.py 0.00% <0.00%> (-100.00%) ⬇️
...ython/graphscope/tests/unittest/test_cython_ast.py 0.00% <0.00%> (-100.00%) ⬇️
...ython/graphscope/tests/unittest/test_serailaize.py 0.00% <0.00%> (-100.00%) ⬇️
python/graphscope/analytical/udf/patch.py 3.47% <0.00%> (-96.53%) ⬇️
python/graphscope/tests/unittest/test_lazy.py 0.00% <0.00%> (-96.22%) ⬇️
python/graphscope/tests/unittest/test_app.py 0.00% <0.00%> (-96.18%) ⬇️
...thon/graphscope/tests/unittest/test_scalability.py 0.00% <0.00%> (-96.16%) ⬇️
...hon/graphscope/tests/unittest/test_create_graph.py 0.00% <0.00%> (-92.89%) ⬇️
python/graphscope/tests/unittest/test_graph.py 0.00% <0.00%> (-85.92%) ⬇️
python/graphscope/tests/unittest/test_context.py 0.00% <0.00%> (-81.36%) ⬇️
... and 40 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update acd11d7...d6cc5a4. Read the comment docs.

@BingqingLyu BingqingLyu force-pushed the ir_physical branch 4 times, most recently from e80bf60 to 3c70789 Compare February 8, 2023 10:43
@BingqingLyu BingqingLyu marked this pull request as ready for review February 8, 2023 10:44
}

// A dummy node to delegate a source opr for multiple scan cases.
message Dummy {}
Copy link
Collaborator

@longbinlai longbinlai Feb 9, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Name it as RootScan

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

import "expr.proto";
import "schema.proto";
import "type.proto";
import "algebra.proto";
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggest redefine those operators even they are the same as the logical ones.

PathExpand path = 32;
}
}
message ColumnType {
Copy link
Collaborator

@longbinlai longbinlai Feb 10, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个建议叫MetaData。

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@BingqingLyu BingqingLyu merged commit 2d76b3d into alibaba:main Feb 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants