Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] Tez examples integration test #957

Closed
3 tasks done
zhengchenyu opened this issue Jun 19, 2023 · 2 comments
Closed
3 tasks done

[Subtask] Tez examples integration test #957

zhengchenyu opened this issue Jun 19, 2023 · 2 comments

Comments

@zhengchenyu
Copy link
Collaborator

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

Describe the subtask

Add tez example integration test

Parent issue

#321

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@zhengchenyu
Copy link
Collaborator Author

zhengchenyu commented Jun 20, 2023 •
edited
Loading

There are 6 examples in tez-exampels project.

JoinDataGen and JoinValidate are used for generated input and verify result, so ignore it.

Example How to check
WordCount make sure the results generated by original tez are same with rss tez.
OrderedWordCount make sure the results generated by original tez are same with rss tez.
SimpleSessionExample make sure the results generated by original tez are same with rss tez.
HashJoinExample JoinDataGen is used to generated input. JoinValidate is used to verify result.
SortMergeJoinExample JoinDataGen is used to generated input. JoinValidate is used to verify result.
CartesianProduct make sure the results generated by original tez are same with rss tez, but not guarantee the order.

cartesianproduct will run failed in unpartitioned mode, so only test in partitioned mode.

zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jun 29, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
b3f3d42
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jun 29, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
5a5df85
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 3, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
1923879
@zhengchenyu
Copy link
Collaborator Author

This PR is not ready to review. The integration test will fail until some issue is solved.
This issue are blocked by:

zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 3, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
2a789f5
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 4, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
9922194
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 4, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
13897fc
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 4, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test
7c083da
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 5, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test. (#13)
294b466 
* [apache#957] feat(tez): Tez examples integration test

* add dependency for integration test for hadoop3.2

* add dependency for integration test for hadoop3.2

* exclude hadoop
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 6, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test.
351dea9
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 11, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test.
1603b2b
zhengchenyu added a commit to zhengchenyu/incubator-uniffle that referenced this issue Jul 11, 2023
@zhengchenyu
[apache#957] feat(tez): Tez examples integration test.
c7c35db
jerqi pushed a commit that referenced this issue Jul 12, 2023
@zhengchenyu
[#957] feat(tez): Tez examples integration test (#982)
889f67e 
### What changes were proposed in this pull request?

Add integration test for tez

### Why are the changes needed?

To construct tez test pipeline, we need integration test.

### How was this patch tested?

integration test.
@jerqi jerqi closed this as completed Jul 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jerqi @zhengchenyu