Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDDS-3840. Use OFS in MapReduce acceptance test #1365

Merged
merged 5 commits into from
Sep 3, 2020

Conversation

adoroszlai
Copy link
Contributor

@adoroszlai adoroszlai commented Aug 28, 2020

What changes were proposed in this pull request?

Run HDFS (hdfs dfs) and MapReduce (yarn jar) tests for both O3FS and OFS.

https://issues.apache.org/jira/browse/HDDS-3840

How was this patch tested?

Regular CI:
https://github.com/adoroszlai/hadoop-ozone/runs/1042638707

hadoopfs-o3fs :: Test ozone fs with hadoopfs                          | PASS |
mapreduce-o3fs :: Execute MR jobs                                     | PASS |
hadoopfs-ofs :: Test ozone fs with hadoopfs                           | PASS |
mapreduce-ofs :: Execute MR jobs                                      | PASS |
Running command 'yarn jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount -D fs.defaultFS=ofs://om/volume1/bucket1 ofs://om/volume1/bucket1/input/ ofs://om/volume1/bucket1/wordcount-35.txt
...
Running command 'yarn jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount -D fs.defaultFS=o3fs://bucket1.volume1.om/ o3fs://bucket1.volume1.om/input/ o3fs://bucket1.volume1.om/wordcount-91.txt

@adoroszlai adoroszlai self-assigned this Aug 28, 2020
Copy link
Contributor

@smengcl smengcl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @adoroszlai . lgtm +1.

@adoroszlai adoroszlai merged commit ead6371 into apache:master Sep 3, 2020
@adoroszlai adoroszlai deleted the HDDS-3840 branch September 3, 2020 14:43
@adoroszlai
Copy link
Contributor Author

Thanks @smengcl for the review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants