New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CARBONDATA-2224][File Level Reader Support] Refactoring of #2055 #2069
Conversation
Can one of the admins verify this patch? |
1 similar comment
Can one of the admins verify this patch? |
SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3910/ |
Retest this please. |
Retest this please |
import org.apache.hadoop.mapreduce.security.TokenCache; | ||
|
||
/** | ||
* Input format of CarbonData file. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
change comment:
Base class for carbondata input format, there are two input format implementations:
1. CarbonFileInputFormat: describe this format
2. CarbonTableInputFormat: describe this format
import org.apache.hadoop.mapreduce.lib.input.FileSplit; | ||
import org.apache.hadoop.mapreduce.security.TokenCache; | ||
|
||
/** | ||
* Input format of CarbonData file. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
change description
import org.apache.hadoop.mapreduce.TaskAttemptContext; | ||
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; | ||
import org.apache.hadoop.mapreduce.lib.input.FileSplit; | ||
import org.apache.hadoop.mapreduce.security.TokenCache; | ||
|
||
/** | ||
* Input format of CarbonData file. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
change description
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3938/ |
…arbondata into carbonfile_master # Conflicts: # hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonFileInputFormat.java
retest this please |
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3943/ |
retest this please |
add to whitelist |
Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3189/ |
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4423/ |
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3946/ |
LGTM |
Review comment fixes and refactoring of apache#2055 This closes apache#2069
Review comment fixes and refactoring of apache#2055 This closes apache#2069
Review comment fixes and refactoring of apache#2055 This closes apache#2069
Review comment fixes and refactoring of #2055
CarbonTableInputFormat and CarbonFileInputFormat now extends CarbonInputFormat. This avoids the duplication of code.
And other minor review comment fixes on refactoring PR #2055
Any interfaces changed?
Any backward compatibility impacted?
Document update required?
Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance test report.
- Any additional information to help reviewers in testing this change.
For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.