Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CARBONDATA-2224][File Level Reader Support] Refactoring of #2055 #2069

Closed

Conversation

ajantha-bhat
Copy link
Member

@ajantha-bhat ajantha-bhat commented Mar 16, 2018

Review comment fixes and refactoring of #2055

CarbonTableInputFormat and CarbonFileInputFormat now extends CarbonInputFormat. This avoids the duplication of code.
And other minor review comment fixes on refactoring PR #2055

  • Any interfaces changed?

  • Any backward compatibility impacted?

  • Document update required?

  • Testing done
    Please provide details on
    - Whether new unit test cases have been added or why no new tests are required?
    - How it is tested? Please attach test report.
    - Is it a performance related change? Please attach the performance test report.
    - Any additional information to help reviewers in testing this change.

  • For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

@ajantha-bhat ajantha-bhat changed the title [CARBONDATA-2224][File Level Reader Support] Refactoring of #2055 [WIP][CARBONDATA-2224][File Level Reader Support] Refactoring of #2055 Mar 16, 2018
@CarbonDataQA
Copy link

Can one of the admins verify this patch?

1 similar comment
@CarbonDataQA
Copy link

Can one of the admins verify this patch?

@ravipesala
Copy link
Contributor

SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3910/

@ajantha-bhat
Copy link
Member Author

Retest this please.

@ajantha-bhat
Copy link
Member Author

Retest this please

import org.apache.hadoop.mapreduce.security.TokenCache;

/**
* Input format of CarbonData file.
Copy link
Contributor

@jackylk jackylk Mar 19, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change comment:

Base class for carbondata input format, there are two input format implementations:
1. CarbonFileInputFormat: describe this format
2. CarbonTableInputFormat: describe this format

import org.apache.hadoop.mapreduce.lib.input.FileSplit;
import org.apache.hadoop.mapreduce.security.TokenCache;

/**
* Input format of CarbonData file.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change description

import org.apache.hadoop.mapreduce.TaskAttemptContext;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.input.FileSplit;
import org.apache.hadoop.mapreduce.security.TokenCache;

/**
* Input format of CarbonData file.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change description

@ravipesala
Copy link
Contributor

SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3938/

…arbondata into carbonfile_master

# Conflicts:
#	hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonFileInputFormat.java
@ajantha-bhat
Copy link
Member Author

retest this please

@ravipesala
Copy link
Contributor

SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3943/

@ravipesala
Copy link
Contributor

retest this please

@ravipesala
Copy link
Contributor

add to whitelist

@CarbonDataQA
Copy link

Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3189/

@CarbonDataQA
Copy link

Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4423/

@ajantha-bhat ajantha-bhat changed the title [WIP][CARBONDATA-2224][File Level Reader Support] Refactoring of #2055 [CARBONDATA-2224][File Level Reader Support] Refactoring of #2055 Mar 19, 2018
@ravipesala
Copy link
Contributor

SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3946/

asfgit pushed a commit that referenced this pull request Mar 19, 2018
Review comment fixes and refactoring of #2055

This closes #2069
@jackylk
Copy link
Contributor

jackylk commented Mar 19, 2018

LGTM

asfgit pushed a commit that referenced this pull request Mar 20, 2018
Review comment fixes and refactoring of #2055

This closes #2069
jackylk pushed a commit to jackylk/incubator-carbondata that referenced this pull request Mar 21, 2018
asfgit pushed a commit that referenced this pull request Mar 23, 2018
Review comment fixes and refactoring of #2055

This closes #2069
anubhav100 pushed a commit to anubhav100/incubator-carbondata that referenced this pull request Apr 4, 2018
anubhav100 pushed a commit to anubhav100/incubator-carbondata that referenced this pull request Jun 22, 2018
@ajantha-bhat ajantha-bhat deleted the carbonfile_master branch November 23, 2018 12:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants