New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CARBONDATA-1870] Add dictionary path support to carbondata #1617
Conversation
Build Success with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/469/ |
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1734/ |
SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/2117/ |
06dcfd7
to
d72a1ca
Compare
Build Success with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/486/ |
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/2132/ |
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1750/ |
d72a1ca
to
bd74173
Compare
Build Success with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/566/ |
bd74173
to
cb9f9f3
Compare
Build Success with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/575/ |
@@ -79,21 +82,26 @@ public DictionaryColumnUniqueIdentifier(AbsoluteTableIdentifier absoluteTableIde | |||
this.dataType = dataType; | |||
if (null != carbonTablePath) { | |||
this.carbonTablePath = carbonTablePath; | |||
} else { | |||
this.carbonTablePath = CarbonStorePath.getCarbonTablePath(absoluteTableIdentifier); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
dictionaryLocation needs to be initialized here also, also in other constructors
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1814/ |
cb9f9f3
to
5731dda
Compare
Build Failed with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/586/ |
5731dda
to
d88789b
Compare
Build Failed with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/589/ |
d88789b
to
b200849
Compare
Build Failed with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/591/ |
b200849
to
5a2c199
Compare
Build Success with Spark 2.2.0, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/593/ |
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1821/ |
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/2191/ |
LGTM |
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1825/ |
Added dictionary path support. Carbondata dictionary framework is further enhanced to support reading dictionary files from a given dictionary file location.
Any interfaces changed?
No
Any backward compatibility impacted?
No
Document update required?
No
Testing done
For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
NA