[CARBONDATA-2071] Added block size to BblockletDataMap while initialising #1851
Conversation
ravipesala
changed the title
|
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3065/ |
|
Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1833/ |
ravipesala
force-pushed
the
add-block-size
branch
from
17c3c10
to
2565213
Compare
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3069/ |
|
Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1838/ |
|
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3054/ |
|
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3059/ |
|
verified on local standalone mode LGTM |
| @@ -244,4 +247,22 @@ public void clearAccessCount( | |||
| cacheable.clear(); | |||
| } | |||
| } | |||
|
|
|||
| public static class BlockMetaInfo { | |||
There was a problem hiding this comment.
Is it only used in this class? I think it is better to move to outside if not just used in this class
|
|
||
| public static class BlockMetaInfo { | ||
| private String[] locationInfo; | ||
| private long size; |
There was a problem hiding this comment.
please add comment for these two variable
|
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3074/ |
|
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3064/ |
|
Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1843/ |
|
retest this please |
|
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3078/ |
|
Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1847/ |
|
verified CI successfully on local machine |
Added block size to blocklet datamap so that features like small file merge can use them
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
Any interfaces changed?
Any backward compatibility impacted?
Document update required?
Testing done
For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.