[CARBONDATA-3425]Added documentation for mv #3275
Conversation
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3495/ |
|
Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11765/ |
|
Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3699/ |
docs/datamap/mv-datamap-guide.md
Outdated
| * [Data Management](#data-management-with-mv-tables) | ||
|
|
||
| ## Quick example | ||
| Download and unzip spark-2.2.0-bin-hadoop2.7.tgz, and export $SPARK_HOME |
There was a problem hiding this comment.
may be here you can create a link to preaggregate doc, instead of copying the same lines
There was a problem hiding this comment.
@akashrn5 for quick example itself?
docs/datamap/mv-datamap-guide.md
Outdated
|
|
||
| Start spark-shell in new terminal, type :paste, then copy and run the following code. | ||
| ```scala | ||
| import java.io.File |
There was a problem hiding this comment.
is this executed and tested?
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3499/ |
|
Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11770/ |
|
Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3704/ |
Indhumathi27
force-pushed
the
mv_doc
branch
2 times, most recently
from
ece7ea6
to
2589404
Compare
|
LGTM |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3548/ |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3553/ |
|
Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11827/ |
|
Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3759/ |
Indhumathi27
force-pushed
the
mv_doc
branch
3 times, most recently
from
4d3dd69
to
95e7452
Compare
Indhumathi27
changed the title
|
@ravipesala Handled all comments. Please review |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3573/ |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3575/ |
|
Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3783/ |
Indhumathi27
force-pushed
the
mv_doc
branch
4 times, most recently
from
bb63c52
to
8688bcc
Compare
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3608/ |
Indhumathi27
force-pushed
the
mv_doc
branch
2 times, most recently
from
fa7b12b
to
6225bb7
Compare
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3611/ |
Indhumathi27
force-pushed
the
mv_doc
branch
7 times, most recently
from
7524cfe
to
11fc543
Compare
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3613/ |
|
Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3819/ |
|
Retest this please |
|
Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11888/ |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3614/ |
|
Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3821/ |
|
retest this please |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/3620/ |
|
Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11894/ |
|
Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3827/ |
|
LGTM, thanks for your contribution! |
| 13. COLUMN_COMPRESSOR | ||
| * All columns of main table at once cannot participate in mv datamap table creation | ||
| * TableProperties can be provided in DMProperties excluding LOCAL_DICTIONARY_INCLUDE, | ||
| LOCAL_DICTIONARY_EXCLUDE, DICTIONARY_INCLUDE, DICTIONARY_EXCLUDE, INVERTED_INDEX, |
There was a problem hiding this comment.
Streaming property is not supported in dmproperties. This can be mentioned in this list.
| ``` | ||
| CREATE DATAMAP agg_sales | ||
| ON TABLE sales | ||
| USING "MV" |
There was a problem hiding this comment.
Usage of DMproperties can also be mentioned in example.
Added documentation for mv datamap
Any interfaces changed?
Any backward compatibility impacted?
Document update required?
Testing done
For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.