[CARBONDATA-2793][32k][Doc] Add 32k support in document #2572
Conversation
Update document and add description for long string columns
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7560/ |
|
Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6314/ |
|
SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/6030/ |
|
SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/6031/ |
| @@ -283,7 +283,29 @@ This tutorial is going to introduce all commands and data operations on CarbonDa | |||
| ``` | |||
| ALTER TABLE employee SET TBLPROPERTIES (‘CACHE_LEVEL’=’Blocklet’) | |||
| ``` | |||
|
|
|||
|
|
|||
| - **String longer than 32000 characters** | |||
There was a problem hiding this comment.
If it is a Alpha feature then please mention in the bracket that (Alpha Feature 1.4.1 )
|
Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7617/ |
|
Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6362/ |
|
only document updated, no code related |
| - **String longer than 32000 characters** (Alpha Feature 1.4.1) | ||
|
|
||
| In common scenarios, the length of string is less than 32000, so carbondata store the length of content using Short to reduce memory and space consumption. | ||
| If your string content exceeds the 32000 characters limitation, you can specify the columns as 'long string column' using below tblProperties: |
There was a problem hiding this comment.
comparing to previous paragram, better to describe we are using int32 to store length of the long string
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7670/ |
|
retest this please |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7677/ |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7680/ |
|
Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6405/ |
|
Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7687/ |
|
Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6411/ |
|
retest sdv please |
|
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/6086/ |
|
LGTM |
Update document and add description for long string columns
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
Any interfaces changed?
Any backward compatibility impacted?
Document update required?
Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance test report.
- Any additional information to help reviewers in testing this change.
For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.