diff --git a/README.md b/README.md index c475a0c2..c8d0d0a6 100644 --- a/README.md +++ b/README.md @@ -34,37 +34,37 @@ com.aliyun.emr emr-maxcompute_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-logservice_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-tablestore - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-ons_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-mns_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-core - 1.6.0-SNAPSHOT + 1.6.0 ``` diff --git a/docs/HadoopMR-on-TableStore.md b/docs/HadoopMR-on-TableStore.md index 16ba7667..f9b6a311 100644 --- a/docs/HadoopMR-on-TableStore.md +++ b/docs/HadoopMR-on-TableStore.md @@ -111,7 +111,7 @@ OK, let the program run. ``` $ rm -rf out -$ HADOOP_CLASSPATH=emr-tablestore-1.6.0-SNAPSHOT.jar:tablestore-4.1.0-jar-with-dependencies.jar::joda-time-2.9.4.jar:YourRowCounter.jar bin/hadoop YourRowCounterClass +$ HADOOP_CLASSPATH=emr-tablestore-1.6.0.jar:tablestore-4.1.0-jar-with-dependencies.jar::joda-time-2.9.4.jar:YourRowCounter.jar bin/hadoop YourRowCounterClass ... $ find out -type f out/_SUCCESS @@ -122,7 +122,7 @@ $ cat out/part-r-00000 TOTAL 9 ``` -FYI, in emr-examples_2.11-1.6.0-SNAPSHOT.jar, we provides an executable row-counting program, `com.aliyun.openservices.tablestore.hadoop.RowCounter`. +FYI, in emr-examples_2.11-1.6.0.jar, we provides an executable row-counting program, `com.aliyun.openservices.tablestore.hadoop.RowCounter`. ## TableStore as Data Sink diff --git a/docs/Hive-SparkSQL-on-TableStore.md b/docs/Hive-SparkSQL-on-TableStore.md index 19d8baea..263aac05 100644 --- a/docs/Hive-SparkSQL-on-TableStore.md +++ b/docs/Hive-SparkSQL-on-TableStore.md @@ -5,13 +5,13 @@ ### Hive CLI ``` -$ HADOOP_HOME=YourHadoopDir HADOOP_CLASSPATH=emr-tablestore-1.6.0-SNAPSHOT.jar:tablestore-4.1.0-jar-with-dependencies.jar:joda-time-2.9.4.jar bin/hive +$ HADOOP_HOME=YourHadoopDir HADOOP_CLASSPATH=emr-tablestore-1.6.0.jar:tablestore-4.1.0-jar-with-dependencies.jar:joda-time-2.9.4.jar bin/hive ``` ### SparkSQL CLI ``` -$ bin/spark-sql --master local --jars emr-tablestore-1.6.0-SNAPSHOT.jar,tablestore-4.1.0-jar-with-dependencies.jar +$ bin/spark-sql --master local --jars emr-tablestore-1.6.0.jar,tablestore-4.1.0-jar-with-dependencies.jar ``` diff --git a/docs/Spark-on-TableStore.md b/docs/Spark-on-TableStore.md index bd9d5b6a..4d61db71 100644 --- a/docs/Spark-on-TableStore.md +++ b/docs/Spark-on-TableStore.md @@ -72,10 +72,10 @@ If you prefer to scala, please replace `JavaSparkContext` to `SparkContext` and Let it run. ``` -$ bin/spark-submit --master local --jars emr-tablestore-1.6.0-SNAPSHOT.jar,tablestore-4.1.0-jar-with-dependencies.jar YourRowCounter.jar +$ bin/spark-submit --master local --jars emr-tablestore-1.6.0.jar,tablestore-4.1.0-jar-with-dependencies.jar YourRowCounter.jar TOTAL: 9 ``` FYI, * for more details about `TableStoreInputFormat`, please refer to (HadoopMR-on-TableStore.md). -* in emr-examples_2.11-1.6.0-SNAPSHOT.jar, we provides an executable row-counting program, `com.aliyun.openservices.tablestore.spark.RowCounter`. +* in emr-examples_2.11-1.6.0.jar, we provides an executable row-counting program, `com.aliyun.openservices.tablestore.spark.RowCounter`. diff --git a/docs/how_to_run_spark_with_python_sdk.md b/docs/how_to_run_spark_with_python_sdk.md index 1ffbe577..14b696ea 100644 --- a/docs/how_to_run_spark_with_python_sdk.md +++ b/docs/how_to_run_spark_with_python_sdk.md @@ -26,13 +26,13 @@ Bellow document will show you how to use Loghub (ODPS, ONS, MNS and so on) in py ## LogService 1. download the [**loghub.py**](https://github.com/aliyun/aliyun-emapreduce-sdk/blob/master-2.x/external/emr-logservice/src/main/python/pyspark/streaming/loghub.py); -2. download the pre-build [**emr-logservice_2.11-1.6.0-SNAPSHOT.jar**](http://central.maven.org/maven2/com/aliyun/emr/emr-logservice_2.11/1.6.0-SNAPSHOT/emr-logservice_2.11-1.6.0-SNAPSHOT.jar); +2. download the pre-build [**emr-logservice_2.11-1.6.0.jar**](http://central.maven.org/maven2/com/aliyun/emr/emr-logservice_2.11/1.6.0/emr-logservice_2.11-1.6.0.jar); 3. download loghub's dependencies, i.e. [**fastjson-1.2.45.jar**](http://central.maven.org/maven2/com/alibaba/fastjson/1.2.45/fastjson-1.2.45.jar), [**commons-validator-1.4.0.jar**](http://central.maven.org/maven2/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar), [**loghub-client-lib-0.6.13.jar**](http://central.maven.org/maven2/com/aliyun/openservices/loghub-client-lib/0.6.13/loghub-client-lib-0.6.13.jar), [**aliyun-log-0.6.11.jar**](http://central.maven.org/maven2/com/aliyun/openservices/aliyun-log/0.6.11/aliyun-log-0.6.11.jar), [**json-lib-2.4-jdk15.jar**](http://central.maven.org/maven2/net/sf/json-lib/json-lib/2.4/json-lib-2.4-jdk15.jar). Above-mentioned library version pass test; 4. download [**loghub-wordcount.py**](https://github.com/aliyun/aliyun-emapreduce-sdk/blob/master-2.x/examples/src/main/python/streaming/loghub-wordcount.py); 5. run the example, use ``` spark-submit --master local[4] --jars fastjson-1.2.45.jar,commons-validator-1.4.0.jar, -emr-logservice_2.11-1.6.0-SNAPSHOT.jar,loghub-client-lib-0.6.13.jar,aliyun-log-0.6.11.jar,json-lib-2.4-jdk15.jar +emr-logservice_2.11-1.6.0.jar,loghub-client-lib-0.6.13.jar,aliyun-log-0.6.11.jar,json-lib-2.4-jdk15.jar --py-files loghub.py loghub-wordcount.py ``` @@ -40,12 +40,12 @@ emr-logservice_2.11-1.6.0-SNAPSHOT.jar,loghub-client-lib-0.6.13.jar,aliyun-log-0 ## ODPS 1. download the [**odps.py**](https://github.com/aliyun/aliyun-emapreduce-sdk/blob/master-2.x/external/emr-maxcompute/src/main/python/pyspark/odps.py); -2. download the pre-build [**emr-maxcompute_2.11-1.6.0-SNAPSHOT.jar**](http://central.maven.org/maven2/com/aliyun/emr/emr-maxcompute_2.11/1.6.0-SNAPSHOT/emr-maxcompute_2.10-1.6.0-SNAPSHOT.jar); +2. download the pre-build [**emr-maxcompute_2.11-1.6.0.jar**](http://central.maven.org/maven2/com/aliyun/emr/emr-maxcompute_2.11/1.6.0/emr-maxcompute_2.10-1.6.0.jar); 3. download odps's dependencies, i.e. [**fastjson-1.2.23.jar**](http://mvnrepository.com/artifact/com.alibaba/fastjson/1.2.23), [**aspectjrt-1.8.2.jar**](http://mvnrepository.com/artifact/org.aspectj/aspectjrt/1.8.2), [**odps-sdk-commons-0.27.2-public.jar**](http://mvnrepository.com/artifact/com.aliyun.odps/odps-sdk-commons/0.27.2-public), [**odps-sdk-core-0.27.2-public.jar**](http://mvnrepository.com/artifact/com.aliyun.odps/odps-sdk-core/0.27.2-public). Above-mentioned library version pass test; 4. download [**odps-sample.py**](https://github.com/aliyun/aliyun-emapreduce-sdk/blob/master/examples/src/main/python/odps-sample.py); 5. run the example, use ``` - spark-submit --master local[4] --jars fastjson-1.2.23.jar,aspectjrt-1.8.2.jar,emr-maxcompute_2.11-1.6.0-SNAPSHOT.jar, + spark-submit --master local[4] --jars fastjson-1.2.23.jar,aspectjrt-1.8.2.jar,emr-maxcompute_2.11-1.6.0.jar, odps-sdk-commons-0.27.2-public.jar,odps-sdk-core-0.27.2-public.jar --py-files odps.py odps-sample.py ``` diff --git a/docs/manual.md b/docs/manual.md index efa04268..7703b812 100644 --- a/docs/manual.md +++ b/docs/manual.md @@ -31,37 +31,37 @@ com.aliyun.emr emr-maxcompute_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-logservice_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-tablestore - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-ons_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-mns_2.11 - 1.6.0-SNAPSHOT + 1.6.0 com.aliyun.emr emr-core - 1.6.0-SNAPSHOT + 1.6.0 ``` diff --git a/emr-baseline-testing/pom.xml b/emr-baseline-testing/pom.xml index dc582ab6..4c93f5a7 100644 --- a/emr-baseline-testing/pom.xml +++ b/emr-baseline-testing/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 4.0.0 diff --git a/emr-datahub/pom.xml b/emr-datahub/pom.xml index cd700155..ab8e2d15 100644 --- a/emr-datahub/pom.xml +++ b/emr-datahub/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-dts/pom.xml b/emr-dts/pom.xml index 62d2d8d5..fd863a57 100644 --- a/emr-dts/pom.xml +++ b/emr-dts/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-kafka/pom.xml b/emr-kafka/pom.xml index ca34f7ce..ea076cb8 100644 --- a/emr-kafka/pom.xml +++ b/emr-kafka/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-logservice/pom.xml b/emr-logservice/pom.xml index d50cf447..91c8f106 100644 --- a/emr-logservice/pom.xml +++ b/emr-logservice/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-logservice/src/main/python/pyspark/streaming/loghub.py b/emr-logservice/src/main/python/pyspark/streaming/loghub.py index e620a02c..9dd2344e 100644 --- a/emr-logservice/src/main/python/pyspark/streaming/loghub.py +++ b/emr-logservice/src/main/python/pyspark/streaming/loghub.py @@ -193,4 +193,4 @@ def _printErrorMsg(): ________________________________________________________________________________________________ -""" % ('1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT')) +""" % ('1.6.0', '1.6.0', '1.6.0')) diff --git a/emr-maxcompute/pom.xml b/emr-maxcompute/pom.xml index 572d7a11..10364f3c 100644 --- a/emr-maxcompute/pom.xml +++ b/emr-maxcompute/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-maxcompute/src/main/python/pyspark/odps.py b/emr-maxcompute/src/main/python/pyspark/odps.py index ddcf1ec1..466bd6f1 100644 --- a/emr-maxcompute/src/main/python/pyspark/odps.py +++ b/emr-maxcompute/src/main/python/pyspark/odps.py @@ -141,4 +141,4 @@ def _printErrorMsg(): ________________________________________________________________________________________________ -""" % ('1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT')) +""" % ('1.6.0', '1.6.0', '1.6.0')) diff --git a/emr-mns/pom.xml b/emr-mns/pom.xml index 139d2867..e16802ae 100644 --- a/emr-mns/pom.xml +++ b/emr-mns/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-mns/src/main/python/pyspark/streaming/mns.py b/emr-mns/src/main/python/pyspark/streaming/mns.py index 885d14e5..ff61db57 100644 --- a/emr-mns/src/main/python/pyspark/streaming/mns.py +++ b/emr-mns/src/main/python/pyspark/streaming/mns.py @@ -96,4 +96,4 @@ def _printErrorMsg(): ________________________________________________________________________________________________ -""" % ('1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT')) +""" % ('1.6.0', '1.6.0', '1.6.0')) diff --git a/emr-ons/pom.xml b/emr-ons/pom.xml index b6c54a5d..54e8af03 100644 --- a/emr-ons/pom.xml +++ b/emr-ons/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-ons/src/main/python/pyspark/streaming/ons.py b/emr-ons/src/main/python/pyspark/streaming/ons.py index 7b2d5633..b0d853f6 100644 --- a/emr-ons/src/main/python/pyspark/streaming/ons.py +++ b/emr-ons/src/main/python/pyspark/streaming/ons.py @@ -73,4 +73,4 @@ def _printErrorMsg(): ________________________________________________________________________________________________ -""" % ('1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT', '1.6.0-SNAPSHOT')) +""" % ('1.6.0', '1.6.0', '1.6.0')) diff --git a/emr-oss/pom.xml b/emr-oss/pom.xml index a594af23..5f91937e 100644 --- a/emr-oss/pom.xml +++ b/emr-oss/pom.xml @@ -5,7 +5,7 @@ com.aliyun.emr emr_2.11 - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/emr-tablestore/pom.xml b/emr-tablestore/pom.xml index 1b197304..0bffd1a3 100644 --- a/emr-tablestore/pom.xml +++ b/emr-tablestore/pom.xml @@ -5,7 +5,7 @@ emr_2.11 com.aliyun.emr - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml 4.0.0 diff --git a/examples/pom.xml b/examples/pom.xml index b869703f..a26f3fc8 100644 --- a/examples/pom.xml +++ b/examples/pom.xml @@ -5,7 +5,7 @@ com.aliyun.emr emr_2.11 - 1.6.0-SNAPSHOT + 1.6.0 ../pom.xml diff --git a/pom.xml b/pom.xml index b784f0a6..b9e12e33 100644 --- a/pom.xml +++ b/pom.xml @@ -4,7 +4,7 @@ com.aliyun.emr emr_2.11 - 1.6.0-SNAPSHOT + 1.6.0 pom Aliyun E-MapReduce Root