Skip to content

XuQianJin-Stars/alicloud-hbase-spark-examples

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

alicloud-hbase-spark-examples

1、在examples/conf/hbase-site.xml中配置alihbase的zkurl

2、下载alihbase以及aliphoenix的客户端,里面包含spark分析hbase数据时需要的jar包

3、eg:

a、spark-submit --class org.apache.spark.hbase.NativeRDDAnalyze --master yarn-client --jars shc-core-1.1.0-2.1-s_2.11.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-common-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-server-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-client-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-protocol-1.1.1.jar shc-examples-1.1.0-2.1-s_2.11.jar

b、spark-submit --class org.apache.spark.sql.execution.datasources.hbase.SqlAnalyze --master yarn-client --jars shc-core-1.1.0-2.1-s_2.11.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-common-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-server-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-client-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-protocol-1.1.1.jar shc-examples-1.1.0-2.1-s_2.11.jar

c、spark-submit --class org.apache.spark.phoenix.connector.PhoenixTest --master yarn-client --jars shc-core-1.1.0-2.1-s_2.11.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-common-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-server-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-client-1.1.1.jar,/home/hadoop/muyuan/alihbase-1.1.1/lib/alihbase-protocol-1.1.1.jar,/home/hadoop/muyuan/phoenix-4.11.0-AliHBase-1.1-0.3/phoenix-4.11.0-AliHBase-1.1-0.3-server.jar,/home/hadoop/muyuan/phoenix-4.11.0-AliHBase-1.1-0.3/phoenix-spark-4.11.0-HBase-1.1.jar shc-examples-1.1.0-2.1-s_2.11.jar

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 96.6%
  • Java 3.4%