No description or website provided.
Switch branches/tags
Nothing to show
Clone or download
Permalink
Failed to load latest commit information.
ansible setup zabbix successfully Feb 8, 2017
spark-app-skeleton init Jan 31, 2017
.gitignore update .gitignore Feb 2, 2017
README.md init Jan 31, 2017
Vagrantfile update zabbix config Feb 2, 2017

README.md

get start

  1. download vagrant box: https://pan.baidu.com/s/1c1SAXTQ
  2. vagrant box add u16 /path/you_downloaded_box
  3. vagrant up
  4. download hbase, hadoop, spark
  5. download hadoop-native-64-2.6.0.tar to ./ansible/roles/spark2/files
  6. run ansible-playbook ./ansible/playbook.yml -i ./ansible/inventory -u vagrant -k password is vagrant

download jdk8: https://pan.baidu.com/s/1bpxfpvD

download hbase: https://pan.baidu.com/s/1slhdGhZ

download hadoop: https://pan.baidu.com/s/1dFkjWch

download spark: https://pan.baidu.com/s/1dE6ows5

checking

hdfs: http://192.168.11.151:50070/dfshealth.html#tab-datanode

spark: http://192.168.11.152:8080/

hbase: http://192.168.11.153:16010/master-status

deploy spark hbase example

  • word count example

    1. chmod +x ./ansible/deploy-wordcount.sh
    2. run ./ansible/deploy-wordcount.sh
  • the example for Spark integrate with Hbase

    1. chmod +x ./ansible/deploy-hbase-example.sh
    2. run ./ansible/deploy-hbase-example.sh