update doc

jetoile · Oct 31, 2019 · 3a1287a · 3a1287a
1 parent e88a2c5
commit 3a1287a
Show file tree

Hide file tree

Showing 5 changed files with 57 additions and 16 deletions.
diff --git a/hadoop-unit-site/src/site/markdown/cli.md b/hadoop-unit-site/src/site/markdown/cli.md
@@ -2,6 +2,7 @@
 
 Hadoop-unit can be used with common tools such as:
 
+* [zookeeper command](#zk-command)
 * [hdfs command](#hdfs-command)
 * [kafka-console command](#kafka-console-command)
 * [ksql-console command](#ksql-command)
@@ -12,6 +13,18 @@ Hadoop-unit can be used with common tools such as:
 * [alluxio shell](#alluxio-shell)
 * [pulsar shell](#pulsar-shell)
 
+<div id="zk-command"/>
+# Zookeeper command
+
+* Download and unzip zookeeper
+* From directory `ZK_HOME/bin`, execute command:
+
+```bash
+./zkCli.sh -server localhost:22010
+```
+
+
+
 <div id="hdfs-command"/>
 # HDFS command
 

diff --git a/hadoop-unit-site/src/site/markdown/focus.md b/hadoop-unit-site/src/site/markdown/focus.md
@@ -4,15 +4,9 @@
 * [Focus on Redis](#focus-on-redis)
 * [Focus on Oozie](#focus-on-oozie)
 * [Focus on Hive 3](#focus-on-hive3)
+* [Focus on Hadodp 3](#focus-on-hadoop3)
+* [Focus on Pulsar](#focus-on-pulsar)
 
-<div id="focus-on-hive3"/>
-# Focus on Hive3
-
-Because Hive 3 is doing in the class `HiveMaterializedViewsRegistry` in the method `init()` a call to `HiveConf conf = new HiveConf();`, the properties are lost.
-
-This is why a `hive-site.xml` has to be found in the classpath where the property `hive.metastore.uris` has to be set with the hivemetastore's thrift url.
-
-Without this property, Hiveserver2 try to start an embedded hivemetastore which create a conflit with the hivemetastore's derby.  
 
 <div id="focus-on-elasticsearch"/>
 # Focus on ElasticSearch
@@ -46,4 +40,27 @@ To know which version of Redis has to be downloaded, the variable ```redis.versi
 To use oozie, you need:
 
 * to download the [oozie's share libs](http://s3.amazonaws.com/public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.5.0/tars/oozie/oozie-4.2.0.2.6.5.0-292-distro.tar.gz)
-* to edit the configuration file ```conf/hadoop-unit-default.properties``` and to set the variable ```oozie.sharelib.path``` to where you downloaded the oozie's share libs
+* to edit the configuration file ```conf/hadoop-unit-default.properties``` and to set the variable ```oozie.sharelib.path``` to where you downloaded the oozie's share libs
+
+<div id="focus-on-hive3"/>
+# Focus on Hive3
+
+Because Hive 3 is doing in the class `HiveMaterializedViewsRegistry` in the method `init()` a call to `HiveConf conf = new HiveConf();`, the properties are lost.
+
+This is why a `hive-site.xml` has to be found in the classpath where the property `hive.metastore.uris` has to be set with the hivemetastore's thrift url.
+
+Without this property, Hiveserver2 try to start an embedded hivemetastore which create a conflit with the hivemetastore's derby.  
+
+<div id="focus-on-hadoop3"/>
+# Focus on Hadoop 3
+
+The maven's __Simple dependency Usage__ does not work with Hadoop 3 (hdfs, hive, yarn).
+
+The maven's __integration plugin in mode embedded__ or the standalone mode are recommended.
+
+<div id="focus-on-pulsar"/>
+# Focus on Pulsar
+
+The maven's __Simple dependency Usage__ does not work with Pulsar.
+
+The maven's __integration plugin in mode embedded__ or the standalone mode are recommended.
diff --git a/hadoop-unit-site/src/site/markdown/index.md b/hadoop-unit-site/src/site/markdown/index.md
@@ -2,7 +2,7 @@ Welcome to the Hadoop Unit wiki!
 
 ```bash
    ______  __      _________                         _____  __      __________
-   ___  / / /_____ ______  /___________________      __  / / /_________(_)_  /_ 3.3
+   ___  / / /_____ ______  /___________________      __  / / /_________(_)_  /_ 3.6
    __  /_/ /_  __ `/  __  /_  __ \  __ \__  __ \     _  / / /__  __ \_  /_  __/
    _  __  / / /_/ // /_/ / / /_/ / /_/ /_  /_/ /     / /_/ / _  / / /  / / /_
    /_/ /_/  \__,_/ \__,_/  \____/\____/_  .___/      \____/  /_/ /_//_/  \__/
@@ -29,7 +29,10 @@ Welcome to the Hadoop Unit wiki!
 		 port:8983
 		 collection:collection1
 - CASSANDRA
-		 ip:127.0.0.1
+		 listenAddressIp:127.0.0.1
+		 rpcAddressIp:0.0.0.0
+		 broadcastAddressIp:127.0.0.1
+		 broadcastRpcAddressIp:127.0.0.1
 		 port:13433
 - ELASTICSEARCH
 		 clusterName:elasticsearch
@@ -58,10 +61,17 @@ Welcome to the Hadoop Unit wiki!
 		 labels:{MAGIC_NUMBER=42}
 		 command:[/bin/sh, -c, while true; do echo "$MAGIC_NUMBER" | nc -l -p 80; done]
 		 classpathResourceMappings:{}
+- BOOKKEEPER 
+		 ip:0.0.0.0
+		 port:31810
+		 http port:31900
 - PULSAR 
-         ip:127.0.0.1
-         port:22022
-         zookeeper port:22020		 
+		 name:pulsar-cluster-1
+		 ip:0.0.0.0
+		 port:22022
+		 httpPort:22023
+		 zookeeper port:22010
+	 
 ...
 ```
 

diff --git a/hadoop-unit-site/src/site/markdown/install-hadoop-unit-standalone.md b/hadoop-unit-site/src/site/markdown/install-hadoop-unit-standalone.md
@@ -1,7 +1,7 @@
 # Install Hadoop Unit Standalone
 
 * Download it on [search.maven.org - v2](http://search.maven.org/remotecontent?filepath=fr/jetoile/hadoop/hadoop-unit-standalone/2.10.1/hadoop-unit-standalone-2.10.1.tar.gz)
-* Download it on [search.maven.org - v3](http://search.maven.org/remotecontent?filepath=fr/jetoile/hadoop/hadoop-unit-standalone/3.5/hadoop-unit-standalone-3.5.tar.gz)
+* Download it on [search.maven.org - v3](http://search.maven.org/remotecontent?filepath=fr/jetoile/hadoop/hadoop-unit-standalone/3.5/hadoop-unit-standalone-3.6.tar.gz)
 * Unzip it
 * Edit file:
   * ```conf/hadoop.properties``` to activate the components you want

diff --git a/hadoop-unit-site/src/site/markdown/what-is-hadoop-unit.md b/hadoop-unit-site/src/site/markdown/what-is-hadoop-unit.md
@@ -79,7 +79,8 @@ The available components are:
 * NEO4J
 * KNOX
 * ALLUXIO
-* PULSAR
 * BOOKKEEPER
+* PULSAR
+* PULSAR_STANDALONE
 * REDIS (for linux and macOS only)