Skip to content
Branch: master
Find file Copy path
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
152 lines (103 sloc) 7.96 KB

... On Hadoop

Note: This topic is no longer being maintained. Refer to Hadoop Users for the most up-to-date documentation.

Currently supported versions:

  • CDH 5.4
  • CDH 5.5
  • CDH 5.6
  • CDH 5.7
  • CDH 5.8
  • CDH 5.10
  • CDH 5.13
  • CDH 5.14
  • HDP 2.2
  • HDP 2.3
  • HDP 2.4
  • HDP 2.5
  • HDP 2.6
  • MapR 4.0
  • MapR 5.0
  • MapR 5.1
  • MapR 5.2
  • IOP 4.2

Important Points to Remember:

  • The command used to launch H2O differs from previous versions (refer to the Tutorial section)
  • Launching H2O on Hadoop requires at least 6 GB of memory
  • Each H2O node runs as a mapper
  • Run only one mapper per host
  • There are no combiners or reducers
  • Each H2O cluster must have a unique job name
  • -mapperXmx, -nodes, and -output are required
  • Root permissions are not required - just unzip the H2O .zip file on any single node

Prerequisite: Open Communication Paths

H2O communicates using two communication paths. Verify these are open and available for use by H2O.

Path 1: mapper to driver

Optionally specify this port using the -driverport option in the hadoop jar command (see "Hadoop Launch Parameters" below). This port is opened on the driver host (the host where you entered the hadoop jar command). By default, this port is chosen randomly by the operating system.

Path 2: mapper to mapper

Optionally specify this port using the -baseport option in the hadoop jar command (refer to Hadoop Launch Parameters below. This port and the next subsequent port are opened on the mapper hosts (the Hadoop worker nodes) where the H2O mapper nodes are placed by the Resource Manager. By default, ports 54321 and 54322 are used.

The mapper port is adaptive: if 54321 and 54322 are not available, H2O will try 54323 and 54324 and so on. The mapper port is designed to be adaptive because sometimes if the YARN cluster is low on resources, YARN will place two H2O mappers for the same H2O cluster request on the same physical host. For this reason, we recommend opening a range of more than two ports (20 ports should be sufficient).


The following tutorial will walk the user through the download or build of H2O and the parameters involved in launching H2O from the command line.

  1. Download the latest H2O release for your version of Hadoop. Refer to the H2O on Hadoop Download page.

  2. Prepare the job input on the Hadoop Node by unzipping the build file and changing to the directory with the Hadoop and H2O's driver jar files.

     unzip h2o-{{project_version}}-*.zip
     cd h2o-{{project_version}}-*
  3. To launch H2O nodes and form a cluster on the Hadoop cluster, run:

     hadoop jar h2odriver.jar -nodes 1 -mapperXmx 6g -output hdfsOutputDirName

    The above command launches a 6g node of H2O. We recommend you launch the cluster with at least four times the memory of your data file size.

    • mapperXmx is the mapper size or the amount of memory allocated to each node. Specify at least 6 GB.

    • nodes is the number of nodes requested to form the cluster.

    • output is the name of the directory created each time a H2O cloud is created so it is necessary for the name to be unique each time it is launched.

  4. To monitor your job, direct your web browser to your standard job tracker Web UI. To access H2O's Web UI, direct your web browser to one of the launched instances. If you are unsure where your JVM is launched, review the output from your command after the nodes has clouded up and formed a cluster. Any of the nodes' IP addresses will work as there is no master node.

     Determining driver host interface for mapper->driver callback...
     [Possible callback IP address:]
     [Possible callback IP address:]
     Waiting for H2O cluster to come up...
     H2O node requested flatfile
     Sending flatfiles to nodes...
      [Sending flatfile to node]
     H2O node reports H2O cluster size 1
     H2O cluster (1 nodes) is up
     Blocking until the H2O cluster shuts down...

Hadoop Launch Parameters

  • -h | -help: Display help
  • -jobname <JobName>: Specify a job name for the Jobtracker to use; the default is H2O_nnnnn (where n is chosen randomly)
  • -driverif <IP address of mapper -> driver callback interface>: Specify the IP address for callback messages from the mapper to the driver.
  • -driverport <port of mapper -> callback interface>: Specify the port number for callback messages from the mapper to the driver.
  • -network <IPv4Network1>[,<IPv4Network2>]: Specify the IPv4 network(s) to bind to the H2O nodes; multiple networks can be specified to force H2O to use the specified host in the Hadoop cluster. allows 256 possibilities.
  • -timeout <seconds>: Specify the timeout duration (in seconds) to wait for the cluster to form before failing. Note: The default value is 120 seconds; if your cluster is very busy, this may not provide enough time for the nodes to launch. If H2O does not launch, try increasing this value (for example, -timeout 600).
  • -disown: Exit the driver after the cluster forms.
  • -notify <notification file name>: Specify a file to write when the cluster is up. The file contains the IP and port of the embedded web server for one of the nodes in the cluster. All mappers must start before the H2O cloud is considered "up".
  • -mapperXmx <per mapper Java Xmx heap size>: Specify the amount of memory to allocate to H2O (at least 6g).
  • -extramempercent <0-20>: Specify the extra memory for internal JVM use outside of the Java heap. This is a percentage of mapperXmx.
  • -n | -nodes <number of H2O nodes>: Specify the number of nodes.
  • -nthreads <maximum number of CPUs>: Specify the number of CPUs to use. Enter -1 to use all CPUs on the host, or enter a positive integer.
  • -baseport <initialization port for H2O nodes>: Specify the initialization port for the H2O nodes. The default is 54321.
  • -ea: Enable assertions to verify boolean expressions for error detection.
  • -verbose:gc: Include heap and garbage collection information in the logs.
  • -XX:+PrintGCDetails: Include a short message after each garbage collection.
  • -license <license file name>: Specify the directory of local filesytem location and the license file name.
  • -o | -output <HDFS output directory>: Specify the HDFS directory for the output.
  • -flow_dir <Saved Flows directory>: Specify the directory for saved flows. By default, H2O will try to find the HDFS home directory to use as the directory for flows. If the HDFS home directory is not found, flows cannot be saved unless a directory is specified using -flow_dir.

##Accessing S3 Data from Hadoop

H2O launched on Hadoop can access S3 Data in addition to to HDFS. To enable access, follow the instructions below.

Edit Hadoop's core-site.xml, then set the HADOOP_CONF_DIR environment property to the directory containing the core-site.xml file. For an example core-site.xml file, refer to Core-site.xml. Typically, the configuration directory for most Hadoop distributions is /etc/hadoop/conf.

You can also pass the S3 credentials when launching H2O with the Hadoop jar command. Use the -D flag to pass the credentials:

    hadoop jar h2odriver.jar -Dfs.s3.awsAccessKeyId="${AWS_ACCESS_KEY}" -Dfs.s3n.awsSecretAccessKey="${AWS_SECRET_KEY}" -n 3 -mapperXmx 10g  -output outputDirectory

where AWS_ACCESS_KEY represents your user name and AWS_SECRET_KEY represents your password.

Then import the data with the S3 URL path:

  • To import the data from the Flow API:

    importFiles [ "s3n:/path/to/bucket/file/" ]
  • To import the data from the R API:

    h2o.importFile(path = "s3n://bucket/path/to/file.csv")
  • To import the data from the Python API:

    h2o.import_frame(path = "s3n://bucket/path/to/file.csv")
You can’t perform that action at this time.