title | weight |
---|---|
Prerequisites |
100 |
To send messages from {{% param "product.abbrev" %}} to HDFS, complete the following steps.
-
{{< include-headless "chunk/para-java-requirements.md" >}}
-
Download the Hadoop Distributed File System (HDFS) libraries (version 2.x) from http://hadoop.apache.org/releases.html.
-
Extract the HDFS libraries into a temporary directory, then collect the various
.jar
files into a single directory (for example,/opt/hadoop/lib/
) where {{% param "product.abbrev" %}} can access them. You must specify this directory in the {{% param "product.abbrev" %}} configuration file. The files are located in the variouslib
directories under theshare/
directory of the Hadoop release package. (For example, in Hadoop 2.7, required files arecommon/hadoop-common-2.7.0.jar
,common/libs/\*.jar
,hdfs/hadoop-hdfs-2.7.0.jar
,hdfs/lib/\*
, but this may change between Hadoop releases, so it is easier to copy every.jar
file into a single directory.