Skip to content

Hadoop CLASSPATH

javapark edited this page Oct 10, 2022 · 7 revisions

◀️ KryoSerializer Generator 🔗 Kafka CLASSPATH ▶️ 🔗 Home ▶️


The Hadoop class path is defined in the following order:

$CLASSPATH
$PADOGRID_WORKSPACE/clusters/<cluster>/plugins/*
$PADOGRID_WORKSPACE/clusters/<cluster>/lib/*
$PADOGRID_WORKSPACE/plugins/*
$PADOGRID_WORKSPACE/lib/*
$PADOGRID_HOME/hadoop/plugins/*
$PADOGRID_HOME/hadoop/lib/*
$PADOGRID_HOME/lib/*
$HADOOP_HOME/lib/native/*
$HADOOP_HOME/share/hadoop/common/*
$HADOOP_HOME/share/hadoop/common/lib/*
$HADOOP_HOME/share/hadoop/mapreduce/*
$HADOOP_HOME/share/hadoop/client/*
$HADOOP_HOME/share/hadoop/tools/lib/*

To see data node startup details, run the start_datanode -simulate command, which does not run the worker but simulates the startup sequence that includes displaying the order of CLASSPATH, Java options, and arguments.

start_datanode -simulate

Note that CLASSPATH and JAVA_OPTS can be set in setenv.sh at each directory level to include additional paths or override any paths set in the subsequent directory levels. The setenv.sh files are located as follows:

$PADOGRID_WORKSPACE/clusters/$CLUSTER/bin_sh/setenv.sh
$PADOGRID_WORKSPACE/setenv.sh
$PADOGRID_HOME/bin_sh/setenv.sh

◀️ KryoSerializer Generator 🔗 Kafka CLASSPATH ▶️ 🔗 Home ▶️

Overview

Operations

Tools

Platforms

Clouds

Pado

Geode/GemFire

Hazelcast/Jet

ComputeDB/SnappyData

Coherence

Hadoop

Kafka/Confluent

Mosquitto

Redis

Spark

Clone this wiki locally