This is a package that contains the open source projects Apache Mesos, Marathon and Mesos-DNS and provides those services as a Cloudera Manager Parcel that can be deployed and run on a Cloudera Hadoop Cluster. The parcel takes care of the resource management and scheduling of different distributed applications which run in the same cluster. The applications are containerized with Docker.
We also provide ready-to-use Parcels for EL6 and Ubuntu 14.04 (Trusty), see the Alternative section.
- Build a Cloudera parcel containing Apache Mesos, Marathon and Mesos-DNS
- Build a Cloudera parcel containing Docker
#changelog v1.0 -> v1.1
##Docker Parcel
- '-g, --graph' flag can now be set through Cloudera Manager. This sets the path to use as the root of the Docker runtime.
- 'Registry ip and port' can now be set without URI validation warning.
##Mesos Parcel
- Renamed from MMC to MESOS.
###General
- More configuration options are now available on deployment.
- Tested on CDH 5.4.5
##Chronos
- Removed Chronos from the parcel, this can be run on Mesos via Marathon instead.
##Marathon
- Moved up to version 0.9 (in the pre-build parcels and tests).
##Mesos DNS
Mesos-DNS supports service discovery in Apache Mesos clusters.
- added Mesos DNS to the parcel.
- Zookeeper
- Cgroups
This part explains the steps to build Apache Mesos - Marathon - Mesos-DNS from source with CentOS 6.5.
You can skip this part if you want to use our pre-built versions and go to step 2.
- Create a new file called
wandisco-svn.repoin/etc/yum.repos.d/
cd /etc/yum.repos.d/
cat > wandisco-svn.repo
- Place the following content in your created file
wandisco-svn.repo
[WandiscoSVN]
name=Wandisco SVN Repo
baseurl=http://opensource.wandisco.com/centos/6/svn-1.8/RPMS/$basearch/
enabled=1
gpgcheck=0
- Install the dependent packages for the build. This is very important because all the libraries are necessary for a successful build.
sudo yum groupinstall -y "Development Tools"
sudo yum install -y python-devel java-1.7.0-openjdk-devel zlib-devel libcurl-devel openssl-devel cyrus-sasl-devel cyrus-sasl-md5 apr-devel subversion-devel apr-utils-devel
wget http://mirror.nexcess.net/apache/maven/maven-3/3.0.5/binaries/apache-maven-3.0.5-bin.tar.gz
sudo tar -zxf apache-maven-3.0.5-bin.tar.gz -C /opt/
sudo ln -s /opt/apache-maven-3.0.5/bin/mvn /usr/bin/mvn
# Because we are building from the Git repository, we will also need the following packages
sudo yum install autoconf
sudo yum install libtool
#####1.1.2 Build Mesos
- We used mesos version 0.22.0
# download mesos-0.22.0 tarball
wget http://archive.apache.org/dist/mesos/0.22.0/mesos-0.22.0.tar.gz
# extract tarball
tar xvf mesos-0.22.0.tar.gz
# Change the working directory to `mesos`
cd mesos-0.22.0
# configure and build
mkdir build
cd build
../configure --enable-static --prefix=/usr/lib/mesos
make
# put the installation folders in the prefix directory
make install
# run test (optional)
make check
# add all depending libraries to the lib folder
# can differ from system to system
# use the command ldd /usr/lib/mesos/lib/libmesos.so
# copy all the libraries to the lib folder
cp /usr/lib64/libsasl2.so.2 /usr/lib/mesos/lib/
cp /usr/lib64/libsvn_delta-1.so.0 /usr/lib/mesos/lib/
cp /usr/lib64/libsvn_subr-1.so.0 /usr/lib/mesos/lib/
cp /usr/lib64/libaprutil-1.so.0 /usr/lib/mesos/lib/
cp /lib64/libcrypt.so.1 /usr/lib/mesos/lib/
cp /lib64/libdb-4.7.so /usr/lib/mesos/lib/
cp /lib64/libexpat.so.1 /usr/lib/mesos/lib/
cp /lib64/libdl.so.2 /usr/lib/mesos/lib/
cp /usr/lib64/libapr-1.so.0 /usr/lib/mesos/lib/
cp /lib64/libpthread.so.0 /usr/lib/mesos/lib/
cp /usr/lib64/libcurl.so.4 /usr/lib/mesos/lib/
cp /lib64/libz.so.1 /usr/lib/mesos/lib/
cp /lib64/librt.so.1 /usr/lib/mesos/lib/
cp /usr/lib64/libstdc++.so.6 /usr/lib/mesos/lib/
cp /lib64/libm.so.6 /usr/lib/mesos/lib/
cp /lib64/libc.so.6 /usr/lib/mesos/lib/
cp /lib64/libgcc_s.so.1 /usr/lib/mesos/lib/
cp /lib64/libresolv.so.2 /usr/lib/mesos/lib/
cp /lib64/libuuid.so.1 /usr/lib/mesos/lib/
cp /lib64/libfreebl3.so /usr/lib/mesos/lib/
cp /lib64/libidn.so.11 /usr/lib/mesos/lib/
cp /lib64/libldap-2.4.so.2 /usr/lib/mesos/lib/
cp /lib64/libgssapi_krb5.so.2 /usr/lib/mesos/lib/
cp /lib64/libkrb5.so.3 /usr/lib/mesos/lib/
cp /lib64/libk5crypto.so.3 /usr/lib/mesos/lib/
cp /lib64/libcom_err.so.2 /usr/lib/mesos/lib/
cp /usr/lib64/libssl3.so /usr/lib/mesos/lib/
cp /usr/lib64/libsmime3.so /usr/lib/mesos/lib/
cp /usr/lib64/libnss3.so /usr/lib/mesos/lib/
cp /usr/lib64/libnssutil3.so /usr/lib/mesos/lib/
cp /lib64/libplds4.so /usr/lib/mesos/lib/
cp /lib64/libplc4.so /usr/lib/mesos/lib/
cp /lib64/libnspr4.so /usr/lib/mesos/lib/
cp /usr/lib64/libssh2.so.1 /usr/lib/mesos/lib/
cp /lib64/liblber-2.4.so.2 /usr/lib/mesos/lib/
cp /lib64/libkrb5support.so.0 /usr/lib/mesos/lib/
cp /lib64/libkeyutils.so.1 /usr/lib/mesos/lib/
cp /usr/lib64/libssl.so.10 /usr/lib/mesos/lib/
cp /usr/lib64/libcrypto.so.10 /usr/lib/mesos/lib/
For the full documentation on Apache Mesos please refer to this link.
####1.2 Marathon
# get repo
curl https://bintray.com/sbt/rpm/rpm | sudo tee /etc/yum.repos.d/bintray-sbt-rpm.repo
# install sbt
sudo yum install sbt
# download marathon-0.9 tarball
# marathon version 0.9 was used for this project
wget http://downloads.mesosphere.com/marathon/v0.9.0/marathon-0.9.0.tgz
# extract the tar file
tar xvf marathon-0.9.0.tgz
# change the working directory
cd marathon-0.9.0
# build
sbt assembly
For the full documentation on Marathon please refer to this link.
####1.3 Mesos-DNS
To build Mesos-DNS, you need to install go and godep on your machine. You must set the GOPATH environment variable to point to the directory where outside go packages will be installed. You must also add $GOPATH/bin to the PATH environment variable. If you install go to a custom location, you may need to set the GOROOT environment properly and add $GOROOT/bin to the PATH environment variable. For instance, you may need to do the following:
export GOPATH=$HOME/go
export PATH=$PATH:$GOPATH/bin
export GOROOT=/usr/local/go # assuming go is installed at /usr/local/go
export PATH=$PATH:$GOROOT/bin
To build Mesos-DNS using godep:
go get github.com/mesosphere/mesos-dns
cd $GOPATH/src/github.com/mesosphere/mesos-dns
make all
For more info on Mesos-DNS and the build process, refer to the Mesos-DNS docs
In this part we are going to package a parcel containing Apache Mesos - Marathon - Mesos-DNS.
####2.1 pull and create parcel directory
# clone repository from Git.
git clone https://github.com/BigIndustries/cm_mesos_ext.git
# change directory
cd cm_mesos_ext/MMC_PARCEL-1.1
# create the folders for the build files from step 1 in `mesos-integration/MMC_PARCEL-1.1/`
mkdir fat_mesos
cd fat_mesos
mkdir mesos
mkdir mesos-dns
mkdir marathon
#create an extra work dir
mkdir work_dir
The directory `MMC_PARCEL-1.1` should now have a folder `fat_mesos` with 3 subfolders `mesos`, `marathon`, `mesos-dns` and `work_dir`.
MMC_PARCEL-1.1
└── fat_mesos
├── mesos
├── marathon
└── mesos-dns
Please place the built files from step 1 in the corresponding folders.
To package the parcels correctly Python 2.7 and Maven must be installed. To know how to install Python 2.7 on CentOS 6.5 refer to this link.
Make sure you are in the mesos-integration/MMC_PARCEL-1.1/ directory.
# package with Maven
mvn package
You will find the result of the packaging in the MMC_PARCEL-1.1/target directory. The files needed are:
- manifest.json
- MESOS-1.1-el6.parcel
- MESOS-1.1.jar
To package the parcels correctly Python 2.7 and Maven must be installed. To know how to install Python 2.7 on CentOS 6.5 refer to this link.
Make sure you are in the mesos-integration/DOCKER_PARCEL-1.1/ directory.
# package with Maven
mvn package
You will find the result of the packaging in the DOCKER_PARCEL-1.1/target directory. The files needed are:
- manifest.json
- DOCKER-1.1-el6.parcel
- DOCKER-1.1.jar
Cloudera allows for third party parcels to be added to Cloudera Manager. More information on parcels can be found here.
We will make our parcels available to Cloudera Manager by adding our .parcel and .manifest file to a web host. (i.e. Apache). Provide the URL to the parcels to Cloudera Manager and the parcels will show up in the list.
Download, distribute and activate the parcels we just made available.
Now, one last step remains.
The <PARCEL>-<VERSION>.jar file in the target directory of the parcels we've just build, contains the Service Descriptor (csd). This allows for services to be added to Cloudera Manager.
These jar file(s) need to be added to the CSD directory on the CM host machine. By default, this directory is located at /opt/cloudera/csd.
For CM to pick up these files, the Cloudera Manager service needs to be restarted.
sudo service cloudera-scm-server restart
Now you will be able to add the services to your cluster, just like you would I.e. HDFS, Hive, ...
- In Cloudera Manager, point the parcel URL to http://bigindustries.be/parcels/
- Download - distrubute and activate the parcel
- Download the Docker CSD file
- Download the Mesos CSD file
These jar file(s) need to be added to the CSD directory on the CM host machine. By default this directory is located at /opt/cloudera/csd.
For CM to pick up these files, the Cloudera Manager service needs to be restarted.
sudo service cloudera-scm-server restart