A Hadoop image on Ubuntu
Shell
Pull request Compare This branch is 23 commits ahead of sequenceiq:master.
Latest commit 2f05a05 Jul 27, 2015 @thehajime thehajime add gnuplot
Permalink
Failed to load latest commit information.
extlibs matatabi-hive-init.sh add Apr 16, 2015
Dockerfile add gnuplot Jul 27, 2015
LICENSE ubutnu 2.5.0 base image first commit Sep 15, 2014
NECOMAtter-install.sh add malc0de, TwitterStreamingWatcher, TwitterSearchLogger. Install NE… Apr 21, 2015
README.md add tag information during build Apr 17, 2015
bash.bashrc add envs for abush.ch scripts Jul 9, 2015
bootstrap.sh add malc0de, TwitterStreamingWatcher, TwitterSearchLogger. Install NE… Apr 21, 2015
core-site.xml.template matatabi-hive-init.sh add Apr 16, 2015
hadoop-native-64-2.2.0.tar.gz add native library for hadoop-2.2.0 64bits Apr 15, 2015
hdfs-site.xml Make name node listen to all interfaces. Sep 16, 2014
hive-site.xml presto works with select * from malc0de; Apr 16, 2015
hiveserver.sh presto works with select * from malc0de; Apr 16, 2015
hiveserver2.sh presto works with select * from malc0de; Apr 16, 2015
mapred-site.xml ubutnu 2.5.0 base image first commit Sep 15, 2014
matatabi-hive-init.sh add anonymized netflow data Jul 23, 2015
mysql-hive.sql presto works with select * from malc0de; Apr 16, 2015
presto.catalog presto works with select * from malc0de; Apr 16, 2015
presto.config.properties presto works with select * from malc0de; Apr 16, 2015
presto.jvm.config add change to hadoop 2.2.0, add hive presto Apr 15, 2015
presto.sh add change to hadoop 2.2.0, add hive presto Apr 15, 2015
ssh_config ubutnu 2.5.0 base image first commit Sep 15, 2014
supervisord.conf presto works with select * from malc0de; Apr 16, 2015
yarn-site.xml ubutnu 2.5.0 base image first commit Sep 15, 2014

README.md

NECOMA MATATABI Docker image based on Hadoop 2.2.0

based on sequenceiq/docker-hadoop-ubuntu

It contains Apache Hadoop 2.2.0 with LZO native library, Hive 0.13.1, Presto 0.66 with additional HDFS import script and thread analysis scrips, necoma/matatabi_script.

Build the image

If you'd like to try directly from the Dockerfile you can build the image as:

docker build  -t necoma/matatabi

Pull the image

The image is also released as an official Docker image from Docker's automated build repository - you can always pull or refer the image when launching containers.

docker pull necoma/matatabi

Start a container

In order to use the Docker image you have just build or pulled use:

docker run -i -t necoma/matatabi

Testing

You can run one of the stock examples:

# run presto CLI
presto
presto:default> select * from sys.node;

Automate everything

As we have mentioned previously, a Docker file was created and released in the official Docker repository