Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Python module that allows one to easily write and run Hadoop programs.
Python

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
bin added example, updated README, and added individual commands in bin/
examples
src don't read common config opts twice
README
build-pymod.xml
build.xml

README

DESCRIPTION
"""""""""""

Originally, Dumbo was just a simple Python module that made writing 
and running Streaming programs very easy, but now it also consists 
of some helper code in Java. More generally, Dumbo can be considered
to be a convenient Python API for writing MapReduce programs.


INSTALLATION
""""""""""""

Dumbo should get built together with the rest of Hadoop when the 
"dumbo/" directory is put in Hadoop's "src/contrib/" directory. More
precisely, a "build/hadoop-*/contrib/dumbo/" directory should be
generated when you run "ant package" in Hadoop's root directory.


USAGE
"""""

contrib/dumbo/bin/put examples/brian.txt brian.txt

contrib/dumbo/bin/start examples/wordcount.py \
-input brian.txt -output brian-wc -inputformat text

contrib/dumbo/bin/cat brian-wc > brian-wc.txt


MORE INFO
"""""""""

http://github.com/klbostee/dumbo/wikis
Something went wrong with that request. Please try again.