Permalink
Browse files

added example, updated README, and added individual commands in bin/

  • Loading branch information...
1 parent 116cdb8 commit f142fc41ee3cc8bf0a72e9b35dba5b396ee78e32 Klaas Bosteels committed Dec 26, 2008
Showing with 36 additions and 14 deletions.
  1. +8 −14 README
  2. +3 −0 bin/cat
  3. +10 −0 bin/example
  4. +3 −0 bin/get
  5. +3 −0 bin/ls
  6. +3 −0 bin/put
  7. +3 −0 bin/rm
  8. +3 −0 bin/start
View
22 README
@@ -10,27 +10,21 @@ to be a convenient Python API for writing MapReduce programs.
INSTALLATION
""""""""""""
-The Java code gets build together with the rest of Hadoop when the
-"dumbo/" directory is put in Hadoop's "src/contrib/", and the Python
-module can be installed by running
-
-sudo ant -f build-pymod.xml install_pymod
-
-in the "src/contrib/dumbo" directory. If the dir "dumbo/" is a subdir
-of Hadoop's "src/contrib/", then the -f option can be omitted:
-
-sudo ant install_pymod
+Dumbo should get built together with the rest of Hadoop when the
+"dumbo/" directory is put in Hadoop's "src/contrib/" directory. More
+precisely, a "build/hadoop-*/contrib/dumbo/" directory should be
+generated when you run "ant package" in Hadoop's root directory.
USAGE
"""""
-/usr/local/hadoop/bin/hadoop dfs -put examples/brian.txt brian.txt
+contrib/dumbo/bin/put examples/brian.txt brian.txt
-python examples/wordcount.py -hadoop /path/to/hadoop \
--file excludes.txt -input brian.txt -output brian-wc
+contrib/dumbo/bin/start examples/wordcount.py \
+-input brian.txt -output brian-wc -inputformat text
-python -m dumbo cat brian-wc > brian-wc.txt
+contrib/dumbo/bin/cat brian-wc > brian-wc.txt
MORE INFO
View
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+exec "`dirname $0`/dumbo" cat $@
View
@@ -0,0 +1,10 @@
+#!/bin/sh
+
+DUMBODIR="`dirname $0`/.."
+
+$DUMBODIR/bin/put $DUMBODIR/examples/brian.txt brian.txt
+
+$DUMBODIR/bin/start $DUMBODIR/examples/wordcount.py \
+-input brian.txt -output brian-wc -inputformat text
+
+$DUMBODIR/bin/cat brian-wc
View
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+exec "`dirname $0`/dumbo" get $@
View
3 bin/ls
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+exec "`dirname $0`/dumbo" ls $@
View
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+exec "`dirname $0`/dumbo" put $@
View
3 bin/rm
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+exec "`dirname $0`/dumbo" rm $@
View
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+exec "`dirname $0`/dumbo" start $@

0 comments on commit f142fc4

Please sign in to comment.