Skip to content
This repository has been archived by the owner on Oct 26, 2023. It is now read-only.

Commit

Permalink
add readme for a few examples
Browse files Browse the repository at this point in the history
  • Loading branch information
markpollack committed Dec 12, 2012
1 parent bd3cbc5 commit a40bfed
Show file tree
Hide file tree
Showing 3 changed files with 55 additions and 0 deletions.
21 changes: 21 additions & 0 deletions hadoop/batch-extract/README.md
@@ -0,0 +1,21 @@
# Building and running

$ cd hadoop/batch-export
$ mvn clean package appassembler:assemble

# Start the database

$ sh ./target/appassembler/bin/start-database &

View the products in the PRODUCT table using the web UI, should be empty

To view the data in HDFS (as if it came out of a MR job)

$ hadoop fs -ls /data/analysis/results

# Run the export job

$ sh ./target/appassembler/bin/export



20 changes: 20 additions & 0 deletions hadoop/batch-import/README.md
@@ -0,0 +1,20 @@
# Building and running

$ cd hadoop/batch-import
$ mvn clean package appassembler:assemble

# Start the database

$ sh ./target/appassembler/bin/start-database

View the products in the PRODUCT table using the web UI

# Run the import job

$ sh ./target/appassembler/bin/import

To view the imported product database

$ hadoop fs -ls /import/data/products


14 changes: 14 additions & 0 deletions hadoop/streaming/README.md
@@ -0,0 +1,14 @@
# Building and running

$ cd hadoop/wordcount-hdfs-copy
$ mvn clean package appassembler:assemble
$ sh ./target/appassembler/bin/streaming

To send a message to syslog

$ logger -p local3.info -t TESTING "Test Syslog Message"

Look at the data inside hadoop

$ hadoop fs -ls /data

0 comments on commit a40bfed

Please sign in to comment.