This repository has been archived by the owner on Oct 26, 2023. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
bd3cbc5
commit a40bfed
Showing
3 changed files
with
55 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,21 @@ | ||
# Building and running | ||
|
||
$ cd hadoop/batch-export | ||
$ mvn clean package appassembler:assemble | ||
|
||
# Start the database | ||
|
||
$ sh ./target/appassembler/bin/start-database & | ||
|
||
View the products in the PRODUCT table using the web UI, should be empty | ||
|
||
To view the data in HDFS (as if it came out of a MR job) | ||
|
||
$ hadoop fs -ls /data/analysis/results | ||
|
||
# Run the export job | ||
|
||
$ sh ./target/appassembler/bin/export | ||
|
||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,20 @@ | ||
# Building and running | ||
|
||
$ cd hadoop/batch-import | ||
$ mvn clean package appassembler:assemble | ||
|
||
# Start the database | ||
|
||
$ sh ./target/appassembler/bin/start-database | ||
|
||
View the products in the PRODUCT table using the web UI | ||
|
||
# Run the import job | ||
|
||
$ sh ./target/appassembler/bin/import | ||
|
||
To view the imported product database | ||
|
||
$ hadoop fs -ls /import/data/products | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
# Building and running | ||
|
||
$ cd hadoop/wordcount-hdfs-copy | ||
$ mvn clean package appassembler:assemble | ||
$ sh ./target/appassembler/bin/streaming | ||
|
||
To send a message to syslog | ||
|
||
$ logger -p local3.info -t TESTING "Test Syslog Message" | ||
|
||
Look at the data inside hadoop | ||
|
||
$ hadoop fs -ls /data | ||
|