Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Browse files

More readme notes

  • Loading branch information...
commit 813498636ec912423accdebe4a7785e51fd29656 1 parent b43db5c
@NathanNeff authored
Showing with 7 additions and 2 deletions.
  1. +7 −2 examples/streaming-modules/README.org
View
9 examples/streaming-modules/README.org
@@ -8,8 +8,13 @@ Don't forget to specify -file <MyModule.pm>
** Other Interesting Things
-This job is a map-only job. mapred.map.tasks is 2 on the VM where these scripts were written,
-so it was interesting to see two output files produced despite the input data being only ~14 lines
+- This job is a map-only job, hence the -Dmapred.reduce.tasks=0 in ./run_streaming_modules.sh
+
+- mapred.map.tasks is 2 on the VM where these scripts were written, so it was
+ interesting to see two output files produced despite the input data being
+ only ~14 lines
+
+- If I specify -D mapred.map.tasks=10, then I get 11 output files (part-00000 part-00010)
* Error Logs
Please sign in to comment.
Something went wrong with that request. Please try again.