Skip to content
This repository
Browse code

More readme notes

  • Loading branch information...
commit 813498636ec912423accdebe4a7785e51fd29656 1 parent b43db5c
Nathan Neff authored

Showing 1 changed file with 7 additions and 2 deletions. Show diff stats Hide diff stats

  1. 9  examples/streaming-modules/README.org
9  examples/streaming-modules/README.org
Source Rendered
@@ -8,8 +8,13 @@ Don't forget to specify -file <MyModule.pm>
8 8
 
9 9
 ** Other Interesting Things
10 10
 
11  
-This job is a map-only job.  mapred.map.tasks is 2 on the VM where these scripts were written,
12  
-so it was interesting to see two output files produced despite the input data being only ~14 lines
  11
+- This job is a map-only job, hence the -Dmapred.reduce.tasks=0 in ./run_streaming_modules.sh
  12
+
  13
+- mapred.map.tasks is 2 on the VM where these scripts were written, so it was
  14
+  interesting to see two output files produced despite the input data being
  15
+  only ~14 lines
  16
+
  17
+- If I specify -D mapred.map.tasks=10, then I get 11 output files (part-00000 part-00010)
13 18
 
14 19
 * Error Logs
15 20
 

0 notes on commit 8134986

Please sign in to comment.
Something went wrong with that request. Please try again.