Permalink
Browse files

name field in hdp-stream

  • Loading branch information...
1 parent efc7d53 commit a52c23046187c66b140f086e87d005448e48a8a3 Philip (flip) Kromer committed Jan 28, 2011
Showing with 1 addition and 0 deletions.
  1. +1 −0 bin/hdp-stream
View
@@ -15,6 +15,7 @@ HADOOP_HOME=${HADOOP_HOME-/usr/lib/hadoop}
cmd="${HADOOP_HOME}/bin/hadoop \
jar ${HADOOP_HOME}/contrib/streaming/hadoop-*streaming*.jar
-partitioner org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner
+ -jobconf "mapred.job.name=`basename $0`-$map_script-$input_file-$output_file"
-jobconf num.key.fields.for.partition=\"$partfields\"
-jobconf stream.num.map.output.key.fields=\"$sortfields\"
-jobconf stream.map.output.field.separator=\"'/t'\"

0 comments on commit a52c230

Please sign in to comment.