Permalink
Browse files

Changed some comments and messages

  • Loading branch information...
1 parent ac1bc63 commit f9336cce5061092bb93d3b205c4b2f0bdf37e7fb Gabor Szabo committed May 14, 2012
Showing with 11 additions and 6 deletions.
  1. +4 −0 java/src/com/twitter/pycascading/CascadingBaseOperationWrapper.java
  2. +7 −6 remote_deploy.sh
View
4 java/src/com/twitter/pycascading/CascadingBaseOperationWrapper.java
@@ -150,6 +150,10 @@ private PythonInterpreter setupInterpreter(JobConf jobConf, FlowProcess flowProc
// We set the Python variable "map_input_file" to the path to the mapper
// input file
+ // But this is unfortunately null with the old Hadoop API, see
+ // https://groups.google.com/group/cascading-user/browse_thread/thread/d65960ad738bebd4/f343e91625cf3c07
+ // http://lucene.472066.n3.nabble.com/map-input-file-in-20-1-td961619.html
+ // https://issues.apache.org/jira/browse/MAPREDUCE-2166
interpreter.set("map_input_file", jobConf.get("map.input.file"));
// We set the Python variable "jobconf" to the MR jobconf
View
13 remote_deploy.sh
@@ -54,16 +54,17 @@ copied to the remote server and submitted together with the job to Hadoop.
Options:
-h Show this message.
- -m Also deploy the PyCascading master jar before submitting
- the job.
+ -m Also deploy the PyCascading master archives before submitting
+ the job. The master archives must be on the Hadoop server
+ before a job can be run.
-f <file> Copy file to the server together with main_script, but
- do not bundle it into the Hadoop jar for submission. This
- option may be repeated several times for multiple files.
- File names cannot start with a dot.
+ do not bundle it up for submission. This option may be
+ repeated several times for multiple files. File names
+ cannot start with a dot.
-s <server> The name of the remote server where Hadoop is installed,
- and the PyCascading jar should be deployed to.
+ and the PyCascading scripts should be deployed to.
-o <ssh_options> Additional options for SSH (such as private key, etc.).
ssh_options is one string enclosed by "s or 's, even if

0 comments on commit f9336cc

Please sign in to comment.