Skip to content
Browse files

Fixes a couple of pipeline script bugs.

-Corrects bad classpath invocation in step [glue-tune]
-Inserts correct value of JAVA_HOME into hadoop config
 for automatically rolled out hadoop.
  • Loading branch information...
1 parent 160b14b commit 867dffbecf11d0de7c84790e96366a4815f8f6e5 @alopez alopez committed
Showing with 2 additions and 1 deletion.
  1. +2 −1 scripts/training/pipeline.pl
View
3 scripts/training/pipeline.pl
@@ -617,7 +617,7 @@ BEGIN
system("grep -v input-file $THRAX_CONF_FILE > thrax-$GRAMMAR_TYPE.conf")
unless -e "thrax-$GRAMMAR_TYPE.conf";
$cachepipe->cmd("glue-tune",
- "$SCRIPTDIR/training/scat tune/grammar.filtered.gz | java -cp $JOSHUA/lib/thrax.jar:$JOSHUA/hadoop-core-0.20.203.0.jar:$JOSHUA/lib/commons-logging-1.1.1.jar edu.jhu.thrax.util.CreateGlueGrammar thrax-$GRAMMAR_TYPE.conf > tune/grammar.glue",
+ "$SCRIPTDIR/training/scat tune/grammar.filtered.gz | java -cp $JOSHUA/lib/thrax.jar:$JOSHUA/lib/hadoop-core-0.20.203.0.jar:$JOSHUA/lib/commons-logging-1.1.1.jar edu.jhu.thrax.util.CreateGlueGrammar thrax-$GRAMMAR_TYPE.conf > tune/grammar.glue",
"tune/grammar.filtered.gz",
"tune/grammar.glue");
$GLUE_GRAMMAR_FILE = "tune/grammar.glue";
@@ -958,6 +958,7 @@ sub rollout_hadoop_cluster {
system("echo $hostname > hadoop/conf/masters");
system("echo $hostname > hadoop/conf/slaves");
+ system("echo export JAVA_HOME=$ENV{JAVA_HOME} >> hadoop/conf/hadoop-env.sh");
} else {

0 comments on commit 867dffb

Please sign in to comment.
Something went wrong with that request. Please try again.