Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Loading…

Exception in thread "main" java.io.IOException: Error opening job jar: /Users/chris/src/hadoop-0.21.0/contrib/streaming/hadoop-*streaming*.jar #4

Open
wants to merge 1 commit into from

2 participants

@christocracy

I'm very new to hadoop and even newer to Wukong, but it seems that the path to the jar "hadoop-streaming.jar has changed slightly in hadoop 0.21.0.

Does this make sense?

@amartinfraguas

Thank you! I still have to fix some other problems with Wukong, so I have not been able to test it thoroughly.

This works for me if I remove "if options[:hadoop_home].include?("0.21.0")"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Commits on Mar 25, 2011
  1. @christocracy
This page is out of date. Refresh to see the latest.
Showing with 6 additions and 2 deletions.
  1. +6 −2 lib/wukong/script/hadoop_command.rb
View
8 lib/wukong/script/hadoop_command.rb
@@ -54,13 +54,17 @@ def jobconf option
# others
#
def execute_hadoop_workflow
+
+ jar_path = File.join('contrib', 'streaming', 'hadoop-*streaming*.jar')
+ jar_path = File.join('mapred', jar_path) if options[:hadoop_home].include?("0.21.0")
+
# Input paths join by ','
input_paths = @input_paths.join(',')
#
# Use Settings[:hadoop_home] to set the path your config install.
hadoop_commandline = [
- hadoop_runner,
- "jar #{options[:hadoop_home]}/contrib/streaming/hadoop-*streaming*.jar",
+ hadoop_runner,
+ "jar #{File.join(options[:hadoop_home], jar_path)}",
hadoop_jobconf_options,
"-D mapred.job.name='#{job_name}'",
hadoop_other_args,
Something went wrong with that request. Please try again.