bin/bixo is working incorrectly with hadoop 0.20.203.0

[onokonem]

Looks like jar file naming scheme was changed.

simple fix:

--- bin/bixo.fix1       2011-09-14 14:40:29.035885594 +0400
+++ bin/bixo    2011-09-14 14:41:40.798931767 +0400
@@ -97,7 +97,7 @@
 done

 # add Hadoop libs to CLASSPATH
-for f in $HADOOP_HOME/hadoop-*-core.jar; do
+for f in $HADOOP_HOME/hadoop-core-*.jar; do
   CLASSPATH=${CLASSPATH}:$f;
 done
 for f in $HADOOP_HOME/lib/*.jar; do

[Schmed]

It looks like we have similar problems with CDH3 and 0.21.0 (though sadly, not quite similar enough for a clean general solution):

CDH3 seems to use the same convention as you report for 0.20.203.0:

schmed-mb-2:Newcastle schmed$ ll $HADOOP_HOME/*.jar
-rw-r--r--@ 1 schmed schmed 6842 Mar 25 19:57 /Users/schmed/Tools/hadoop/hadoop-ant-0.20.2-cdh3u0.jar
-rw-r--r--@ 1 schmed schmed 3452955 Mar 25 19:57 /Users/schmed/Tools/hadoop/hadoop-core-0.20.2-cdh3u0.jar
-rw-r--r--@ 1 schmed schmed 142551 Mar 25 19:57 /Users/schmed/Tools/hadoop/hadoop-examples-0.20.2-cdh3u0.jar
-rw-r--r--@ 1 schmed schmed 2416604 Mar 25 19:57 /Users/schmed/Tools/hadoop/hadoop-test-0.20.2-cdh3u0.jar
-rw-r--r--@ 1 schmed schmed 174987 Mar 25 19:57 /Users/schmed/Tools/hadoop/hadoop-tools-0.20.2-cdh3u0.jar

However, 0.21.0 has apparently split the core jar into pieces:

kay@wasp:~/Projects/bixo$ ls ~/Projects/hadoop-0.21.0/ | grep jar
hadoop-common-0.21.0.jar
hadoop-common-test-0.21.0.jar
hadoop-hdfs-0.21.0.jar
hadoop-hdfs-0.21.0-sources.jar
hadoop-hdfs-ant-0.21.0.jar
hadoop-hdfs-test-0.21.0.jar
hadoop-hdfs-test-0.21.0-sources.jar
hadoop-mapred-0.21.0.jar
hadoop-mapred-0.21.0-sources.jar
hadoop-mapred-examples-0.21.0.jar
hadoop-mapred-test-0.21.0.jar
hadoop-mapred-tools-0.21.0.jar

Whatever (ugly) fix we make should work for all of these versions.

[vmagotra]

I have added the new file naming scheme to the bin/bixo script (in addition to the older one) while setting up the classpath.
Once I have made the changes to handle CDH3 and Hadoop 0.21.x I'll close this issue.