Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Newer
Older
100755 19 lines (16 sloc) 0.524 kB
db24328 @thiruvel Initial push
authored
1 #!/bin/bash
2 # Copyright (c) 2012 Yahoo! Inc. All rights reserved.
3 # Copyrights licensed under the New BSD License. See the accompanying LICENSE file for terms.
4 #
5
6 while read items
7 do
8 ls >&2
9 INPUTFILE=`echo $items | cut -d: -f1 | awk '{print $2}'`
10 OUTPUTFILE=`echo $items | cut -d: -f2`
11
12 echo "Processing files - $INPUTFILE - $OUTPUTFILE" >&2
13 $HADOOP_HOME/bin/hadoop fs -get $INPUTFILE .
14 FILE=`basename $INPUTFILE`
15 ./splitBzip2.sh "$FILE"
16 $HADOOP_HOME/bin/hadoop fs -put chunk-* $OUTPUTFILE
17 rm -f chunk-* $FILE
18 done
Something went wrong with that request. Please try again.