codahale / hadoop-streaming fork watch download tarball
public
Description: Support libraries for writing Hadoop Streaming-compatible map/reduce tasks.
Clone URL: git://github.com/codahale/hadoop-streaming.git
Search Repo:
hadoop-streaming / Commit History feed

03/25/08

Changed Collector to KeyValueCollector to better describe it, and added 
some documentation to stuff.
codahale (author)
Tue Mar 25 12:09:15 -0700 2008
commit  53c462ecee0da108f330fdbe2791641078081f36
tree    9c2ceda7823be92a81d56b3b6e931a778caa752e
parent  d1b3bc3dffb8ee3690dce306b55b67ddff82159c

03/24/08

Adding further complication to the averge example.
codahale (author)
Mon Mar 24 16:07:17 -0700 2008
commit  d1b3bc3dffb8ee3690dce306b55b67ddff82159c
tree    a46c3bf7eaf6fa8ecb612a8b57b890efe4990128
parent  8ab769dcc704f6b6dadce6ee5245a16803e7c644 
Fixed tests, changed word_count example, added average example, fixed 
TSVParser -> map stuff.
codahale (author)
Mon Mar 24 16:04:12 -0700 2008
commit  8ab769dcc704f6b6dadce6ee5245a16803e7c644
tree    e729583d857c74b39451a9c240ea03517272511c
parent  cb36487707499d06ea796519c13a24a597f45133 
Added setup.py for much winning.
codahale (author)
Mon Mar 24 15:27:49 -0700 2008
commit  cb36487707499d06ea796519c13a24a597f45133
tree    f8772df71c43009f01e61e183daddc46a1870934
parent  2bf813f514520396f9685dbc9fde42d452146bc4 
Moved src to lib and removed the old hadoop module.
codahale (author)
Mon Mar 24 15:22:32 -0700 2008
commit  2bf813f514520396f9685dbc9fde42d452146bc4
tree    f4ee675bb9c1093e9fb17954ee817c7a7c1f77ec
parent  a0e4230834a94d2bda9d672c0f1870d84babafe5 
A bit of help and some changes.
codahale (author)
Mon Mar 24 15:18:00 -0700 2008
commit  a0e4230834a94d2bda9d672c0f1870d84babafe5
tree    8e03e16503113452df97922ecf2bb457aea7d2b1
parent  df084ac7be3205ed039f50dabbc598ed8160ffe4 
Extracted out an example job.
codahale (author)
Mon Mar 24 15:16:09 -0700 2008
commit  df084ac7be3205ed039f50dabbc598ed8160ffe4
tree    1fa0e78c8905a22114fb16f3ba61fcf542ea7db2
parent  dec0d947c3fc852039361c3a8c4b4aca75ad3c1e 
Added Job class.
codahale (author)
Mon Mar 24 15:08:39 -0700 2008
commit  dec0d947c3fc852039361c3a8c4b4aca75ad3c1e
tree    b0764cba4d01ccb9e01eb2ca8e47fafb27f3fba2
parent  00c862ab3f7252022c9f657f176323bdabb41b57 
Standardize parser/collector input/output to 'stream.' Also, remove 
defaults and references to sys -- not
codahale (author)
Mon Mar 24 14:19:30 -0700 2008
commit  00c862ab3f7252022c9f657f176323bdabb41b57
tree    f7f07b2b58501dfee7dec6750c4597dfc460650e
parent  239e032899dcad7ce3363c9021ec453ec649dbed 
Added Runner class with tests.
codahale (author)
Mon Mar 24 12:13:35 -0700 2008
commit  239e032899dcad7ce3363c9021ec453ec649dbed
tree    f226c12f8ab01419831278b86739a7c211d06a8d
parent  fe666812bbc78ff81c24063b0814aa64eaf31772

03/22/08

Added KeyValueParser, and made TSVParser descend from it.
codahale (author)
Sat Mar 22 22:39:56 -0700 2008
commit  fe666812bbc78ff81c24063b0814aa64eaf31772
tree    4aa9aae24d91658266f9ff8604ed4fe8471079b0
parent  bf73eda6fdfd2af02873fbbb9fa856f7c9d74ea5 
Added collectors for wonderous output goodness.
codahale (author)
Sat Mar 22 22:29:00 -0700 2008
commit  bf73eda6fdfd2af02873fbbb9fa856f7c9d74ea5
tree    8a21202f6c91140a382347b9f4e88f110834ddfd
parent  b5e5601348bd39c1e1fb14e7af093de22a2fa1da 
Wait, that's a stupid idea. Back out the reporter -- logging will suffice 
for that.
codahale (author)
Sat Mar 22 22:05:28 -0700 2008
commit  b5e5601348bd39c1e1fb14e7af093de22a2fa1da
tree    55dc61add903817006094bbd594f54953f91947c
parent  761f2b427d2ab19d6d319fbc82b161592c48bfdc 
Added reporter class for debug messages.
codahale (author)
Sat Mar 22 21:51:47 -0700 2008
commit  761f2b427d2ab19d6d319fbc82b161592c48bfdc
tree    fd763dde6a9de5bbd1faf6bb825bcf530249469b
parent  f0815253fa53c5e531a4d3dab1170983e036ef9c 
Add a full test suite (why isn't that auto-discovered?) and make the 
parsers default to parsing stdin.
codahale (author)
Sat Mar 22 21:38:41 -0700 2008
commit  f0815253fa53c5e531a4d3dab1170983e036ef9c
tree    792ae7e73d03142e804119d44fa573c17ccc8fac
parent  ab0eb14aa4e9f97cc0f8acfd8cb5f2b479a68ef8 
Added real structure for this project, plus parser classes (with tests!).
codahale (author)
Sat Mar 22 21:16:49 -0700 2008
commit  ab0eb14aa4e9f97cc0f8acfd8cb5f2b479a68ef8
tree    c67440d93774c0ab46b12030e216171adfb742ae
parent  2b780b91644d184449aedba85cfa12480258ec5d

03/05/08

Added README and the MIT License.
codahale (author)
Wed Mar 05 16:11:25 -0800 2008
commit  2b780b91644d184449aedba85cfa12480258ec5d
tree    9a9f4aa42dba2ff1a9f7a74f27ddb110ca4e517d
parent  692e07a5ccce4be3e1f521238261c422bd3da88f 
First commit of the Python lib.
codahale (author)
Wed Mar 05 16:00:26 -0800 2008
commit  692e07a5ccce4be3e1f521238261c422bd3da88f
tree    dc9e196563eb80f50c27d86041ef9b16bb31614b