php utils for Hadoop Streaming
PHP
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
examples/wordcount
src
.gitignore
LICENSE
README.md
composer.json

README.md

php-hadoopstreaming

Install

Add to composer.json

{
    "require": {
        "makotokw/hadoopstreaming": "dev-master"
    }
}

Usage

simple test without hadoop

cd examples/wordcount
php mapper.php < word.txt | sort | php reducer.php

with hadoop streaming

hadoop-standalone/bin/hadoop jar hadoop-standalone/hadoop-streaming.jar\
 -input examples/wordcount/word.txt\
 -output examples/wordcount/output\
 -mapper 'php examples/wordcount/mapper.php'\
 -reducer 'php examples/wordcount/reducer.php'

LICENSE

The MIT License (MIT)