An iterative computing framework on both Hadoop MapReduce and Hadoop YARN.
Please visit Guagua site for tutorials.
Guagua, a sub-project of Shifu, is a distributed, pluggable and scalable iterative computing framework based on Hadoop MapReduce and YARN.
This graph shows the iterative computing process for Guagua.
Typical use cases for Guagua are distributed machine learning model training based on Hadoop. By using Guagua, we implement distributed neural network algorithm which can reduce model training time from days to hours on 500GB data sets. Distributed neural network algorithm is based on Encog and Guagua. Any details please check our example source code.
Copyright 2013-2014, eBay Software Foundation under the Apache License V2.0.