How to Do-It-Yourself A Cluster for Spark & Hadoop
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.

How to Do-It-Yourself A Cluster for Spark & Hadoop

It's unusual to have opportunity working on server farm, but it's not that difficult to build a cluster by yourself, with some commodity machines, like your old PC, not-use-anymore laptop, or even Raspberry Pi. It's not a bad idea to build such a cluster and try Apache Spark together with Hadoop on it.

In this document, I'm going to introduce the process to set up a cluster by yourself, including the hardware needed, network configuration, software installation, as well as some issues I encountered. It may be helpful for you too.