Cluster computing tool to deploy Docker containers on AWS
Python Jupyter Notebook Shell Other
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
bin
clusterous
demo
docs
support/baking/ansible
tests/e2e
.gitignore
CHANGELOG.md
LICENSE.md
README.md
setup.cfg
setup.py

README.md

Clusterous: Easy Cluster Computing with Docker and AWS

Clusterous is a easy-to-use command line tool for cluster computing on AWS. It allows you to create and manage a cluster on AWS and deploy your software in the form of Docker containers. It is aimed at scientists and researchers who want the on-demand compute power that AWS offers, but don't have the necessary time or technical expertise.

Requires Linux or OS X and Python 2.7.

Features

  • Scalable cluster via adding and/or removing nodes
  • Shared volume accessible to all nodes
  • Central logging system available for your applications
  • Reusable and redistributable environments
  • Customisable architecture (master-salve by default)
  • IPython parallel and Apache Spark environments demos provided
  • Commands to upload or download your data to and from the cluster
  • Secure connections to the clusters via SSH tunnels
  • Own virtual private cloud (VPC)
  • Private docker registry
  • Setup wizard
  • ... and many more

Get started

Quick start guide

You can also read the full user manual.

Contributing

We heartily welcome external contributions to Clusterous.

  • Have you found an issue? Feel free to report it using our Issues page. In order to speed up response times, we ask you to provide as much information on how to reproduce the problem as possible.

  • Developing new features or Fixing bugs? Clone this repository, create a branch, do your magic and then submit a pull request.

Authors

Clusterous is being developed by SIRCA team as part of the Big Data Knowledge Discovery (BDKD) project funded by SIEF.

  • Benjamin King (Delivery Manager)
  • Balram Ramanathan
  • Lolo Fernandez

Acknowledgements

BDKD project partners whom gave us their support and guidance:

Open source projects:

Licensing

Clusterous is available under the Apache License (2.0). See the LICENSE file.

Copyright Data61 2016.