Skip to content

jp/haas

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HaaS - Hadoop as a Service

Installing a Hadoop cluster has never been so easy.

Haas big cluster

How to use

Install HaaS

gem install haas

Configure your environment with your AWS account

Get your AWS key and secret.

Set the two environment variable AWS_KEY and AWS_SECRET.

Launch

haas --launch

Optional parameters

Option Description Default
--nb-instances The number of instances you want to have in your cluster. 5
--instance-type The EC2 instance type. m3.large
--aws-region The AWS region to launch the instances. us-east-1

Stop the cluster

haas --terminate

Known issues and limitations

Cloud Provider

HaaS is working only with AWS. If you need another cloud provider create an issue about it.

AWS Limitations

EC2 Limits

By default, you can launch only 20 instances per region on AWS. This tool will check if you have enough instances available before launching a cluster. If you need more, you can increase your EC2 limit here.

Hadoop distribution

Only the HortonWorks distribution is currently supported. If you want to have another distribution supported, feel free to submit a pull request or an issue.

Contributing

If you wish to contribute on this gem:

  1. Fork the repository on Github
  2. Create a named feature branch (like add_component_x)
  3. Write your change
  4. Write tests for your change (if applicable)
  5. Run the tests, ensuring they all pass
  6. Submit a Pull Request using Github

License and Authors

Author: Julien Pellet

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

About

The easiest way to launch a Hadoop cluster in the cloud

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages