Thursday, January 31 @ 10a P, 12p C, 1p EJoin Nathaniel Eliot, @temujin9, DevOps Engineer and lead on Ironfan, in this community discussion. Ironfan is a lightweight cluster orchestration toolset, built on top of Chef, which empowers spinning up of Hadoop clusters in under 20 minutes. Nathan has been responsible for Ironfan’s core plugin code, cookbooks, and other components to stabilize both Infochimps’ open source offerings, and internal architectures. Register Now
Ironfan, the foundation of The Infochimps Platform, is an expressive toolset for constructing scalable, resilient architectures. It works in the cloud, in the data center, and on your laptop, and it makes your system diagram visible and inevitable. Inevitable systems coordinate automatically to interconnect, removing the hassle of manual configuration of connection points (and the associated danger of human error). For more information about Ironfan and the Infochimps Platform, visit infochimps.com.
This repo implements:
- Core models to describe your system diagram with a clean, expressive domain-specific language
- Knife plugins to orchestrate clusters of machines using simple commands like
knife cluster launch
- Logic to coordinate truth among chef server and cloud providers
Ironfan consists of the following Toolset:
- ironfan-homebase: centralizes the cookbooks, roles and clusters. A solid foundation for any chef user.
- core models to describe your system diagram with a clean, expressive domain-specific language
- knife plugins to orchestrate clusters of machines using simple commands like
knife cluster launch
- logic to coordinate truth among chef server and cloud providers.
- ironfan-pantry: Our collection of industrial-strength, cloud-ready recipes for Hadoop, HBase, Cassandra, Elasticsearch, Zabbix and more.
silverware cookbook: coordinate discovery of services ("list all the machines for
awesome_webapp, that I might load balance them") and aspects ("list all components that write logs, that I might logrotate them, or that I might monitor the free space on their volumes".
- Index of wiki pages
- Ironfan wiki: high-level documentation
- Ironfan issues: bugs, questions and feature requests for any part of the ironfan toolset.
- Ironfan gem docs: rdoc docs for Ironfan
- Ironfan Screencast -- build a Hadoop cluster from scratch in 20 minutes.
- Ironfan powers the Infochimps Platform, our scalable enterprise big data platform. Ironfan Enterprise adds zero-configuration logging, monitoring and a compelling UI.
Note: Ironfan is not compatible with Ruby 1.8. All versions later than 1.9.2-p136 should work fine.
- Core Concepts -- Components, Announcements, Amenities and more.
- Philosophy -- Best practices and lessons learned
- Style Guide -- Common attribute names, how and when to include other cookbooks, and more
- Homebase Layout -- How this homebase is organized, and why