Advanced Mesos cluster configuration and deployment via Ansible
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.

README.md

Build Status

Red Cell: Cluster Configuration & Deployment

This repository contains scripts and configurations used at Ognitio to automate the deployment process of our clusters. As we run Apache Mesos and a few of his frameworks for scheduling, we plan to continuously share publicly related templates and scripts through this directory.

RedCell Architecture

Status

This project is undergoing heavy refactoring, hardening and testing and isn't even considered alpha.

Technology stack

We mainly rely on Ansible to configure our VMs.

The following list contains some of the projects that composes our stack:

  • Consensus

  • Resource management

  • Scheduling (i.e. Mesos frameworks)

  • Logging and metrics

    • Transport
      • Telegraf: Plugin-driven server agent for reporting metrics
      • Fluentd: Open source data collector
    • Storage
    • Visualization
  • Container registry

    • Distribution: Docker toolset to pack, ship, store, and deliver content
  • Service discovery and load balancing

    • HAProxy: TCP/HTTP Load Balancer
    • Mesos DNS: DNS-based service discovery for Mesos
  • Application isolation

    • Weave: Network of Docker containers

Further work

  • Enable SSL within Mesos and frameworks
  • Authorization and authentication
  • Secret files distribution
  • Finer cloud providers deployment support (GCE, AWS, ...)
  • Generate Ansible inventory file