A DC/OS time series demo
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
commons
crime-data-producer
img
offline
online
stream-processing
.gitignore
LICENSE
README.md
deployment.md

README.md

Time Series DCOS Demo: Crime Buster!

Overview

In this demo we take the crime dataset from the City of Chicago, turn it into a streaming data source and process the data in two paths:

  • an online path, using a time series database (InfluxDB) and visualize the crime types in Grafana.
  • an offline part, using Spark jobs to create an overlay heat map of aggregated crimes on Google Maps.

Architecture

Usage

First you need to clone this repo:

$ git clone https://github.com/mesosphere/time-series-demo.git && cd time-series-demo/

Then you can set up and launch the components:

  1. Set up Kafka and Spark.
  2. Set up and launch the Crime Data Producer.
  3. Set up InfluxDB and Grafana online path, configure it and launch it.
  4. Set up Kubernetes and the offline reporting Web app and launch it.

We've also recorded a walkthrough of the set up and launch steps as asciicasts:

Part 1 Part 2

You can also check out the overview deployment doc for more details.

Dependencies

To do:

  • Create video walkthrough (Michael H9)
  • Add real timestamps to InfluxDB data (Michael G)