Opinionated serverless event analytics pipeline
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
backend typo fix Jun 24, 2018
frontend limits May 15, 2018
.gitignore
.travis.yml
Banias_Architecture.png Arch image Mar 26, 2018
CNAME
LICENSE Initial commit Feb 15, 2018
README.md Update README.md May 30, 2018
_config.yml Set theme jekyll-theme-minimal Jul 18, 2018
banias-logo-lowres-trimmed.png
banias-logo-lowres.png banias logo Apr 6, 2018

README.md

Banias

License GitHub stars Build Status

Blog Post

Banias (Arabic: بانياس الحولة‎; Hebrew: בניאס‬) is the Arabic and modern Hebrew name of an ancient site developed around a river once associated with the Greek god Pan.

So, like the flow of the Banias, events are flowing into our system. So we decided to build a reference architecture and actual implementation of event analytics pipeline. You can take the code as it is and use it or use it a design reference.

Banias Architecture:

  • API receiving the events data from the producers (e.g. web apps, mobile app or backend servers)
  • The events are sent to Google Pub/Sub topic
  • Apache Beam/Google Cloud Dataflow streams the events into BigQuery with or without mutations or agregations

Installation

API Deployment

Apache Beam/Google Cloud Dataflow Deployment