Skip to content

OTv2: centralized ingest and aggregation of anonymous traffic data

License

Notifications You must be signed in to change notification settings

opentraffic/datastore

Repository files navigation

Open Traffic Datastore

Open Traffic Datastore is part of the OTv2 platform. It takes the place of OTv1's Data Pool.

The Datastore ingests input from distributed Reporter instances, creating internal "histogram tile files." The Datastore is also used to create public data extracts from the histogram tile files.

Datastore jobs can be run within Docker containers on AWS Batch, with Reporter inputs, histogram tile files, and public data extracts all stored on Amazon S3. Or run the jobs and store the files on your own choice of infrastructure.

Analyst UI, an app that runs in a web browser, can be used to fetch and parse Datastore's public data extracts.

How to use

Read more about:

To parse and visualize public data extracts:

  • Use the simple JavaScript web app contained in ./speed-tile-visualizer
  • Use the full Analyst UI

How to develop

Docker build

This repository and resultant Docker images are built and published via CircleCI. If you need to build locally:

sudo docker build -t opentraffic/datastore .

Using the image

The image is available via DockerHub:

docker pull opentraffic/datastore:latest

Building with Maven

mvn clean package

About

OTv2: centralized ingest and aggregation of anonymous traffic data

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published