Phase 1 - Raw Waze to RDS
  

Updated Sep 11, 2018

4 Save JSON files to S3 Bucket

5 Data Processor

6 Data Store

3 Alarm/Notification System

1 Policy, Groups, Security, Roles

This project doesn’t have any columns or cards.

Menu

Phase 1 - Raw Waze to RDS #1

  
Updated Sep 11, 2018
Do the minimum to get the raw Waze data feed into an RDS. See our architecture diagrams.

Do the minimum to get the raw Waze data feed into an RDS. See our architecture diagrams.

Numbers on cards come from our Architecture Diagram. https://raw.githubusercontent.com/LouisvilleMetro/WazeCCPProcessor/master/docs/Current%20Architecture.png

  • Gets the raw Waze CCP JSON data feed into a relational database.
  • Base requirement for Waze data to be useful for governments.

Technical: Cloudwatch alarm triggers Lambda every 2 minutes to look at the Waze endpoint and saves data to S3. Lambda adds record to SQS Queue to process S3 files into Aurora Postgres DB. Alerts and queues for failures and SNS Topics used to allow real-time hooks. DB enriched with extra columns need for analysis.

Activity

    Loading activity

Archived cards

Loading archived cards…