New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Project: Waze CCP Data Processor #1

Open
schnuerle opened this Issue Apr 19, 2018 · 5 comments

Comments

2 participants
@schnuerle
Contributor

schnuerle commented Apr 19, 2018

August 2017 - Would take Waze CCP data feed and process it into your cloud provider for access, analysis, and visualization. https://www.waze.com/ccp

Even though there are over 500 Waze CCP partners, only a small percent use the data that Waze provides to govs. It comes in 2 minute JSON file chunks, and it's up to govs to store and process the data themselves, and build the analytics tools and applications off the database.

Louisville has processed the data to an internal Microsoft MS SQL database from June 2016 to February 2017, and we are connecting to it with SQL queries and Power BI, and ran an internal hackathon.

@schnuerle

This comment has been minimized.

Contributor

schnuerle commented Apr 19, 2018

October 2017 - Louisville paid a local dev company around $2K to train us on AWS in general and how we could go about migrating this to the cloud.

Pitched this project to the Harvard Civic Analytics Network and got some interest.

@schnuerle

This comment has been minimized.

Contributor

schnuerle commented Apr 19, 2018

November 2017 - We've published a first pass of our code and instructions to for cities to use on GitHub here: https://github.com/LouisvilleMetro/WazeCCPProcessor

Right now it just takes your data feed URL and saves JSON to an S3 bucket. But at least you are collecting the data for the first time. Three cities have used it to do this: LA, Anchorage, Denver.

It also is built in Cloud Formation so it's easily deployable, updateable, and destroyable, and we have a future architecture diagram and detailed Project and Wiki area with tasks on the repo.

Other cities are interested in helping, including NYC, Boston, Pittsburgh, Philly, New Orleans, Chicago, San Francisco, and San Jose.

@schnuerle

This comment has been minimized.

Contributor

schnuerle commented Apr 19, 2018

January 2018 - Ok it looks like this is a good candidate for a project, so let's make it official!

@schnuerle schnuerle closed this Apr 19, 2018

@schnuerle schnuerle added this to In progress in Project Status Apr 20, 2018

@schnuerle

This comment has been minimized.

Contributor

schnuerle commented Apr 20, 2018

Reopening project. Maybe it shouldn't be closed until it's completed.

@patwater

This comment has been minimized.

patwater commented Apr 23, 2018

Yes one thought would be to phase the project. Definitely seems like there could be future evolutions or opportunities to say integrate Waze data with work order information (lots of challenges to develop requisite standards across cities!) though also that the first phase is reaching a close. Been very cool to watch from the sidelines! Great model for inter-city (and other local government) data collaborations.

@schnuerle schnuerle self-assigned this Jun 6, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment