Scrape crime data

[seanjtaylor]

We need the data to have the following fields:

• city
• crime category
• date
• count of unique incidents

We can work down the list of MSAs by population: https://en.wikipedia.org/wiki/List_of_Metropolitan_Statistical_Areas

New York: http://www.nyc.gov/html/nypd/html/analysis_and_planning/historical_nyc_crime_data.shtml

Los Angeles: No clear source.

Chicago: https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-present/ijzp-q8t2/data

[seanjtaylor]

Louisville, KY - https://data.louisvilleky.gov/dataset/crime-data

[bstarling]

Sources look like files/one-time downloads with a data cleaning exercise vs web scraping. Is that accurate?

[nix-bohon]

Here is the data available from Little Rock, AR:
https://data.littlerock.org/Public-Safety/COMPSTAT-Year-To-Date-as-2016/53ac-n7q5/data
https://data.littlerock.org/Public-Safety/COMPSTAT-2015/ysqk-d7nm

[jasdumas]

Hartford, CT (MSA 47 in the list):
https://data.hartford.gov/Public-Safety/Police-Incidents-01012005-to-Current/889t-nwfu
In a previous dashboarding project I pulled this crime data and formatted its fields that match the above requirements! The code is available here: https://github.com/jasdumas/hartford-police

Totally up for helping out anyone else who needs it!

[alexmansourati]

Chicago has an API for their crime data! https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-present/ijzp-q8t2/data