Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.ipynb_checkpoints
archived_notebooks
data_files
dataset_original
images
AustinCrime_SankeyMATIC.rtf
Crime_2014_2016.ipynb
Crime_Analysis.pptx
GoogleReviews.ipynb
Graphing.ipynb
Presentation_Notes.docx
README.md
Team_Project_version_10.ipynb
Third Review Sentence Count vs Business Ratings.png
final_presention_slides.pdf
gitignore.txt
requirements1.txt

README.md

Deep Data Dive of Crime in Austin

Our goal was to take an in-depth analysis into the crimes occurring in Austin, Texas. In addition to the overall crime spread of our city, we wanted to discover correlations between the Travis County zip codes and the demographics behind the crimes.

But... why?

Because even though Austin is a pretty cool place, there are dusty corners and dark alleyways that we wanted to explore. For data!

The Data

crime_data We utilized the jupyter notebook and Python 3.6 to create our DataFrames and coerce our data to tell us a story.

After creating and cleaning the data, other questions we discovered we wanted answers to include:

  • Are certain zip codes associated with certain crimes?
  • Do affordable housing locations have a relationship with crime?
  • What about businesses - will the quality of their reviews be reflected in their location?
We also performed sentiment analysis using VADER sentiment analysis on the reviews for local businesses in the area, in hopes to find correlation between review polarity and location.

The Code

examples of code here

Tests

Stats/graphs pictures, info here

Data Relationships

austin_burglaryAfter the research and data crunching, we discovered that there are a few relationships of note:

  • Most crimes are committed in the South/Central Austin area
  • There is no correlation, at all, between Yelp reviews and the crime data
  • Areas with higher crime also have a higher number of affordable housing projects

Insights

One interesting trend we noticed during our exploration involves the sentiment analysis of the business reviews. Even if the compound sentiment polarity is negative, the overall rating for the business will not necessarily be low. Overall, Yelp reviews in Austin are overwhelmingly positive.

Challenges

Every project comes with its own set of challenges. Time (or lack of) is a fairly universal one. We also encountered limits with the data, such as the Yelp API only allowing three reviews per business.

Originally, we had planned to include more in-depth information about housing prices, family size, and median income, but we ran into complications involving the Zillow API and in aquiring additional market datasets.

The overall quality of the Yelp reviews was also called into question, as well as the Yelp business practices. We won't get into it here, but we do feel there is bias and a great deal of limitation using this interface.

Additional Questions

We feel that, given ample time, there are far more questions that can be answered and data to be explored. What are the schools like in these areas? We now know a bit about gender and racial demographics involving crime, but how are the demographics spread throughout the city? We have all of this crime data from 2014-2016, can we predict a trend for 2017 and 2018?

Prerequisites

*include info here

Raw Data Sources

Public annual crime records (2014 - 2016), crime demographics, and affordable housing information were all obtained from data.austintexas.gov.

Local business information and reviews obtained from the Yelp API.

You can’t perform that action at this time.