Fetching latest commit…
list-of-WPRDC-relevant-tools-and-analyses
A collection of WPRDC-relevant tools and data analyses.
Tools
- WPRDC Property Dashboard - The Regional Data Center's Property Dashboard integrates data from multiple data sources and provides it all in one place. We're happy to announce that the beta version of the tool is now live, and we built it in-house.
- WPRDC's Parcels n'at - Parcels n'at allows you to pull a variety of data by neighborhood, municipality, or even for a user-defined area using some of the embedded drawing tools.
Data analyses by dataset
311 Data
- conorotompkins/pittsburgh_311 - Conor Tompkins' R-based analaysis of Pittsburgh's 311 data.
- The Use of 311 Requests as a Measure of Neighborhood Conditions in the City of Pittsburgh - An article reporting on the analysis of Pittsburgh's 311 data, by UCSUR's own Don Musa, published in UCSUR's PEQ (Pittsburgh Economic Quarterly).
Air-Quality Data
- WPRDC/Jupyter-notebooks-by-dataset/air-quality-exploration - A demonstration of how to dig into the Allegheny County air-quality data to pull out and plot particular measurements.
Carnegie Library Wi-Fi Use Data
- eleanortutt/codeforpgh-20180613 - Eleanor Tutt's demonstration of how to load data into Pandas dataframes and how to make choloropleth maps.
Crash Data
- WPRDC/Jupyter-notebooks-by-dataset/Crash-Data-Analysis - WPRDC data analysis of Allegheny County crash data, demonstrating a few methods for loading data from CKAN and manipulating data.
- conorotompkins/allegheny_crashes - Conor Tompkins' R-based analysis of Allegheny County crash data and the accompanying blog post, showing some interesting visualizations.
Crime Data
- conorotompkins/pgh-crime - Conor Tompkins' R-based analysis of Pittsburgh crime data.
- ZacharyGoldstein/pgh-juvenile-arrests - Zach Goldstein's analysis of Pittsburgh arrests data for a WESA article on juvenile arrests. You can also view the Jupyter notebook with plots.
Dog-License Data
- nrfulton/pittdoggos - Nathan Fulton's Python scripts for analyzing county (but not city) dog-license data and a simple Web page for searching dogs by name.
Fatal Accidental Overdoses Data
- conorotompkins/allegheny_overdoses - Conor Tompkins' R-based analaysis of the County Fatal Accidental Overdoses data.
Healthy Ride Data
- conorotompkins/healthy_ride - Conor Tompkins' R-based analysis of Healthy Ride data.
Examples demonstrating different skills
Python
Learning Python/Jupyter notebooks/data analysis
- WPRDC/urban-informatics-and-visualization - A WPRDC fork of Paul Waddell's course materials for Urban Informatics and Visualization. These Jupyter notebooks cover Python/Jupyter fundamentals, cleaning/manipulating/analyzing/visualizing/mapping data, and using Web APIs for getting and posting data.
Making bar charts
Making SQL queries on WPRDC data
Mapping
Pandas dataframes
Pulling WPRDC data through the CKAN API
Transforming from a long-format data table to a wide-format data table
R
Learning R
- Tutorial on using R to analyze pothole data - Material from a workshop run by Conor Tompkins, using Pittsburgh's 311 data on potholes to teach the basics of using R (including manipulating data and making charts and maps).
Principal component analysis in R
- Principal Component Analysis in R - A bloh post explaining the application of prinicpal component analysis to Pittsburgh's 311 data.
CKAN API usage under R + debugging a broken SQL query
- Using the CKAN API wrapper + converting string fields to integers in SQL queries - Addressing a common pitfall when running SQL queries, this R script shows how to convert a string field to an integer and then use it in the WHERE clause of a SQL query. This also gives a simple example of using the ckanr wrapper package to more easily use the CKAN API.
Other data sources
Tools
- ljwolf/cenpy - A Python library for exploring and querying the US Census API and returning Pandas DataFrames.
General tools for working with data
- saulpw/visidata - A terminal spreadsheet multitool for discovering and arranging data. (It's basically a Swiss Army chainsaw for manipulating tabular data.)
Contribute
Please contribute things that could be useful to others using WPRDC data, including scripts for data cleaning or analyzing data, Jupyter notebooks for particular datasets, and tools for manipulating and visualizing the data.