Archive of Mass ENvironmental Data Site
The Archive of Mass ENvironmental Data (AMEND) is a project to assemble and analyze data related to environmental regulation, focused on water policy in Massachusetts.
The website for the project can be viewed here.
This git repository contains code for data acquisition (see get_data subdirectory), analysis (see analysis subdirectory), and the jekyll site for this project (see docs subdirectory).
You can run the single convenience script update_all.sh to (re)generate all content associated with the site.
Hosting the site
The python scripts in this repository automatically feed content to a static website generated with jekyll. The website is hosted via GitHub Pages or can be run locally with the proper Ruby configuration.
Several python packages are required to execute the scripts needed to generate this website:
- numpy 1.13.0
- matplotlib 2.0.0
- scipy 0.19.0
- pandas 0.20.0
- folium 0.5.0
- sqlalchemy 1.1.6
- census 0.8.1
- urllib2 2.7
- BeautifulSoup4 4.4.1
- unidecode 2.7.12
- requests 2.12.1
- sodapy 1.4.3
- shapely 1.6.4.post1
Other tools used
chart.js was used to generate interactive charts for the website.
Leaflet for interactive map display.
sql.js is used to enable interactive querying of the site's integrated database.
Tabula was used to extract tables from PDF files.