source for Open States' scrapers
Python JavaScript CSS HTML Shell R
Latest commit 6d5f63f Jan 17, 2017 @jamesturk jamesturk committed on GitHub Merge pull request #1267 from openstates/tim/id/2017versions
ID: Add missing bill versions and documents


The Open States Project collects and makes available data about state legislative activities, including bill summaries, votes, sponsorships and state legislator information. This data is gathered directly from the states and made available in a common format for interested developers, through a JSON API and data dumps.


Getting Started

We use Docker to provide a reproducible development environment. Make sure you have Docker installed. Inside of the directory you cloned this project into:

docker build -t openstates/openstates .  # Flaky. Try running the command again if it fails.
docker run openstates/openstates <abbreviated state code>  # Scrapes the state indicated by the code e.g. "ny"

This project runs on top of billy, a scraping framework for government data. Our Docker container runs the billy-update command (billy-update docs) with whatever arguments you put at the end of docker run. For example, you can limit the scrape to Tennessee's (tn) state senators using:

docker run openstates/openstates tn --upper --legislators

You have your local changes included in the container by mounting your clone directory:

docker run -v `pwd`:/srv/openstates-web openstates/openstates [billy-update-args...]


To run all tests:

docker run --entrypoint=nosetests openstates/openstates /srv/openstates-web/openstates

Note that Illinois (il) is the only state with tests right now.