No description or website provided.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
LICENSE
README.md
data-2018-11-28.csv
data.csv
proc.py
scrape.py

README.md

MacArthur Foundation

This is for Vipul Naik's Donations List Website.

see https://github.com/vipulnaik/donations/issues/4 for the issue that initiated this repo.

see https://www.macfound.org/grants/ for the data source.

files:

  • scrape.py: scrapes the grants info and stores it in a CSV file. Scraping takes over an hour.
  • proc.py: takes the data stored in the CSV and transforms it into a SQL file (a SQL insert statement with a bunch of values) that can be loaded into MySQL. The schema for this is in the donations repo.

Instructions for doing a run

./scrape.py out.csv
./proc.py out.csv > out.sql

License

CC0 for the scripts, not sure about the data.