@@ -0,0 +1,11 @@ +A script that fetches, parses and archives the XML data dumps of lobbyist's +political contributions published by The Senate Office of Public Records. + +Zips files containing the XML are: +1. Downloaded and unzipped. +2. Parsed out into flat text files and stored in a timestamped folder structure. +3. Imported to a SQLite database. + +The ultimate goal is for a series of SQL statements to scrub and cut the data +to account for flaws in the reporting system first uncovered by Bill Allison +and Anupama Narayanswamy of The Sunlight Foundation. README @@ -15,9 +15,8 @@ and Anupama Narayanswamy of The Sunlight Foundation. Sunlight study: http://realtime.sunlightprojects.org/2008/08/14/mark-warner-biggest-recipient-of-lobbyist-dough-new-disclosures-show-so-far/ -Simple analysis tasks -could then be scripted to output as schedule XLS dumps, email alerts or maybe -even Django-ifed HTML. +Simple analysis tasks could then be scripted to output as schedule XLS dumps, +email alerts or maybe even Django-ifed HTML. Source URL: http://www.senate.gov/legislative/Public_Disclosure/contributions_download.htm fetch.py 2e8d1a1357a1475969ac3e6ffc8227362627891d Ben Welsh palewire@palewire.com http://github.com/palewire/sopr-contribs/commit/ab2a4c1f3bd501d5b232adc4aa6909372acf5575 ab2a4c1f3bd501d5b232adc4aa6909372acf5575 2008-08-17T20:33:03-07:00 2008-08-17T20:33:03-07:00 Minor fixes 0b3d1ced1dfc7c53dfb31f75fb45735fbdd40991 Ben Welsh palewire@palewire.com