forked from openstates/openstates-scrapers
-
Notifications
You must be signed in to change notification settings - Fork 1
Wikipedia sync for state politicians
h4ck3rm1k3 edited this page Aug 13, 2012
·
4 revisions
-
scrape the wikipedia and ballotpedia, extract all links there.
-
check that wikipedia has an infobox, create it.
-
check the links to the official state website from wikipedia (is broken some times)
-
add links to wiki/ballotpedia in the json data
-
upload picture to wikipmedia commons
-
dont create new articles if not there, we can do that in phase II
-
dont remove any existing data, except broken links to the homepage (see in the example below, the link to the gov website was broken in the old version.)