Skip to content

Commit

Permalink
Merge pull request #8 from everypolitician-scrapers/remove-term-from-…
Browse files Browse the repository at this point in the history
…data

Do not capture term in scraper
  • Loading branch information
tmtmtmtm committed Feb 23, 2017
2 parents cf30f9e + e240683 commit 239feb9
Showing 1 changed file with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions scraper.rb
Expand Up @@ -21,12 +21,10 @@ def scrape(h)
ScraperWiki.sqliteexecute('DELETE FROM data') rescue nil

url = 'http://www.alderney.gov.gg/article/4077/States-Members'
term = 2014
data = (scrape url => MembersPage).member_urls.map do |mem_url|
(scrape mem_url => MemberPage).to_h.merge(district: 'Alderney',
party: 'Independent',
term: term)
party: 'Independent')
end

# data.each { |d| puts d.reject { |_k, v| v.to_s.empty? }.sort_by { |k, _v| k }.to_h }
ScraperWiki.save_sqlite(%i(id term), data)
ScraperWiki.save_sqlite(%i(id), data)

0 comments on commit 239feb9

Please sign in to comment.