Skip to content

Commit

Permalink
Deal with IDs throughout, rather than names
Browse files Browse the repository at this point in the history
use the new 'as_ids' functionality from 0.22 of wikidata-fetcher
  • Loading branch information
tmtmtmtm committed Oct 10, 2018
1 parent ef3fb37 commit ae2c51d
Showing 1 changed file with 6 additions and 5 deletions.
11 changes: 6 additions & 5 deletions scraper.rb
Expand Up @@ -2,19 +2,20 @@
# encoding: utf-8

require 'wikidata/fetcher'
require 'pry'

sparq = 'SELECT ?item WHERE { ?item p:P39/pq:P2937 wd:Q18109299 }'
ids = EveryPolitician::Wikidata.sparql(sparq)
wikidata = EveryPolitician::Wikidata.sparql(sparq)

en_names = EveryPolitician::Wikidata.wikipedia_xpath(
enwiki = EveryPolitician::Wikidata.wikipedia_xpath(
url: 'https://en.wikipedia.org/wiki/Template:Current_MPs_of_South_Africa',
xpath: '//div[@role="navigation"]//table//tr[td]/td[1]//a[not(@class="new")]/@title',
as_ids: true,
)

af_names = EveryPolitician::Wikidata.wikipedia_xpath(
afwiki = EveryPolitician::Wikidata.wikipedia_xpath(
url: 'https://af.wikipedia.org/wiki/Sjabloon:Huidige_LP%27s_van_Suid-Afrika',
xpath: '//div[@role="navigation"]//table//tr[td]/td[1]//a[not(@class="new")]/@title',
as_ids: true,
)

EveryPolitician::Wikidata.scrape_wikidata(ids: ids, names: { en: en_names, af: af_names })
EveryPolitician::Wikidata.scrape_wikidata(ids: ids | enwiki | afwiki)

0 comments on commit ae2c51d

Please sign in to comment.