Skip to content

Commit

Permalink
Fetch in batches of 200
Browse files Browse the repository at this point in the history
Save some memory
  • Loading branch information
tmtmtmtm committed Jan 30, 2019
1 parent a3dcfd8 commit 755952c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scraper.rb
Expand Up @@ -31,4 +31,4 @@ def members
EOQ
ids = EveryPolitician::Wikidata.sparql(sparq)

EveryPolitician::Wikidata.scrape_wikidata(ids: ids | morph)
EveryPolitician::Wikidata.scrape_wikidata(ids: ids | morph, batch_size: 200)

0 comments on commit 755952c

Please sign in to comment.