Skip to content

Commit

Permalink
Update scraper.py
Browse files Browse the repository at this point in the history
  • Loading branch information
walinchus committed Aug 8, 2017
1 parent fa9d413 commit e1fb154
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions scraper.py
Expand Up @@ -105,7 +105,7 @@ def scrape_and_look_for_next_link(url):
record['URL'] = next_url
scraperwiki.sqlite.save(['URL'], record)
scrape_and_look_for_next_link(next_url)
if i == 450:
'''if i == 450:
time.sleep(65)
next_url = ListofOKCases[i]
print next_url
Expand All @@ -119,7 +119,7 @@ def scrape_and_look_for_next_link(url):
record = {}
record['URL'] = next_url
scraperwiki.sqlite.save(['URL'], record)
scrape_and_look_for_next_link(next_url)
scrape_and_look_for_next_link(next_url)'''



Expand Down

0 comments on commit e1fb154

Please sign in to comment.