Skip to content

Commit

Permalink
Update scraper.py
Browse files Browse the repository at this point in the history
  • Loading branch information
bethanjhn committed Jul 30, 2019
1 parent 7ef24f3 commit c711870
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions scraper.py
Expand Up @@ -35,8 +35,8 @@ def scrape_table(jim):
def scrape_and_look_for_next_link(url):
html = scraperwiki.scrape(url)
print html
root = lxml.html.fromstring(html)
# scrape_table(root)
jim = lxml.html.fromstring(html)
scrape_table(jim)
# Below would find a next button on the page and select it, then loop through that page etc
# next_link = root.cssselect("a.next")
# print next_link
Expand Down

0 comments on commit c711870

Please sign in to comment.