Skip to content

Commit

Permalink
Update scraper.py
Browse files Browse the repository at this point in the history
  • Loading branch information
GravityTwin committed Jan 25, 2018
1 parent 7247958 commit cc4fe0a
Showing 1 changed file with 5 additions and 4 deletions.
9 changes: 5 additions & 4 deletions scraper.py
Expand Up @@ -15,12 +15,13 @@
print root
root.cssselect("div[align='left']")
selectthings = root.cssselect("div[align='left']")
urltoscrape = "http://foo.com"
listylist = ["p1","p2","p3"]
for blah in listylist
print blah
fullurl = urltoscrape+blah
for blah in listylist:
print blah
fullurl = urltoscrape+blah
print fullurl
print listylist
print fullurl
# # Write out to the sqlite database using scraperwiki library
# scraperwiki.sqlite.save(unique_keys=['name'], data={"name": "susan", "occupation": "software developer"})
#
Expand Down

0 comments on commit cc4fe0a

Please sign in to comment.