Skip to content

Commit

Permalink
Update scraper.py
Browse files Browse the repository at this point in the history
  • Loading branch information
hicham20201441 committed Aug 27, 2020
1 parent 4e52a37 commit 13b435d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scraper.py
Expand Up @@ -25,7 +25,7 @@
newrls=[e.get("href") for e in root1.cssselect("a")]
urls=urls+newrls
print(str(len(newrls))+" new urls")
scraperwiki.sqlite.save(unique_keys=['Id'], data={"link": urls[0], "body":html1 })
scraperwiki.sqlite.save(unique_keys=[urls[0]], data={"link": urls[0], "body":html1 })
urls.pop(0)


Expand Down

0 comments on commit 13b435d

Please sign in to comment.