Skip to content

Commit

Permalink
Update scraper.py
Browse files Browse the repository at this point in the history
  • Loading branch information
chadskelton committed Jul 6, 2019
1 parent e060cb6 commit e028f07
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scraper.py
Expand Up @@ -146,7 +146,7 @@ def scrape_bcca(url):
def scrape_bcpc(url):

# html = requests.get(url, verify=False, headers={'User-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36'})
html = requests.get(url)
html = requests.get(url, verify=False)
# verify=False because getting 502 errors due to invalid certificate
htmlpage = html.content

Expand Down

0 comments on commit e028f07

Please sign in to comment.