Skip to content
Browse files

Also scrapes https pages.

  • Loading branch information...
1 parent 64d0685 commit 13feb89274bc8a21e40518a25b6ecadb7f4a9b53 @nanaya nanaya committed with spladug
Showing with 1 addition and 1 deletion.
  1. +1 −1 r2/r2/lib/scraper.py
View
2 r2/r2/lib/scraper.py
@@ -96,7 +96,7 @@ def fetch_url(url, referer = None, retries = 1, dimension = False):
nothing = None if dimension else (None, None)
url = clean_url(url)
#just basic urls
- if not url.startswith('http://'):
+ if not (url.startswith('http://') or url.startswith('https://')):
return nothing
while True:
try:

0 comments on commit 13feb89

Please sign in to comment.
Something went wrong with that request. Please try again.