Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Browse files

Also scrapes https pages.

  • Loading branch information...
commit 13feb89274bc8a21e40518a25b6ecadb7f4a9b53 1 parent 64d0685
@nanaya nanaya authored spladug committed
Showing with 1 addition and 1 deletion.
  1. +1 −1  r2/r2/lib/scraper.py
View
2  r2/r2/lib/scraper.py
@@ -96,7 +96,7 @@ def fetch_url(url, referer = None, retries = 1, dimension = False):
nothing = None if dimension else (None, None)
url = clean_url(url)
#just basic urls
- if not url.startswith('http://'):
+ if not (url.startswith('http://') or url.startswith('https://')):
return nothing
while True:
try:
Please sign in to comment.
Something went wrong with that request. Please try again.