Site Support for archive.org user logins

[kereilly]

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.02.11. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

• [x ] I've verified and I assure that I'm running youtube-dl 2018.02.11

Before submitting an issue make sure you have:

• [ x] At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones
• [x ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• [ x] Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

youtube-dl -u ******@retroreport.com -p ****** --verbose https://archive.org/download/MSNBCW_20160923_000000_All_In_With_Chris_Hayes/MSNBCW_20160923_000000_All_In_With_Chris_Hayes.mp4
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-u', u'PRIVATE', u'-p', u'PRIVATE', u'--verbose', u'https://archive.org/download/MSNBCW_20160923_000000_All_In_With_Chris_Hayes/MSNBCW_20160923_000000_All_In_With_Chris_Hayes.mp4']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.02.11
[debug] Python version 2.7.10 (CPython) - Darwin-14.5.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.5.3, ffprobe 2.5.3
[debug] Proxy map: {}
[generic] MSNBCW_20160923_000000_All_In_With_Chris_Hayes: Requesting header
WARNING: Could not send HEAD request to https://archive.org/download/MSNBCW_20160923_000000_All_In_With_Chris_Hayes/MSNBCW_20160923_000000_All_In_With_Chris_Hayes.mp4: HTTP Error 403: Forbidden
[generic] MSNBCW_20160923_000000_All_In_With_Chris_Hayes: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/Library/Python/2.7/site-packages/youtube_dl/extractor/common.py", line 519, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/Library/Python/2.7/site-packages/youtube_dl/YoutubeDL.py", line 2199, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 469, in error
result = self._call_chain(*args)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 656, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 475, in error
return self._call_chain(*args)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 558, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

---

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

• Single video: https://archive.org/download/MSNBCW_20160923_000000_All_In_With_Chris_Hayes/MSNBCW_20160923_000000_All_In_With_Chris_Hayes.mp4
• Single video: https://archive.org/download/WPVI_20171220_053700_Nightline/WPVI_20171220_053700_Nightline.mp4

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

---

Description of your issue, suggested solution and other information

youtube-dl does support archive.org but not for a registered user. The content is different with login credentials.

I do have credentials necessary to work on this. You can contact me at kreilly@retroreport.com if you want to work on this

FYI we are a non profit news organization and use a python script with youtube-dl to assist in gathering materials for edit. We do not copyright infringe, we fair use or license when necessary. Having this ability to download files automatically from archive.org would be huge for us.

Also we did reach out to archive.org and they are okay with adding user logins for archive.org with youtube-dl. Thank you