Skip to content

/ youtube-dl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

HTTP Error 403 on GoogleDrive URL. #10905

Closed
B0bTheBu1lder opened this issue Oct 12, 2016 · 5 comments
Closed

HTTP Error 403 on GoogleDrive URL. #10905

B0bTheBu1lder opened this issue Oct 12, 2016 · 5 comments
Labels
invalid

Comments

@B0bTheBu1lder
Copy link

@B0bTheBu1lder B0bTheBu1lder commented Oct 12, 2016

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.10.07. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2016.10.07

Before submitting an issue make sure you have:

  • At least skimmed through README and most notably FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

Verbose output:

youtube-dl -v https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=2607:fea8:1cdf:fbbe:e920:deb7:2c39:2e46&ipbits=0&expire=1476243109&cp=QVJMWENfUlFOSlhNOjIxT2pNX0VwSmQ4&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=9A079A628E3ED473073936AC7258FEEDF7A150A3.713C753608F05F13EE6E2962250D4D6131E8D6A5&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476228435&mv=m&nh=IgpwcjAxLnl5ejA2KhcyMDAxOjQ4NjA6MToxOjA6MzJjOjA6OQ&pl=37&sc=yes&usequic=no
[1] 51839
[2] 51840
[3] 51841
[4] 51842
[5] 51843
[6] 51844
[7] 51845
[8] 51846
[9] 51847
[10] 51848
[11] 51849
[12] 51850
[13] 51851
[14] 51852
[15] 51853
[16] 51854
[17] 51855
[18] 51856
[19] 51857
[20] 51858
[21] 51859
[2]   Done                    id=ad178e27e78a102d
[3]   Done                    itag=22
[4]   Done                    source=webdrive
[5]   Done                    ttl=transient
[6]   Done                    app=texmex
[7]   Done                    ip=2607:fea8:1cdf:fbbe:e920:deb7:2c39:2e46
[8]   Done                    ipbits=0
[9]   Done                    expire=1476243109
[10]   Done                    cp=QVJMWENfUlFOSlhNOjIxT2pNX0VwSmQ4
[11]   Done                    sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp
[12]   Done                    signature=9A079A628E3ED473073936AC7258FEEDF7A150A3.713C753608F05F13EE6E2962250D4D6131E8D6A5
[13]   Done                    key=ck2
[14]   Done                    mm=30
[15]   Done                    mn=sn-tt17rn7d
[16]   Done                    ms=nxu
[17]   Done                    mt=1476228435
[18]   Done                    mv=m
[19]   Done                    nh=IgpwcjAxLnl5ejA2KhcyMDAxOjQ4NjA6MToxOjA6MzJjOjA6OQ
[20]-  Done                    pl=37
[21]+  Done                    sc=yes
KoolAid@Salehs-MacBook-Pro Documents $ [debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.10.07
[debug] Python version 2.7.11 - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[generic] videoplayback?requiressl=yes: Requesting header
WARNING: Could not send HEAD request to https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes: HTTP Error 403: Forbidden
[generic] videoplayback?requiressl=yes: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 403, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2001, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

Description of your issue, suggested solution and other information

When I run

 youtube-dl -j https://drive.google.com/open?id=0B6jeZTKWRuG6Z21oNzF6U3d0WW8

I'm returned a bunch of different(broken) streamable URLs of the form:

https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246062&cp=QVJMWENfVVBUQ1hNOkl4TGEtUlBkMFBx&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=1512159A0C06F89B1F1E217D72258C20B691446E.3D2DCB60FA6008BADC4556642ADB1C72A6E036D8&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231384&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no

I can still download the video by running:

 youtube-dl -v https://drive.google.com/open?id=0B6jeZTKWRuG6Z21oNzF6U3d0WW8
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://drive.google.com/open?id=0B6jeZTKWRuG6Z21oNzF6U3d0WW8']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.10.07
[debug] Python version 2.7.11 - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[generic] open?id=0B6jeZTKWRuG6Z21oNzF6U3d0WW8: Requesting header
[redirect] Following redirect to https://drive.google.com/file/d/0B6jeZTKWRuG6Z21oNzF6U3d0WW8/view?usp=drive_web
[GoogleDrive] 0B6jeZTKWRuG6Z21oNzF6U3d0WW8: Downloading webpage
WARNING: "id" field is not a string - forcing string conversion
[debug] Invoking downloader on u'https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231917&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no'
[download] Destination: Kevin Hart stop by the police ��-URLuIBhBbBw.mp4-0B6jeZTKWRuG6Z21oNzF6U3d0WW8.mp4
[download] 100% of 38.10MiB in 00:47

The download will succeed, however accessing the URL the downloader was invoked on returns a 403. This was working just fine as of 10/10/2016.
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Oct 12, 2016

https://github.com/rg3/youtube-dl#video-url-contains-an-ampersand-and-im-getting-some-strange-output-1-2839-or-v-is-not-recognized-as-an-internal-or-external-command
@dstftw dstftw closed this Oct 12, 2016
@dstftw dstftw added the invalid label Oct 12, 2016
@B0bTheBu1lder
Copy link
Author

@B0bTheBu1lder B0bTheBu1lder commented Oct 12, 2016

The issue still exists when escaping the ampersand, as I said this was working perfectly fine as of 10/10/2016.

youtube-dl -v https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes\&id=ad178e27e78a102d\&itag=22\&source=webdrive\&ttl=transient\&app=texmex\&ip=174.114.112.50\&ipbits=0\&expire=1476246638\&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL\&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp\&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20\&key=ck2\&mm=30\&mn=sn-tt17rn7d\&ms=nxu\&mt=1476231917\&mv=m\&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE\&pl=19\&sc=yes\&usequic=no
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231917&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.10.07
[debug] Python version 2.7.11 - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[generic] videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl,id,itag,source,ttl,ip,ipbits,expire,cp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309: Requesting header
WARNING: Could not send HEAD request to https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231917&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no: HTTP Error 403: Forbidden
[generic] videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl,id,itag,source,ttl,ip,ipbits,expire,cp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 403, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2001, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

youtube-dl -v 'https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231917&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no'
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231917&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.10.07
[debug] Python version 2.7.11 - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[generic] videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl,id,itag,source,ttl,ip,ipbits,expire,cp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309: Requesting header
WARNING: Could not send HEAD request to https://r9---sn-tt17rn7d.c.docs.google.com/videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309.83B7E148288C4DF4286391649E39B71CBA413D20&key=ck2&mm=30&mn=sn-tt17rn7d&ms=nxu&mt=1476231917&mv=m&nh=IgpwcjAyLnl5ejA2KgkxMjcuMC4wLjE&pl=19&sc=yes&usequic=no: HTTP Error 403: Forbidden
[generic] videoplayback?requiressl=yes&id=ad178e27e78a102d&itag=22&source=webdrive&ttl=transient&app=texmex&ip=174.114.112.50&ipbits=0&expire=1476246638&cp=QVJMWENfVVZRSVhNOlhfS1UwZGNLeHNL&sparams=requiressl,id,itag,source,ttl,ip,ipbits,expire,cp&signature=A2E07DE07E93B71D09E3D7785DD8FEADD37E5309: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 403, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2001, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/Users/KoolAid/anaconda/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Oct 12, 2016

https://github.com/rg3/youtube-dl#i-extracted-a-video-url-with--g-but-it-does-not-play-on-another-machine--in-my-webbrowser
@B0bTheBu1lder
Copy link
Author

@B0bTheBu1lder B0bTheBu1lder commented Oct 12, 2016

The stream link we have generated from the google drive video for this test was done on the SAME computer and the same INTERNET connection. We have been through the FAQ and if you read my issue you would off noticed that this was working 2 days ago (Oct 10, 2016). This is new behaviour. Please take the time to read the issue so we can have a real conversation.
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Oct 12, 2016 •
edited

Take time to read FAQ with eyes in the first place

with the same cookies

These generated links are used by youtube-dl itself to download and they are provided intact.

PS > py -2.7 .\youtube_dl\__main__.py 'https://r11---sn-n8v7znee.c.docs.google.com/videoplayback
?requiressl=yes&id=<snip>&itag=22&source=webdrive&ttl=transient&app=texmex&ip=<snip>&ipbits=0&expire=<snip>cp=<snip>&sparams=requiressl%2Cid%2Citag%2Csource%2Cttl%2Cip%2Cipbits%2Cexpire%2Ccp&s
ignature=<snip>&key=ck2&mm=30&mn=sn-n8v7znee&
ms=nxu&mt=1476282917&mv=m&nh=<snip>pl=24&sc=yes' --add-header 'Cookie:DRIVE_STREAM=<snip> NID=<snip>' -v -o 'video.%(ext)s'
[debug] System config: []
[debug] User config: []
<snip>
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2016.10.07
[debug] Git HEAD: 7104ae7
[debug] Python version 2.7.12 - Windows-10-10.0.10240
[debug] exe versions: ffmpeg N-81192-g04da20e, ffprobe N-81192-g04da20e, rtmpdump 2.4
[debug] Proxy map: {}
<snip>
[download] Destination: video.unknown_video
[download]  10.5% of 38.10MiB at  2.46MiB/s ETA 00:13
@dstftw dstftw mentioned this issue Jan 15, 2017
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
invalid
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@dstftw @B0bTheBu1lder
You can’t perform that action at this time.