Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
error: unable to dowload wepage: HTTP Error 503 #13864
Comments
|
same problem |
|
youtube-dl https://www.youtube.com/watch?v=-k3qyjZNcX0 --verbose |
|
youtube-dl -v https://www.youtube.com/watch?v=BaW_jenozKc --verbose |
|
Hello all, could you run the following command and paste the output? |
|
@yan12125 |
|
youtube-dl -v --print-traffic "https://www.youtube.com/watch?v=BaW_jenozKc" |
|
I noticed that both @zhangxulong and @RenzHoly uses Chinese name on Github profiles. Are you connecting to YouTube from within Mainland China? Did you use any anti-censorship softwares? (proxies, VPNs, or "翻墙", "科学上网" in Chinese) ping @junmuzi |
|
@yan12125 I connect to YouTube using a VPN in HongKong, from Mainland China. |
|
Hi @yan12125, Yes, I am connecting to YouTube from within Mainland China, but I just use IPv6 to visit YouTube and do not use any proxies or VPN. When use chrome browse visit this url, sometime it will give tips to make sure you are not a robot. Seems youtube-dl could automatically click "I am not a robot" is ok. # curl -v -L -6 "https://www.youtube.com/watch?v=5qVK7GIZ394" |
|
@yan12125 I am using IPv6 visit youtube. without any vpns. |
|
@junmuzi yes I have met the same condition with you |
|
Hmm I guess some people are abusing IPv6 networks in China to connect to YouTube. A possible workaround is exporting cookies to a file and feed it to youtube-dl via There were similar issues on other websites and some Github users gave useful tips. See #11572 (comment)
It's infeasible. youtube-dl is essentially a robot, and it's a bug for Google if youtube-dl can click it automatically. |
|
Hi @yan12125 , @zhangxulong, I double-check this issue, as I have use google to resolve the youtube IPv6 addr, and google will check whether this visit is an unusual traffic. As follow url show. So this issue do not due to youtube website, it is just due to the google dns resolve(as I have modify my hosts file in my computer). Modify hosts: Before modify hosts: As above show, I think we could close this issue(@yan12125). This is due to we use google dns to resolve youtube, and google will check whether this visit is a robot or not(@zhangxulong). |
|
@junmuzi modify the dns can resovle this problem? |
|
@zhangxulong , I think so. But you should find the avail dns server(This is also the IPv6 proxy, I think). Currently, I use encrypted-tbn0.google.com as IPv6 proxy via hosts, but this will check whether a robot or not. |
|
@zhangxulong , you could stop download, and wait for 10 hours, it will resume, it just temporal block. |
|
@junmuzi I have two server , and it all blocked by the robot verification. and I had used encrypted-tbn0.google.com as IPv6 proxy via hosts. you can down load directly by youtube-dl now? |
|
Same condition. And I can't download after waiting for over 12 hours. |
|
I'm able to download with another VPN |
|
Mapping www.youtube.com to encrypted-tbn0.google.com sounds a misconfiguration for me. If I under it correctly, hosts is used to map domain names to IP addresses. Maybe mapping from www.youtube.com directly to 2404:6800:4008:802::200e (an IPv6 address for encrypted-tbn0.google.com) will work? |
|
I am using the IPV6 dns 2001:470:20::2 |
|
oh , it is normal now without any exception. |
youtube-dl https://youtu.be/n2tk2ctypUs --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://youtu.be/n2tk2ctypUs', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.06.12
[debug] Python version 2.7.12 - Linux-4.10.0-27-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] n2tk2ctypUs: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 503: Service Unavailable (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 502, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 2129, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 467, in error
result = self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 654, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
Please follow the guide below
xinto all the boxes [ ] relevant to your issue (like this:[x])Make sure you are using the latest version: run
youtube-dl --versionand ensure your version is 2017.08.06. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.Before submitting an issue make sure you have:
What is the purpose of your issue?
The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue
If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the
-vflag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):
Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.
Description of your issue, suggested solution and other information
Explanation of your issue in arbitrary form goes here. Please make sure the description is worded well enough to be understood. Provide as much context and examples as possible.
If work on your issue requires account credentials please provide them or explain how one can obtain them.