Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Crunchyroll (or CloudFlare ?) throwing a 503. #20027
Comments
|
Having the same problem and my cookie file is correct and functioning properly |
|
Um. me too? Edit 2: Just to avoid the need to scroll down, updating the user agent string fixes it for some.
If that doesn't work, you'll have to keep watching for a different fix, unfortunately. C:\Users\PonyFlare\Videos\BlackClover>youtube-dl --verbose http://www.crunchyroll.com/black-clover |
|
change user agent |
|
Same problem |
|
Well changing user agent is working for some people but not for all people, needs to be fixed, thank you very much! |
|
Confirmed user agent was the issue for me. |
|
PonyFlare, which one do you use? |
|
The one for the same browser I got the cookie from. Got it here: https://www.whoishostingthis.com/tools/user-agent/ Edit: Pointing out that since the only difference is the version number, if this happens again, going to menu>help>about and pulling the current version is all that's needed for those for whom a user agent change works. |
|
User agent is not working on my case rip |
|
that's what I meant, hope for an fast fix of this |
|
Ty PonyFlame, but it's same, We just have to wait a fix now. |
|
I tried with @PonyFlare 's user agent, not working here either... |
|
first, we must sign in.
it is run. |
|
You have the problem in python 3 too? [debug] System config: [] |
@awei78 Can you show the file with modifications? |
|
@awei78 solution dosen't work on my side :/ |
|
I FOUND THE PROBLEM. You don't need to pass thoses lines in the codes however, it works directly with the |
|
that was dumb |
Still not working for me :/ |
|
@RGFRv2 @skid9000 : try: |
|
the minimum working configuration for free videos:
in addition premium only videos require also a valid |
I am doing that and it's still giving me the 503 error. Cookie file with cf_clearance, c_userid and c_userkey freshly generated after a relogin to crunchyroll with no IP switching and putting in the same user agent for the browser I used to get the cookies. Still doesn't work. Not even for free videos. |
|
Same for me. Also, I notice that the cookie appears as |
|
Thanks, it works indeed. I used https://addons.mozilla.org/en-US/firefox/addon/cookies-txt/ / https://github.com/lennonhill/cookies-txt with Firefox to generate the initial cookies file, this is what it produced. Can we reopen this issue as a double enhancement wish?
|
I don't have #HttpOnly in my cookies file. It's just .crunchyroll.com but it still doesn't work |
|
I even tried getting the cookies file from firefox and changing the user agent in the script to match and I'm still getting the same error |
|
@remitamine @rg3 Could you please reopen this? Thanks |
this has been rejected upstream: https://bugs.python.org/issue2190
opening for that. for those saying that it doesn't work even though they really followed every step correctly, there is no way to fix the problem if it still happening, without been able to reproduce the problem locally. |
youtube-dl could do a first pass on the file to remove the prefix, but I guess it is not worth the effort. It can also be done with a one-liner, for example with GNU sed:
Somebody could translate it into python for those who do not have sed and put it on a wiki somewhere, with a link in the error message.
Thanks. |
|
Guys, I'm using the youtube-dl linux version and I'm with the same problem.
Even simple commands like F (just list all available formats of requested videos) doesn't work with Crunchyroll:
And of course trying to download the episode or the subs with the cookies returns the same problem:
Last week this was working perfectly, but now I have this problem. Help? |
|
@sakalol at least you're not using the same user agent where you have exported the cookies. unless some one has something to add, it would be better to stop posting the me too comments(and most of them did not even provide the minimum information to check if the configuration is right). |
|
C:\Windows\system32>D:\Users\User\Downloads\youtube_dl\youtube-dl.exe https://www.crunchyroll.com/the-quintessential-quintuplets/episode-8-the-photo-that-started-it-all-781300 -f best --write-sub --sub-lang enUS --cookies D:\Users\User\Downloads\youtube_dl\cookies.txt --user-agent Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:63.0) Gecko/20100101 Firefox/63.0 -o "D:\Users\User\Downloads\youtube_dl\Downloads%(title)s.%(ext)s" --verbose This is what I'm getting when I try. Probably doesn't add much but figured I'd give more information. |
|
@joshbrown50 you didn't quote the user-agent. |
|
Putting it in double quotes (i.e. "" ) worked. Thank you. Also I've never had to include the user agent before. Why the sudden change? |
|
Oh thanks @remitamine and @joshbrown50. The user-agent of the same browser that we got the cookie from + the double quotes ("") worked perfectly!! But yeah, I also wonder why the change. |
|
Getting a similar issue, cannot figure it out: youtube-dl --cookies "/tmp/cookies.txt" --user-agent "Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:65.0) Gecko/20100101 Firefox/65.0" --skip-download https://www.crunchyroll.com/en-gb/the-rising-of-the-shield-hero --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--cookies', '/tmp/cookies.txt', '--user-agent', 'Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:65.0) Gecko/20100101 Firefox/65.0', '--skip-download', 'https://www.crunchyroll.com/en-gb/the-rising-of-the-shield-hero', '--verbose']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.03.01
[debug] Python version 3.6.8 (CPython) - Linux-4.20.8-100.fc28.x86_64-x86_64-with-fedora-28-Twenty_Eight
[debug] exe versions: none
[debug] Proxy map: {}
[generic] the-rising-of-the-shield-hero: Requesting header
WARNING: Could not send HEAD request to https://www.crunchyroll.com/en-gb/the-rising-of-the-shield-hero: HTTP Error 503: Service Temporarily Unavailable
[generic] the-rising-of-the-shield-hero: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 503: Service Temporarily Unavailable (caused by <HTTPError 503: 'Service Temporarily Unavailable'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/home/jfield/dev/xorima/crunchyroll/.venv/lib64/python3.6/site-packages/youtube_dl/extractor/common.py", line 605, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/home/jfield/dev/xorima/crunchyroll/.venv/lib64/python3.6/site-packages/youtube_dl/YoutubeDL.py", line 2227, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib64/python3.6/urllib/request.py", line 532, in open
response = meth(req, response)
File "/usr/lib64/python3.6/urllib/request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib64/python3.6/urllib/request.py", line 570, in error
return self._call_chain(*args)
File "/usr/lib64/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/usr/lib64/python3.6/urllib/request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)cookies extracted with firefox |
|
3 Things I wanna say: -1st: I really hope that youtube-dl will find a way to automatically bypass this. -2nd: What you actually have to do now:
(!)IF YOU USE A VPN, be sure to get the cookies while your VPN is active! -3rd: If you want to use it in your python script, do this:
Hope this helped somebody |
|
it's don't work for me |
Please follow the guide below
xinto all the boxes [ ] relevant to your issue (like this:[x])Make sure you are using the latest version: run
youtube-dl --versionand ensure your version is 2019.02.18. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.Before submitting an issue make sure you have:
What is the purpose of your issue?
The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue
If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the
-vflag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):
Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.
Description of your issue, suggested solution and other information
Try to download anything from crunchyroll is throwing a 503 error.
And before someone ask me, YES my cookie file is correct and functioning properly, i checked if it was the issue multiple times.