Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Comedy Central fails with 400: bad request #3364
Comments
|
I can reproduce this problem. As a workaround, try adding |
|
All the viacom sites (mtv, vh1) are failing because of the 400 error from the llnwd url. |
|
this has been going on for 24hrs now or more as that's when I noticed it first. |
|
also by the way, quite a few of the shows don't have the rtmp option on them, so it's an OK workaround sadly the newer shows don't have such a thing. |
|
Still not working on southparkstudios |
|
if that site doesn't have rtmp option then it won't work at all. |
|
This site was working as of 7/22... Verbose output [debug] System config: [] |
|
Same issue with @midnight |
|
Same problem, and in this case the RTMP workaround doesn't work (strangely, it did work on part 1 of the same video.) $ time youtube-dl --verbose http://thecolbertreport.cc.com/videos/x9hnxr/vint-cerf-pt--2 real 0m1.504s $ time youtube-dl -f rtmp-3500/rtmp2200 --verbose http://thecolbertreport.cc.com/videos/x9hnxr/vint-cerf-pt--2 real 0m2.040s |
|
Anyone got anything new on this? The RTMP workaround helps a little, but at least for me it always stops downloading at 99.8 or 99.9% of each segment, so it's far from ideal. |
|
@MatrixAgent The workaround works really nice for me. Do you really need the 0.1%? Do you recognize video content missing? The only thing which annoyed me, was the near endless length of time, when you wanted to fast-forward while watching the downloaded MP4 with VLC player, due to the corrupted file. Additional workaround: just copy the video and audio stream from your download and save it to a new MP4 container with FFmpeg: Takes about 1 second conversion time per 1 minute of original video and of course without any loss in quality. |
|
I'm always copying the videostreams into a new file where all segments are in one place, I have a script that takes a URL and spits out the full episode – but due to the 0.01% missing problem I've had several cases of segments not downloading at all, or timeouting. It's not reliable and I can't automate it properly, that is the problem. When I always have to do some manual work for each episode, I might as well not download it but just turn on the proxy (I'm outside the US and with the latest change they also started blocking us again, it seems) and watch it in the browser. I just like downloading much better than using their shitty flash player. (I do realize it is a "first world problem".) |
|
Not sure if this helps, but the mediagen feed which youtube-dl uses allows for several options which may be helpful. For example, attempting to download the July 23 episode, youtube-dl (like the flash player) queries http://thecolbertreport.cc.com/feeds/mediagen/?uri=mgid:arc:episode:colbertnation.cc.com:dc4c312c-731e-44cb-bb08-8eb335861181&device={device}, from which it receives rtmp urls. Several other options are available which may or may not be helpful. For example, leaving off the "device={device}" query parameter and adding "acceptMethods=hls" will provide Apple-style hls/m3u8 targets, while adding "acceptMethods=pd" will provide a downloadable file URI (though, notably, only at 512x288/750kbps). Unfortunately, I am currently unable to download the hls/m3u8 videos (either with curl or avconv) as all of the endpoints (after parsing the m3u8 manifests) result in "403 Access Denied" errors. |
|
@pishposhmcgee To workaround the 403 error when attempting to download the various m3u8 manifests for the different qualities, crypt.key and segment.ts files, you must use the original cookie that is sent from the [Akamai] server when the master.m3u8 is obtained (this is the src URL provided by the mediagen). I have been able to download from various sites which use MTV services through ffmpeg on Windows by using the cookie. |
|
Out of curiosity, and because I cannot seem to find it in the documentation, is there a flag in avconv (perhaps similar to that in ffmpeg) to use a cookie, say one saved by |
|
I have not personally used avconv before but looking around on the internet, you can set a custom HTTP header with the 'headers' parameter. There you could probably add the cookies. https://libav.org/avconv.html#http I tried using the Windows build for avconv but it didn't work because of missing depedencies. However, this is how I got it to work using ffmpeg: From what I can tell, the parameters for avconv should be similar or identical. I have had another attempt at this but it seems that cookies are no longer used like that. It works fine with no cookies set. For example when I try to use curl with the m3u8 URL or even try loading the link directly into my browser, no errors appear. If you run into any videos that still behave like this, let me know which ones. |
|
Thanks to @RealDeviil and @pascalbrax, the mp4 urls will work again in the next version of youtube-dl. |
|
Fixed in youtube-dl 2014.11.20. See our FAQ if you have problems updating. |
and others
Both The Daily Show and Colbert Report are failing to download video data with 400: bad request:
http://thedailyshow.cc.com/full-episodes/3xkgk9/july-23--2014---george-takei
http://thecolbertreport.cc.com/full-episodes/y3i0t2/july-24--2014---elon-musk
The videos play in the online player, so their service is not down.