Colbert Report fails again

[wyatt8740]

$ youtube-dl http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
[ComedyCentralShows] thu-march-13-2014-simon-schama: Extracting information
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading webpage
ERROR: unable to find Flash URL in webpage http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

I am using the latest version from git.

[phihag]

Works fine for me. Can you upload the files you get when passing in --write-pages and the full output when passing in -v somewhere?

[wyatt8740]

Funny. That bit is working for me now, too. But it hangs after printing '[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433746'.

$ youtube-dl -v --write-pages http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', '--write-pages', 'http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama']
[debug] Encodings: locale 'UTF-8', fs 'UTF-8', out 'UTF-8', pref: 'UTF-8'
[debug] youtube-dl version 2014.03.12
[debug] Python version 2.7.3 - Linux-3.5.0-45-generic-i686-with-LinuxMint-14-nadia
[debug] Proxy map: {}
[ComedyCentralShows] thu-march-13-2014-simon-schama: Extracting information
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading webpage
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-www.colbertnation.com_full-episodes_thu-march-13-2014-simon-schama.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading show index
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http-shadow.comedycentral.com_feeds_video_player_mrss_uri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433747.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433743
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http-www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433743.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433744
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http-www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433744.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433745
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http-www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433745.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433746
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http-_www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433746.dump

[wyatt8740]

If it ever finishes I will upload the dumps.

[HalosGhost]

This issue (hanging after downloading configurations) appears also for the DailyShow extractor (see #2573).

[friedretinas]

@wyatt8740 Worked fine for me, but I specified that the 3.31 version of the Python interpreter (whereas you are Python version 2.7.3) when launching youtube-dl script.

Make sure you also have "pthyon3" package installed and try again. Assuming youtube-dl is installed in /usr/bin , the following will invoke it using Python 3 interpreter (instead of the default 2.7.3. version that is apparently the DEFAULT version on your system).

python3 /usr/bin/youtube-dl -v http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama

[phihag]

With the recent updates, this should work fine now. If it doesn't, please comment and we'll reopen this issue.

[bartpolot]

Seems to be broken as of v2014.07.30:

$ youtube-dl --verbose http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', 'http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.07.30
[debug] Python version 3.4.1 - Linux-3.15.5-2-ARCH-x86_64-with-arch
[debug] Proxy map: {}
[generic] thu-march-13-2014-simon-schama: Requesting header
[redirect] Following redirect to http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama
[ComedyCentralShows] march-13--2014---simon-schama: Downloading webpage
ERROR: unable to find Flash URL in webpage http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 516, in extract_info
ie_result = ie.extract(url)
File "/usr/lib/python3.4/site-packages/youtube_dl/extractor/common.py", line 170, in extract
return self._real_extract(url)
File "/usr/lib/python3.4/site-packages/youtube_dl/extractor/comedycentral.py", line 143, in _real_extract
raise ExtractorError('unable to find Flash URL in webpage ' + url)
youtube_dl.utils.ExtractorError: unable to find Flash URL in webpage http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

[friedretinas]

Used to work, but I just tried the same I got the same errors as bartpolot did. I then tried with a related URL but that yielded a different set of errors as shown.

$ youtube-dl -v http://thecolbertreport.cc.com/video-playlists/mp16x2/colbert-report-10078
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://thecolbertreport.cc.com/video-playlists/mp16x2/colbert-report-10078']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.08.02.1
[debug] Python version 3.3.1 - Linux-3.8.0-35-generic-x86_64-with-Peppermint-4-raring
[debug] Proxy map: {}
[ComedyCentralShows] colbert-report-10078: Downloading webpage
[ComedyCentralShows] colbert-report-10078: Downloading show index
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 1 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 2 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 3 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 4 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 5 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 6 / 6
[download] Downloading playlist: thecolbertreport Colbert Report 10078
[ComedyCentralShows] playlist thecolbertreport Colbert Report 10078: Collected 6 video ids (downloading 6 of them)
[download] Downloading video #1 of 6
[debug] Invoking downloader on 'http://mtvnmobile.vo.llnwd.net/kip0/_pxn=1+_pxI0=Ripod-h264+_pxL0=undefined+_pxM0=+_pxK=18639+_pxE=mp4/44620/mtvnorigin/gsp.comedystor/com/colbert/season_10/episode_078/cr_10078_01_1280x720_3500_h32.mp4'
ERROR: unable to download video data: HTTP Error 400: Bad Request
Traceback (most recent call last):
File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1022, in process_info
success = dl(filename, info_dict)
File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 998, in dl
return fd.download(name, info)
File "/usr/bin/youtube-dl/youtube_dl/downloader/common.py", line 291, in download
return self.real_download(filename, info_dict)
File "/usr/bin/youtube-dl/youtube_dl/downloader/http.py", line 58, in real_download
data = self.ydl.urlopen(request)
File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1231, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python3.3/urllib/request.py", line 479, in open
response = meth(req, response)
File "/usr/lib/python3.3/urllib/request.py", line 591, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.3/urllib/request.py", line 517, in error
return self._call_chain(_args)
File "/usr/lib/python3.3/urllib/request.py", line 451, in _call_chain
result = func(_args)
File "/usr/lib/python3.3/urllib/request.py", line 599, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 400: Bad Request

[jaimeMF]

@friedretinas That's a known issue: #3364.