Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

doesn't work with The Daily Show full episodes #2803

Closed
swilbur opened this issue Apr 25, 2014 · 8 comments
Closed

doesn't work with The Daily Show full episodes #2803

swilbur opened this issue Apr 25, 2014 · 8 comments

Comments

@swilbur
Copy link

@swilbur swilbur commented Apr 25, 2014

youtube-dl works fine with individual episode clips, (from http://thedailyshow.cc.com/videos) but fails when attempting to download from the 'full episodes' page (http://www.thedailyshow.com/full-episodes):

$ youtube-dl http://www.thedailyshow.com/full-episodes --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['http://www.thedailyshow.com/full-episodes', '--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.04.21.6
[debug] Python version 2.7.6 - Linux-3.13-1-amd64-x86_64-with-debian-jessie-sid
[debug] Proxy map: {}
[generic] full-episodes: Requesting header
[redirect] Following redirect to http://thedailyshow.cc.com/episodes/rg6cx7/april-24--2014---ramachandra-guha
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading webpage
ERROR: unable to find Flash URL in webpage http://thedailyshow.cc.com/episodes/rg6cx7/april-24--2014---ramachandra-guha; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 514, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 161, in extract
return self._real_extract(url)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/comedycentral.py", line 143, in _real_extract
raise ExtractorError('unable to find Flash URL in webpage ' + url)
ExtractorError: unable to find Flash URL in webpage http://thedailyshow.cc.com/episodes/rg6cx7/april-24--2014---ramachandra-guha; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

@AGSPhoenix
Copy link
Contributor

@AGSPhoenix AGSPhoenix commented Apr 25, 2014

Works for me. Can you play the video in your browser? If you're located outside the US, it may be that Comedy Central won't let you view it due to advertising agreements.

If you can watch it in your browser, could you run the command again with the --dump-intermediate-pages option, and post the results.

@swilbur
Copy link
Author

@swilbur swilbur commented Apr 28, 2014

Oh, that could be it. (I'm currently in France.) I assumed it was a problem with youtube-dl being out of date since it used to work fine, but stopped working when the layout of The Daily Show website changed. I guess the only 'problem' here is that they aren't checking IP location from the 'single clips' page. (and please don't inform them of this fact :) )

@Hamuko
Copy link

@Hamuko Hamuko commented Apr 30, 2014

Works fine for me, even though I'm in Finland and see the 'We're sorry, but this video isn't available in your location'. Not sure if there's some secondary region blocking in place as well.

> youtube-dl http://thedailyshow.cc.com/full-episodes/rg6cx7/april-24--2014---ramachandra-guha
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading webpage
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading show index
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading configuration for segment 1 / 4
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading configuration for segment 2 / 4
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading configuration for segment 3 / 4
[ComedyCentralShows] april-24--2014---ramachandra-guha: Downloading configuration for segment 4 / 4
[download] Downloading playlist: thedailyshow April 24, 2014 - Ramachandra Guha
[ComedyCentralShows] playlist thedailyshow April 24, 2014 - Ramachandra Guha: Collected 4 video ids (downloading 4 of them)
[download] Downloading video #1 of 4
[download] Destination: thedailyshow april-24--2014---ramachandra-guha part 1.mp4
[download]  16.2% of 235.95MiB at  1.99MiB/s ETA 01:39
@AGSPhoenix
Copy link
Contributor

@AGSPhoenix AGSPhoenix commented Apr 30, 2014

@swilbur, do you need any more help, or should this issue be closed?

@harayz
Copy link

@harayz harayz commented Oct 12, 2014

i have a slightly but similar problem where i am located outside the US and had to use VPN to watch the show online. at first try, it failed to download and since i was using VPN (and Tor proxy) i tried using the '--proxy' but still no success. below are the logs for anybody who might be able to find if there is anything can be done here. thanks~

LOG 1

root@kali:~# youtube-dl http://thedailyshow.cc.com/full-episodes/4iaj5r/october-8--2014---leon-panetta --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['http://thedailyshow.cc.com/full-episodes/4iaj5r/october-8--2014---leon-panetta', '--verbose']
[debug] Encodings: locale ANSI_X3.4-1968, fs ANSI_X3.4-1968, out ANSI_X3.4-1968, pref ANSI_X3.4-1968
[debug] youtube-dl version 2014.10.05.2
[debug] Python version 2.7.8 - Linux-3.14-kali1-amd64-x86_64-with-debian-1.0.9
[debug] Proxy map: {}
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading webpage
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading show index
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading configuration for segment 1 / 4
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading configuration for segment 2 / 4
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading configuration for segment 3 / 4
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading configuration for segment 4 / 4
[download] Downloading playlist: thedailyshow October 8, 2014 - Leon Panetta
[ComedyCentralShows] playlist thedailyshow October 8, 2014 - Leon Panetta: Collected 4 video ids (downloading 4 of them)
[download] Downloading video #1 of 4
[debug] Invoking downloader on u'rtmpe://viacommtvstrmfs.fplive.net/viacommtvstrm/gsp.comedystor/com/dailyshow/TDS/season_20/episode_007/ds_20007_act1_1280x720_3500_h32.mp4'
[download] Destination: thedailyshow october-8--2014---leon-panetta part 1-9572dd58-5ee5-454f-afdd-ddc63964c891.mp4
[debug] rtmpdump command line: rtmpdump --verbose -r rtmpe://viacommtvstrmfs.fplive.net/viacommtvstrm/gsp.comedystor/com/dailyshow/TDS/season_20/episode_007/ds_20007_act1_1280x720_3500_h32.mp4 -o 'thedailyshow october-8--2014---leon-panetta part 1-9572dd58-5ee5-454f-afdd-ddc63964c891.mp4.part' --resume --skip 1
[rtmpdump] RTMPDump v2.4
rtmpdump 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
[rtmpdump] DEBUG: Parsing...
[rtmpdump] DEBUG: Parsed protocol: 2
[rtmpdump] DEBUG: Parsed host : viacommtvstrmfs.fplive.net
[rtmpdump] DEBUG: Parsed app : viacommtvstrm/gsp.comedystor/com
[rtmpdump] DEBUG: Number of skipped key frames for resume: 1
[rtmpdump] DEBUG: Protocol : RTMPE
[rtmpdump] DEBUG: Hostname : viacommtvstrmfs.fplive.net
[rtmpdump] DEBUG: Port : 1935
[rtmpdump] DEBUG: Playpath : mp4:dailyshow/TDS/season_20/episode_007/ds_20007_act1_1280x720_3500_h32
[rtmpdump] DEBUG: tcUrl : rtmpe://viacommtvstrmfs.fplive.net:1935/viacommtvstrm/gsp.comedystor/com
[rtmpdump] DEBUG: app : viacommtvstrm/gsp.comedystor/com
[rtmpdump] DEBUG: live : no
[rtmpdump] DEBUG: timeout : 30 sec
[rtmpdump] DEBUG: Failed to get last keyframe.
[rtmpdump] DEBUG: Closing connection.
[rtmpdump] 0 bytes
[rtmpdump] RTMPDump v2.4
rtmpdump 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
[rtmpdump] DEBUG: Parsing...
[rtmpdump] DEBUG: Parsed protocol: 2
[rtmpdump] DEBUG: Parsed host : viacommtvstrmfs.fplive.net
[rtmpdump] DEBUG: Parsed app : viacommtvstrm/gsp.comedystor/com
[rtmpdump] DEBUG: Number of skipped key frames for resume: 1
[rtmpdump] DEBUG: Protocol : RTMPE
[rtmpdump] DEBUG: Hostname : viacommtvstrmfs.fplive.net
[rtmpdump] DEBUG: Port : 1935
[rtmpdump] DEBUG: Playpath : mp4:dailyshow/TDS/season_20/episode_007/ds_20007_act1_1280x720_3500_h32
[rtmpdump] DEBUG: tcUrl : rtmpe://viacommtvstrmfs.fplive.net:1935/viacommtvstrm/gsp.comedystor/com
[rtmpdump] DEBUG: app : viacommtvstrm/gsp.comedystor/com
[rtmpdump] DEBUG: live : no
[rtmpdump] DEBUG: timeout : 30 sec
[rtmpdump] DEBUG: Failed to get last keyframe.
[rtmpdump] DEBUG: Closing connection.

ERROR: rtmpdump exited with code 1
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 18, in
youtube_dl.main()
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 431, in main
_real_main(argv)
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 421, in _real_main
retcode = ydl.download(all_urls)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1067, in download
self.extract_info(url)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 535, in extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 659, in process_ie_result
extra_info=extra)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 577, in process_ie_result
return self.process_video_result(ie_result, download=download)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 845, in process_video_result
self.process_info(new_info)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1037, in process_info
success = dl(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1013, in dl
return fd.download(name, info)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 292, in download
return self.real_download(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/rtmp.py", line 200, in real_download
self.report_error('rtmpdump exited with code %d' % retval)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 145, in report_error
self.ydl.report_error(_args, *_kargs)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 410, in report_error
self.trouble(error_message, tb)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 372, in trouble
tb_data = traceback.format_list(traceback.extract_stack())

root@kali:~#

LOG 2

root@kali:~# youtube-dl --proxy http://192.168.2.2:6379 http://thedailyshow.cc.com/full-episodes/4iaj5r/october-8--2014---leon-panetta --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--proxy', 'http://192.168.2.2:6379', 'http://thedailyshow.cc.com/full-episodes/4iaj5r/october-8--2014---leon-panetta', '--verbose']
[debug] Encodings: locale ANSI_X3.4-1968, fs ANSI_X3.4-1968, out ANSI_X3.4-1968, pref ANSI_X3.4-1968
[debug] youtube-dl version 2014.10.05.2
[debug] Python version 2.7.8 - Linux-3.14-kali1-amd64-x86_64-with-debian-1.0.9
[debug] Proxy map: {u'http': 'http://192.168.2.2:6379', u'https': 'http://192.168.2.2:6379'}
[ComedyCentralShows] october-8--2014---leon-panetta: Downloading webpage
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 18, in
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 431, in main

File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 421, in _real_main

File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1067, in download
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 524, in extract_info
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 193, in extract
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/comedycentral.py", line 152, in _real_extract
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 251, in _download_webpage_handle
File "/usr/lib/python2.7/socket.py", line 351, in read
data = self._sock.recv(rbufsize)
File "/usr/lib/python2.7/httplib.py", line 567, in read
s = self.fp.read(amt)
File "/usr/lib/python2.7/httplib.py", line 1335, in read
return s + self._file.read(amt - len(s))
File "/usr/lib/python2.7/socket.py", line 380, in read
data = self._sock.recv(left)
socket.timeout: timed out

@gaenserich
Copy link

@gaenserich gaenserich commented Apr 28, 2015

I can confirm having a similar issue in the US, no proxy or vpn, and can access the original page just fine. Here's my verbose output:

$  youtube-dl --verbose "http://thedailyshow.cc.com/full-episodes/6ihlbu/april-27--2015---elizabeth-olsen"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', 'http://thedailyshow.cc.com/full-episodes/6ihlbu/april-27--2015---elizabeth-olsen']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.04.17
[debug] Python version 3.4.3 - Linux-3.19.3-3-ARCH-x86_64-with-arch-Arch-Linux
[debug] exe versions: ffmpeg 2.6.2, ffprobe 2.6.2, rtmpdump 2.4
[debug] Proxy map: {}
[ComedyCentralShows] april-27--2015---elizabeth-olsen: Downloading webpage
[ComedyCentralShows] april-27--2015---elizabeth-olsen: Downloading show index
[ComedyCentralShows] april-27--2015---elizabeth-olsen: Downloading configuration for segment 1 / 4
[ComedyCentralShows] april-27--2015---elizabeth-olsen: Downloading configuration for segment 2 / 4
[ComedyCentralShows] april-27--2015---elizabeth-olsen: Downloading configuration for segment 3 / 4
[ComedyCentralShows] april-27--2015---elizabeth-olsen: Downloading configuration for segment 4 / 4
[download] Downloading playlist: thedailyshow April 27, 2015 - Elizabeth Olsen
[ComedyCentralShows] playlist thedailyshow April 27, 2015 - Elizabeth Olsen: Collected 4 video ids (downloading 4 of them)
[download] Downloading video 1 of 4
ERROR: No video formats found!; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 662, in extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 821, in process_ie_result
    extra_info=extra)
  File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 708, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 1047, in process_video_result
    raise ExtractorError('No video formats found!')
youtube_dl.utils.ExtractorError: No video formats found!; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Here are the dependencies I have installed:

python 3.4.3-2
python-setuptools 1:15.2-1
ffmpeg 1:2.6.2-1 (custom build with libfdk-aac, libopus added, and libpulse, libtheora, opencore-amr, schroedinger, speex, libbluray, libmodplug removed)
rtmpdump 20140918-2
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Apr 28, 2015

@gaenserich you are using an outdated version of youtube-dl.

@yan12125
Copy link
Collaborator

@yan12125 yan12125 commented Jul 26, 2016

All TDS URLs mentioned here now redirect to cc.com. However, playlists on cc.com are not supported yet. Please move to #10003 for further discussion.

@yan12125 yan12125 closed this Jul 26, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
7 participants
You can’t perform that action at this time.