Skip to content

/ youtube-dl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PBS, again. Tried with multiple links to the same video. #14867

Open
DiagonalArg opened this issue Nov 28, 2017 · 7 comments
Open

PBS, again. Tried with multiple links to the same video. #14867

DiagonalArg opened this issue Nov 28, 2017 · 7 comments

Comments

@DiagonalArg
Copy link

@DiagonalArg DiagonalArg commented Nov 28, 2017 •
edited

$ ~/bin/youtube-dl --version
2017.11.26

Bug report:
DL'ing a PBS video. Three URL's for the same video, none of which work:

http://www.pbs.org/independentlens/videos/shadow-world-full-film/
https://video.ket.org/video/3002680390/
https://player.pbs.org/portalplayer/3002680390/

It seems the requests land on this video (see below):
https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8

Using advice found on the web, I made another attempt, changing m3u8 to mp4. When that didn't work, I got a lower resolution and tried the same. It also failed.

[The following long lines are not cut off, but they appear that way in preview and in the post.]

$ ~/bin/youtube-dl -v "http://player.pbs.org/portalplayer/3002680390/" -o PBS.mp4
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'http://player.pbs.org/portalplayer/3002680390/', u'-o', u'PBS.mp4']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.11.26
[debug] Python version 2.7.12 - Linux-4.4.0-101-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 2.8.11-0ubuntu0.16.04.1, avprobe 2.8.11-0ubuntu0.16.04.1, ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1, rtmpdump 2.4
[debug] Proxy map: {'socks': 'socks://localhost:9999/'}
[debug] Using fake IP 3.61.93.191 (US) as X-Forwarded-For.
[pbs] Downloading JSON metadata
[pbs] 3002680390: Downloading widget/partnerplayer page
[pbs] 3002680390: Downloading portalplayer page
[pbs] 3002680390: Downloading hls-16x9-1080p video url info
[pbs] 3002680390: Downloading m3u8 information
[pbs] 3002680390: Downloading mp4-16x9-720p video url info
[pbs] 3002680390: Downloading hls-16x9-720p video url info
[pbs] 3002680390: Downloading m3u8 information
[pbs] 3002680390: Checking http-2000k video URL
[pbs] 3002680390: http-2000k video URL is invalid, skipping
[pbs] 3002680390: Checking http-6500k video URL
[pbs] 3002680390: http-6500k video URL is invalid, skipping
[pbs] 3002680390: Checking http-4500k video URL
[pbs] 3002680390: http-4500k video URL is invalid, skipping
[pbs] 3002680390: Checking http-3000k video URL
[pbs] 3002680390: Checking http-1100k video URL
[pbs] 3002680390: http-1100k video URL is invalid, skipping
[pbs] 3002680390: Checking http-730k video URL
[pbs] 3002680390: http-730k video URL is invalid, skipping
[pbs] 3002680390: Checking http-730k video URL
[pbs] 3002680390: http-730k video URL is invalid, skipping
[pbs] 3002680390: Checking http-3000k video URL
[pbs] 3002680390: Checking http-2000k video URL
[pbs] 3002680390: http-2000k video URL is invalid, skipping
[pbs] 3002680390: Checking http-1100k video URL
[pbs] 3002680390: http-1100k video URL is invalid, skipping
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8'
[download] Destination: PBS.mp4
[debug] avconv command line: avconv -y -loglevel verbose -headers 'Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip, deflate
X-Forwarded-For: 3.61.93.191
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Cookie: pbsol.station=WNET
' -i 'https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8' -c copy -f mp4 'file:PBS.mp4.part'
ffmpeg version 2.8.11-0ubuntu0.16.04.1 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.4) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
[hls,applehttp @ 0x19da600] HLS request for url 'https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k_00001.ts', offset 0, playlist 0
Input #0, hls,applehttp, from 'https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8':
  Duration: 01:23:07.78, start: 2.050078, bitrate: 0 kb/s
  Program 0 
    Metadata:
      variant_bitrate : 0
    Stream #0:0: Video: h264 (High), 3 reference frames ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 (1920x1088) [SAR 1:1 DAR 16:9], 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc
    Stream #0:1: Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp, 96 kb/s
[mp4 @ 0x23d5bc0] Codec for stream 0 does not use global headers but container format requires global headers
[mp4 @ 0x23d5bc0] Codec for stream 1 does not use global headers but container format requires global headers
Output #0, mp4, to 'file:PBS.mp4.part':
  Metadata:
    encoder         : Lavf56.40.101
    Stream #0:0: Video: h264, 1 reference frame ([33][0][0][0] / 0x0021), yuv420p, 1920x1080 (0x0) [SAR 1:1 DAR 16:9], q=2-31, 29.97 fps, 29.97 tbr, 90k tbn, 90k tbc
    Stream #0:1: Audio: aac ([64][0][0][0] / 0x0040), 48000 Hz, stereo, 96 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
[mp4 @ 0x23d5bc0] Malformed AAC bitstream detected: use the audio bitstream filter 'aac_adtstoasc' to fix it ('-bsf:a aac_adtstoasc' option with ffmpeg)
av_interleaved_write_frame(): Operation not permitted
No more output streams to write to, finishing.
frame=   36 fps=0.0 q=-1.0 Lsize=    1071kB time=00:00:01.16 bitrate=7514.7kbits/s    
video:1070kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.083482%
Input file #0 (https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8):
  Input stream #0:0 (video): 36 packets read (1095791 bytes); 
  Input stream #0:1 (audio): 1 packets read (256 bytes); 
  Total: 37 packets (1096047 bytes) demuxed
Output file #0 (file:PBS.mp4.part):
  Output stream #0:0 (video): 36 packets muxed (1095791 bytes); 
  Output stream #0:1 (audio): 1 packets muxed (256 bytes); 
  Total: 37 packets (1096047 bytes) muxed
Conversion failed!


ERROR: ffmpeg exited with code 1
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/dev/bin/youtube-dl/__main__.py", line 19, in <module>
    youtube_dl.main()
  File "/home/dev/bin/youtube-dl/youtube_dl/__init__.py", line 465, in main
    _real_main(argv)
  File "/home/dev/bin/youtube-dl/youtube_dl/__init__.py", line 455, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1986, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 795, in extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 849, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1620, in process_video_result
    self.process_info(new_info)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1893, in process_info
    success = dl(filename, info_dict)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1832, in dl
    return fd.download(name, info)
  File "/home/dev/bin/youtube-dl/youtube_dl/downloader/common.py", line 361, in download
    return self.real_download(filename, info_dict)
  File "/home/dev/bin/youtube-dl/youtube_dl/downloader/external.py", line 57, in real_download
    self.get_basename(), retval))
  File "/home/dev/bin/youtube-dl/youtube_dl/downloader/common.py", line 163, in report_error
    self.ydl.report_error(*args, **kargs)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 612, in report_error
    self.trouble(error_message, tb)
  File "/home/dev/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 574, in trouble
    tb_data = traceback.format_list(traceback.extract_stack())
@wright546
Copy link

@wright546 wright546 commented Nov 28, 2017

I came here to report the same problem. Let me know if I can provide any other information that could be helpful.

9:42am ~ >./youtube-dl -v -F "http://www.pbs.org/video/natures-miniature-miracles-c7il7p/"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'http://www.pbs.org/video/natures-miniature-miracles-c7il7p/']
[debug] Encodings: locale US-ASCII, fs US-ASCII, out US-ASCII, pref US-ASCII
[debug] youtube-dl version 2017.11.26
[debug] Python version 2.7.13 - FreeBSD-10.3-RELEASE-p19-amd64-64bit-ELF
[debug] exe versions: ffmpeg 3.3.2, ffprobe 3.3.2
[debug] Proxy map: {}
[debug] Using fake IP 3.0.67.224 (US) as X-Forwarded-For.
[pbs] Downloading JSON metadata
[pbs] natures-miniature-miracles-c7il7p: Downloading webpage
[pbs] Downloading widget/partnerplayer page
WARNING: Unable to download webpage: HTTP Error 404: Not Found
[pbs] Downloading portalplayer page
WARNING: Unable to download webpage: HTTP Error 404: Not Found
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "./youtube-dl/youtube_dl/YoutubeDL.py", line 784, in extract_info
ie_result = ie.extract(url)
File "./youtube-dl/youtube_dl/extractor/common.py", line 437, in extract
ie_result = self._real_extract(url)
File "./youtube-dl/youtube_dl/extractor/pbs.py", line 589, in _real_extract
self._sort_formats(formats)
File "./youtube-dl/youtube_dl/extractor/common.py", line 1067, in _sort_formats
raise ExtractorError('No video formats found')
ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
@remitamine
Copy link
Collaborator

@remitamine remitamine commented Nov 28, 2017 •
edited

@wright546 it's not the same problem, #14865 (comment).
@DiagonalArg
Copy link
Author

@DiagonalArg DiagonalArg commented Nov 28, 2017

@remitamine - any suggestion for a work-around? I'd like to watch this vid, but it will only be around for a few more days. (I have a slow connection. If I want to watch it in decent resolution ...)
@gkoelln
Copy link
Contributor

@gkoelln gkoelln commented Nov 28, 2017 •
edited

Have you tried using this link directly in youtube-dl?
https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8
@DiagonalArg
Copy link
Author

@DiagonalArg DiagonalArg commented Nov 28, 2017

Thanks. I tried, but neither one works...
@gkoelln
Copy link
Contributor

@gkoelln gkoelln commented Nov 28, 2017

youtube-dl -v --hls-prefer-native "https://ga.video.cdn.pbs.org/videos/independent-lens/4421e28a-0b0b-493b-b6fd-11c468583171/2000017706/hd-16x9-mezzanine-1080p/8uzocjp4_inle1902-16x9-1080p-1080p-6500k.m3u8" -o PBS.mp4
@DiagonalArg
Copy link
Author

@DiagonalArg DiagonalArg commented Nov 28, 2017

@gkoelln - Yes, working. Thanks much. After that, I'll wait for the update.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
@wright546 @DiagonalArg @remitamine @gkoelln
You can’t perform that action at this time.