Skip to content

/ youtube-dl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CBS] Getting errors on subtitles #9971

Open
keybounce opened this issue Jul 1, 2016 · 6 comments
Open

[CBS] Getting errors on subtitles #9971

keybounce opened this issue Jul 1, 2016 · 6 comments
Labels
geo-restricted subtitles

Comments

@keybounce
Copy link

@keybounce keybounce commented Jul 1, 2016

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like that [x])
  • Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.07.01. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

  • [ x] I've verified and I assure that I'm running youtube-dl 2016.07.01

Before submitting an issue make sure you have:

  • [x ] At least skimmed through README and most notably FAQ and BUGS sections
  • [x ] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • [ x] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

I am getting errors on subtitles from CBS on Colbert Report. I suspect I'm doing something wrong. What am I doing wrong?

keybounceMBP:Colbert michael$ youtube-dl -v http://www.cbs.com/shows/the-late-show-with-stephen-colbert/video/CqL6j94f0bp2b
1ItuczaM_DpwYUvnF_G/the-late-show-6-28-2016-tom-brokaw-sarah-erin-foster-bibi-bourelly-/
[debug] System config: []
[debug] User config: [u'--no-mtime', u'-o', u'%(title)s.%(ext)s', u'-f', u'best[ext=mp4][height=480]/bestvideo[ext=mp4][height=480]+bestaudio[ext=m4a]/best[ext=mp4][height>360][height<=480]/bestvideo[ext=mp4][height>360][height<=480]+bestaudio/best[height>360][height<=480]/bestvideo[height>360][height<=480]+bestaudio/best[ext=mp4][height>=280][height<=360]/best[height<=480]/worst', u'--write-sub', u'--embed-subs', u'--recode-video', u'mp4']
[debug] Command-line args: [u'-v', u'http://www.cbs.com/shows/the-late-show-with-stephen-colbert/video/CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G/the-late-show-6-28-2016-tom-brokaw-sarah-erin-foster-bibi-bourelly-/']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.07.01
[debug] Python version 2.7.5 - Darwin-13.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.0.2, ffprobe 3.0.2, rtmpdump 2.4
[debug] Proxy map: {}
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Downloading JSON metadata
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Downloading SMIL data for RTMP
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Downloading SMIL data for StreamPack
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Downloading m3u8 information
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Downloading SMIL data for OnceURL
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Checking video URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Downloading m3u8 information
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-1200 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-1200 video format URL is invalid, skipping
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-4400 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-4400 video format URL is invalid, skipping
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-2000 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-2000 video format URL is invalid, skipping
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-764 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-764 video format URL is invalid, skipping
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-512 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-512 video format URL is invalid, skipping
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-264 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-264 video format URL is invalid, skipping
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: Checking http-60 video format URL
[CBS] c97625f7-04ac-4de7-9e61-2d72e549fda4: http-60 video format URL is invalid, skipping
[CBS] CqL6j94f0bp2b1ItuczaM_DpwYUvnF_G: Downloading JSON metadata
[info] Writing video subtitles to: The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).en.ttml
[debug] Invoking downloader on u'https://cbsios-vh.akamaihd.net/i/temp_hd_gallery_video/CBS_Production_Outlet_VMS/video_robot/CBS_Production_Entertainment/2016/06/27/713946179638/CBS_COLBERT_0169_CONTENT_CIAN_steamclip_857002_,1848,3596,2596,1248,848,548,298,158,000.mp4.csmil/index_3_av.m3u8?null=0&id=AgAtGeZDuFfDD1fddVds1TR1CSUNvPPgAWbtk+CeT4bLv2AHRcSNpnQVMFYVwsV%2f5Au02e0YZrrgHg%3d%3d'
[download] Destination: The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).mp4
[debug] ffmpeg command line: ffmpeg -y -headers 'Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip, deflate
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Cookie: _alid_=wMNzfo6jSC8VLy1YfuocDA==; hdntl=exp=1467428567~acl=%2fi%2ftemp_hd_gallery_video%2fCBS_Production_Outlet_VMS%2fvideo_robot%2fCBS_Production_Entertainment%2f2016%2f06%2f27%2f713946179638%2fCBS_COLBERT_0169_CONTENT_CIAN_steamclip_857002_*~data=hdntl~hmac=bc301f9fc1f3744fed2398840d083011d1be4b15e9abaed78f41c4253f0c1f54
' -i 'https://cbsios-vh.akamaihd.net/i/temp_hd_gallery_video/CBS_Production_Outlet_VMS/video_robot/CBS_Production_Entertainment/2016/06/27/713946179638/CBS_COLBERT_0169_CONTENT_CIAN_steamclip_857002_,1848,3596,2596,1248,848,548,298,158,000.mp4.csmil/index_3_av.m3u8?null=0&id=AgAtGeZDuFfDD1fddVds1TR1CSUNvPPgAWbtk+CeT4bLv2AHRcSNpnQVMFYVwsV%2f5Au02e0YZrrgHg%3d%3d' -c copy -f mp4 -bsf:a aac_adtstoasc 'file:The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).mp4.part'
ffmpeg version 3.0.2 Copyright (c) 2000-2016 the FFmpeg developers
  built with Apple LLVM version 6.0 (clang-600.0.57) (based on LLVM 3.5svn)
  configuration: --prefix=/opt/local --enable-swscale --enable-avfilter --enable-avresample --enable-libmp3lame --enable-libvorbis --enable-libopus --enable-libtheora --enable-libschroedinger --enable-libopenjpeg --enable-libmodplug --enable-libvpx --enable-libsoxr --enable-libspeex --enable-libass --enable-libbluray --enable-lzma --enable-gnutls --enable-fontconfig --enable-libfreetype --enable-libfribidi --disable-libxcb --disable-libxcb-shm --disable-libxcb-xfixes --disable-indev=jack --disable-outdev=xv --mandir=/opt/local/share/man --enable-shared --enable-pthreads --cc=/usr/bin/clang --enable-vda --enable-videotoolbox --arch=x86_64 --enable-yasm --enable-gpl --enable-postproc --enable-libx264 --enable-libxvid
  libavutil      55. 17.103 / 55. 17.103
  libavcodec     57. 24.102 / 57. 24.102
  libavformat    57. 25.100 / 57. 25.100
  libavdevice    57.  0.101 / 57.  0.101
  libavfilter     6. 31.100 /  6. 31.100
  libavresample   3.  0.  0 /  3.  0.  0
  libswscale      4.  0.100 /  4.  0.100
  libswresample   2.  0.101 /  2.  0.101
  libpostproc    54.  0.100 / 54.  0.100
Input #0, hls,applehttp, from 'https://cbsios-vh.akamaihd.net/i/temp_hd_gallery_video/CBS_Production_Outlet_VMS/video_robot/CBS_Production_Entertainment/2016/06/27/713946179638/CBS_COLBERT_0169_CONTENT_CIAN_steamclip_857002_,1848,3596,2596,1248,848,548,298,158,000.mp4.csmil/index_3_av.m3u8?null=0&id=AgAtGeZDuFfDD1fddVds1TR1CSUNvPPgAWbtk+CeT4bLv2AHRcSNpnQVMFYVwsV%2f5Au02e0YZrrgHg%3d%3d':
  Duration: 00:41:22.43, start: 0.100511, bitrate: 0 kb/s
  Program 0 
    Metadata:
      variant_bitrate : 0
    Stream #0:0: Video: h264 (Main) ([27][0][0][0] / 0x001B), yuv420p, 768x432 [SAR 1:1 DAR 16:9], 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc
    Stream #0:1: Audio: aac (LC) ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 5 kb/s
Output #0, mp4, to 'file:The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).mp4.part':
  Metadata:
    encoder         : Lavf57.25.100
    Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 768x432 [SAR 1:1 DAR 16:9], q=2-31, 29.97 fps, 29.97 tbr, 90k tbn, 90k tbc
    Stream #0:1: Audio: aac (LC) ([64][0][0][0] / 0x0040), 44100 Hz, stereo, 5 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
frame=74398 fps=233 q=-1.0 Lsize=  388963kB time=00:41:22.44 bitrate=1283.6kbits/s speed=7.77x    
video:356436kB audio:29077kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.895002%
[ffmpeg] Downloaded 398298203 bytes
[download] 100% of 379.85MiB
[ffmpeg] Not converting video file The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).mp4 - already is in target format mp4
[ffmpeg] Embedding subtitles in 'The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).mp4'
[debug] ffmpeg command line: ffmpeg -y -i 'file:The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).mp4' -i 'file:The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).en.ttml' -map 0 -c copy -map -0:s -c:s mov_text -map 1:0 -metadata:s:s:0 language=eng 'file:The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).temp.mp4'
ERROR: file:The Late Show - 6_28_2016 (Tom Brokaw, Sara & Erin Foster, Bibi Bourelly).en.ttml: Invalid data found when processing input
Traceback (most recent call last):
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1786, in post_process
    files_to_delete, info = pp.run(info)
  File "/Users/michael/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 382, in run
    self.run_ffmpeg_multiple_files(input_files, temp_filename, opts)
  File "/Users/michael/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 168, in run_ffmpeg_multiple_files
    raise FFmpegPostProcessorError(msg)
FFmpegPostProcessorError

keybounceMBP:Colbert michael$
@yan12125 yan12125 changed the title Getting errors on subtitles [CBS] Getting errors on subtitles Jul 1, 2016
@remitamine
Copy link
Collaborator

@remitamine remitamine commented Jul 1, 2016

ffmpeg doesn't support ttml subtitles.
@yan12125
Copy link
Collaborator

@yan12125 yan12125 commented Jul 1, 2016

Good catch. Maybe a better error message in such cases?
@remitamine
Copy link
Collaborator

@remitamine remitamine commented Jul 1, 2016

yes, we should make sure that youtube-dl allow to embed only for subtitles supported by ffmpeg and the container and maybe add fixup by embeding in mkv or convert the subtitle before embeding.
@yan12125
Copy link
Collaborator

@yan12125 yan12125 commented Jul 1, 2016

I prefer just an error message instead of converting subtitles automatically. Maybe some people want to embed srt while others vtt.

By the way, can TTML subtitles be merged into mkv?
@yan12125 yan12125 added the subtitles label Jul 1, 2016
@keybounce
Copy link
Author

@keybounce keybounce commented Jul 18, 2016

Is there any way to request a different format of subtitle that FFMPEG can work with?
@HeroCC
Copy link

@HeroCC HeroCC commented Oct 9, 2017

Similar error here with TTML subs from PBS:

youtube-dl --write-info-json --write-description --all-subs --embed-subs --embed-thumbnail --add-metadata -a links.txt -o "%(title)s/%(title)s-%(id)s-%(resolution)s.%(ext)s"
[pbs] Downloading JSON metadata
[pbs] deja-vu-1858-1961-7tmfea: Downloading webpage
[pbs] 3004622993: Downloading widget/partnerplayer page
[pbs] 3004622993: Downloading portalplayer page
[pbs] 3004622993: Downloading hls-1080p-16x9 video url info
[pbs] 3004622993: Downloading m3u8 information
[pbs] 3004622993: Downloading mp4-2500k-16x9 video url info
[pbs] 3004622993: Downloading hls-16x9-720p video url info
[pbs] 3004622993: Downloading m3u8 information
[pbs] 3004622993: Checking http-2000k video URL
[pbs] 3004622993: http-2000k video URL is invalid, skipping
[pbs] 3004622993: Checking http-6500k video URL
[pbs] 3004622993: http-6500k video URL is invalid, skipping
[pbs] 3004622993: Checking http-4500k video URL
[pbs] 3004622993: http-4500k video URL is invalid, skipping
[pbs] 3004622993: Checking http-3000k video URL
[pbs] 3004622993: Checking http-1100k video URL
[pbs] 3004622993: http-1100k video URL is invalid, skipping
[pbs] 3004622993: Checking http-730k video URL
[pbs] 3004622993: http-730k video URL is invalid, skipping
[pbs] 3004622993: Checking http-730k video URL
[pbs] 3004622993: http-730k video URL is invalid, skipping
[pbs] 3004622993: Checking http-3000k video URL
[pbs] 3004622993: Checking http-2000k video URL
[pbs] 3004622993: http-2000k video URL is invalid, skipping
[pbs] 3004622993: Checking http-1100k video URL
[pbs] 3004622993: http-1100k video URL is invalid, skipping
[info] Writing video description to: The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-196
1)-3004622993-1920x1080.description
[info] Writing video subtitles to: The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)
-3004622993-1920x1080.en.ttml
[info] Writing video description metadata as JSON to: The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 -
Déjà Vu (1858-1961)-3004622993-1920x1080.info.json
[pbs] 3004622993: Downloading thumbnail ...
[pbs] 3004622993: Writing thumbnail to: The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-
1961)-3004622993-1920x1080.jpg
[download] Destination: The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)-3004622993
ffmpeg version 2.8.11-0ubuntu0.16.04.1 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.4) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linu
x-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth -
-enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreety
pe --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, hls,applehttp, from 'https://ga.video.cdn.pbs.org/videos/vietnam-war-not-edited/26403898-23c3-4157-a9ae-7e5ad3888707/2000008007/hd-16x9-mezzanine-1080p/xcw0xfeq_vwar0101_explicit_r-16x9-1080p-1080p-6500k.m3u8':
  Duration: 01:25:50.81, start: 2.050078, bitrate: 0 kb/s
  Program 0
    Metadata:
      variant_bitrate : 0
    Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc
    Stream #0:1: Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp, 96 kb/s
[mp4 @ 0x2f0c440] Codec for stream 0 does not use global headers but container format requires global headers
[mp4 @ 0x2f0c440] Codec for stream 1 does not use global headers but container format requires global headers
Output #0, mp4, to 'file:The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)-3004622993-1920x1080.mp4.part':
  Metadata:
    encoder         : Lavf56.40.101
    Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 29.97 fps, 29.97 tbr, 90k tbn, 90k tbc
    Stream #0:1: Audio: aac ([64][0][0][0] / 0x0040), 48000 Hz, stereo, 96 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
frame=154370 fps=162 q=-1.0 Lsize= 4150892kB time=01:25:50.82 bitrate=6601.7kbits/s
video:4087215kB audio:58711kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.119804%
[ffmpeg] Downloaded 4250513828 bytes
[download] 100% of 3.96GiB
[ffmpeg] Adding metadata to 'The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)-3004622993-1920x1080.mp4'
[ffmpeg] Embedding subtitles in 'The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)-3004622993-1920x1080.mp4'
ERROR: file:The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)/The Vietnam War _ Explicit Language Version - 01 - Déjà Vu (1858-1961)-3004622993-1920x1080.en.ttml: Invalid data found when processing input
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
geo-restricted subtitles
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
@keybounce @yan12125 @HeroCC @remitamine
You can’t perform that action at this time.