[pbs] 403 on subtitles causing error

[gesa]

• I've verified and I assure that I'm running youtube-dl 2018.08.04
• At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones
• Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

verbose output

[~] youtube-dl --verbose -o ~/Movies/Downloads/NOVA/%(title)s.%(ext)s https://www.pbs.org/video/nova-why-sharks-attack/
[debug] System config: []
[debug] User config: [u'-n', u'-f', u'bestvideo[ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', u'-o', u'~/Movies/Downloads/%(title)s.%(ext)s', u'--write-sub', u'--write-auto-sub', u'--sub-format', u'srt', u'--sub-lang', u'en', u'--convert-subs', u'srt', u'--embed-subs', u'--add-metadata']
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'-o', u'/Users/aki/Movies/Downloads/NOVA/%(title)s.%(ext)s', u'https://www.pbs.org/video/nova-why-sharks-attack/']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.08.04
[debug] Python version 2.7.10 (CPython) - Darwin-17.7.0-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg 4.0.1, ffprobe 4.0.1, rtmpdump 2.4
[debug] Proxy map: {}
[debug] Using fake IP 3.177.141.80 (US) as X-Forwarded-For.
[pbs] Downloading JSON metadata
[pbs] nova-why-sharks-attack: Downloading webpage
[pbs] nova-why-sharks-attack: Downloading widget/partnerplayer page
[pbs] nova-why-sharks-attack: Downloading portalplayer page
[pbs] nova-why-sharks-attack: Downloading 0 video url info
[pbs] nova-why-sharks-attack: Downloading m3u8 information
[pbs] nova-why-sharks-attack: Downloading 1 video url info
[pbs] nova-why-sharks-attack: Downloading m3u8 information
[pbs] nova-why-sharks-attack: Downloading 2 video url info
[pbs] nova-why-sharks-attack: Downloading 3 video url info
[pbs] nova-why-sharks-attack: Checking http-1200k video URL
[pbs] nova-why-sharks-attack: Checking http-2500k video URL
[pbs] nova-why-sharks-attack: Checking http-800k video URL
[pbs] nova-why-sharks-attack: Checking http-400k video URL
[info] Writing video subtitles to: /Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.en.srt
WARNING: Unable to download subtitle for "en": Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[debug] Invoking downloader on u'https://ga.video.cdn.pbs.org/videos/nova/4f971176-c18e-4939-8207-7e2db70b0e05/131516/hd-mezzanine-16x9/3e646f76_nova4111_new_mezz16x9-16x9-mp4-2500k.mp4'
[download] Destination: /Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.mp4
[download] 100% of 1002.36MiB in 01:01
[ffmpeg] Adding metadata to '/Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.mp4'
[debug] ffmpeg command line: ffmpeg -y -i 'file:/Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.mp4' -c copy -metadata 'comment=Will analyzing the hunting instincts of this endangered predator reduce deadly attacks?' -metadata 'purl=https://www.pbs.org/video/nova-why-sharks-attack/' -metadata 'description=Will analyzing the hunting instincts of this endangered predator reduce deadly attacks?' -metadata 'title=NOVA - Why Sharks Attack' 'file:/Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.temp.mp4'
[ffmpeg] Converting subtitles
[ffmpeg] Subtitle file for srt is already in the requested format
[ffmpeg] Embedding subtitles in '/Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.mp4'
Traceback (most recent call last):
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/bin/youtube-dl/__main__.py", line 19, in <module>
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 472, in main
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 462, in _real_main
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2001, in download
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 803, in extract_info
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 857, in process_ie_result
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1635, in process_video_result
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1982, in process_info
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2047, in post_process
  File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 393, in run
  File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 182, in run_ffmpeg_multiple_files
  File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 182, in <genexpr>
OSError: [Errno 2] No such file or directory: '/Users/aki/Movies/Downloads/NOVA/NOVA - Why Sharks Attack.en.srt'

output ignoring config

youtube-dl --write-sub --verbose --ignore-config -o ~/Movies/%(title)s.%(ext)s https://www.pbs.org/video/nova-why-sharks-attack/

[~] youtube-dl --write-sub --verbose --ignore-config -o ~/Movies/%(title)s.%(ext)s https://www.pbs.org/video/nova-why-sharks-attack/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--write-sub', u'--verbose', u'--ignore-config', u'-o', u'/Users/aki/Movies/%(title)s.%(ext)s', u'https://www.pbs.org/video/nova-why-sharks-attack/']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.08.04
[debug] Python version 2.7.10 (CPython) - Darwin-17.7.0-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg 4.0.1, ffprobe 4.0.1, rtmpdump 2.4
[debug] Proxy map: {}
[debug] Using fake IP 3.101.231.252 (US) as X-Forwarded-For.
[pbs] Downloading JSON metadata
[pbs] nova-why-sharks-attack: Downloading webpage
[pbs] nova-why-sharks-attack: Downloading widget/partnerplayer page
[pbs] nova-why-sharks-attack: Downloading portalplayer page
[pbs] nova-why-sharks-attack: Downloading 0 video url info
[pbs] nova-why-sharks-attack: Downloading m3u8 information
[pbs] nova-why-sharks-attack: Downloading 1 video url info
[pbs] nova-why-sharks-attack: Downloading m3u8 information
[pbs] nova-why-sharks-attack: Downloading 2 video url info
[pbs] nova-why-sharks-attack: Downloading 3 video url info
[pbs] nova-why-sharks-attack: Checking http-1200k video URL
[pbs] nova-why-sharks-attack: Checking http-2500k video URL
[pbs] nova-why-sharks-attack: Checking http-800k video URL
[pbs] nova-why-sharks-attack: Checking http-400k video URL
[debug] Default format spec: bestvideo+bestaudio/best
[info] Writing video subtitles to: /Users/aki/Movies/NOVA - Why Sharks Attack.en.vtt
WARNING: Unable to download subtitle for "en": Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[debug] Invoking downloader on u'https://ga.video.cdn.pbs.org/videos/nova/4f971176-c18e-4939-8207-7e2db70b0e05/131516/hd-mezzanine-16x9/3e646f76_nova4111_new_mezz16x9-16x9-mp4-2500k.mp4'
[download] Destination: /Users/aki/Movies/NOVA - Why Sharks Attack.mp4
[download] 100% of 1002.36MiB in 01:53

lists-subs output

youtube-dl --list-subs --verbose --ignore-config https://www.pbs.org/video/nova-why-sharks-attack/

[~] youtube-dl --list-subs --verbose --ignore-config https://www.pbs.org/video/nova-why-sharks-attack/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--list-subs', u'--verbose', u'--ignore-config', u'https://www.pbs.org/video/nova-why-sharks-attack/']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.08.04
[debug] Python version 2.7.10 (CPython) - Darwin-17.7.0-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg 4.0.1, ffprobe 4.0.1, rtmpdump 2.4
[debug] Proxy map: {}
[debug] Using fake IP 3.97.19.77 (US) as X-Forwarded-For.
[pbs] Downloading JSON metadata
[pbs] nova-why-sharks-attack: Downloading webpage
[pbs] nova-why-sharks-attack: Downloading widget/partnerplayer page
[pbs] nova-why-sharks-attack: Downloading portalplayer page
[pbs] nova-why-sharks-attack: Downloading 0 video url info
[pbs] nova-why-sharks-attack: Downloading m3u8 information
[pbs] nova-why-sharks-attack: Downloading 1 video url info
[pbs] nova-why-sharks-attack: Downloading m3u8 information
[pbs] nova-why-sharks-attack: Downloading 2 video url info
[pbs] nova-why-sharks-attack: Downloading 3 video url info
[pbs] nova-why-sharks-attack: Checking http-1200k video URL
[pbs] nova-why-sharks-attack: Checking http-2500k video URL
[pbs] nova-why-sharks-attack: Checking http-800k video URL
[pbs] nova-why-sharks-attack: Checking http-400k video URL
Available subtitles for 2365239251:
Language formats
en       vtt, srt, ttml

Description of your issue, suggested solution and other information

Download is warning with a 403 when downloading subtitles, then failing when attempting to embed those subtitles on the downloaded video file. It's happened on several different videos, but consistently with those videos. The videos in question do require auth, but that does not make them unique—other downloads are proceeding fine with auth (in ~/.netrc). The files ultimately save, but without subtitles.