Some twitch VOD downloads fail with "Did not get any data blocks" after a certain %

[jleclanche]

• The following twitch vod fails at 24.3% download: https://www.twitch.tv/annemunition/v/58035908
• Fails at 40.8% download: https://www.twitch.tv/annemunition/v/56397653
• Fails at 92.7% download: https://www.twitch.tv/annemunition/v/58297678
• Fails at 33.0% download: https://www.twitch.tv/annemunition/v/67222289

Both stop with ERROR: Did not get any data blocks and freeze the machine for a while.

Reproduced on two different machines.

---

• I've verified and I assure that I'm running youtube-dl 2016.07.09.2
• At least skimmed through README and most notably FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones

---

• Bug report (encountered problems with youtube-dl)

$ youtube-dl --continue --verbose https://www.twitch.tv/annemunition/v/56397653
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--continue', '--verbose', 'https://www.twitch.tv/annemunition/v/56397653']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.07.09.2
[debug] Python version 3.5.2 - Linux-4.5.0-2-amd64-x86_64-with-debian-stretch-sid
[debug] exe versions: ffmpeg 3.0.2-4, ffprobe 3.0.2-4, rtmpdump 2.4
[debug] Proxy map: {}
[twitch:vod] 56397653: Downloading vod info JSON
[twitch:vod] 56397653: Downloading vod access token
[twitch:vod] 56397653: Downloading m3u8 information
[debug] Invoking downloader on 'http://vod.cf.hls.ttvnw.net/0e6317af1a_annemunition_20412075200_423860408/chunked/index-muted-RMAMSBLV41.m3u8'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 11473
[download] Destination: One order of JUSTICE, please.-v56397653.mp4
[download]  40.8% of ~9.51GiB at Unknown speed ETA Unknown ETA

ERROR: Did not get any data blocks
  File "/home/admin/hs/bin/youtube-dl", line 11, in <module>
    sys.exit(main())
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/__init__.py", line 422, in main
    _real_main(argv)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/__init__.py", line 412, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1745, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 692, in extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 738, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1391, in process_video_result
    self.process_info(new_info)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1653, in process_info
    success = dl(filename, info_dict)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1595, in dl
    return fd.download(name, info)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/downloader/common.py", line 350, in download
    return self.real_download(filename, info_dict)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/downloader/hls.py", line 98, in real_download
    success = ctx['dl'].download(frag_filename, {'url': frag_url})
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/downloader/common.py", line 350, in download
    return self.real_download(filename, info_dict)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/downloader/http.py", line 230, in real_download
    self.report_error('Did not get any data blocks')
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/downloader/common.py", line 161, in report_error
    self.ydl.report_error(*args, **kargs)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 555, in report_error
    self.trouble(error_message, tb)
  File "/home/admin/hs/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 517, in trouble
    tb_data = traceback.format_list(traceback.extract_stack())
<end of log>

[yan12125]

Seems a bug in youtube-dl's HLS downloader. The following command works:

youtube-dl --continue --verbose https://www.twitch.tv/annemunition/v/56397653 --hls-prefer-ffmpeg

The Twitch server provides empty files. Maybe youtube-dl should tolerate and just skip empty files.

[jleclanche]

Thanks for the workaround.

For the sake of reproducibility, you might want to either take care of this or figure out why it's broken soon - the videos I linked expire very soon and won't be available anymore. I'll link more here if I find any others.

[weedy]

[download] Downloading video 5 of 133
[generic] 70975718: Requesting header
[redirect] Following redirect to https://www.twitch.tv/moonmoon_ow/v/70975718
[twitch:vod] 70975718: Downloading vod info JSON
[twitch:vod] 70975718: Downloading vod access token
[twitch:vod] 70975718: Downloading m3u8 information
[download] Sleeping 3.0 seconds...
[hlsnative] Downloading m3u8 manifest
ERROR: unable to download video data: HTTP Error 403: Forbidden

[download] Downloading video 10 of 154
[redirect] Following redirect to https://www.twitch.tv/moonmoon_ow/v/71076041
[twitch:vod] 71076041: Downloading vod info JSON
[twitch:vod] 71076041: Downloading vod access token
[twitch:vod] 71076041: Downloading m3u8 information
[download] Sleeping 3.0 seconds...
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 11910
[download] Destination: 20160607-v71076041-mostly_tank_MLGfaze.moonmoon_FRAMES_FRAMES.mp4


ERROR: Did not get any data blocks

[weedy]

v73605779

[ddurdle]

Another: https://www.twitch.tv/vellhart/v/88674371

[erus]

Hi : same error on https://www.twitch.tv/roll4it/v/88176573 at the 38.2 % mark

[lepsa]

I'm also hitting this error. The following VOD fails at ~90%, however it is 10GB in size so testing with it might be a little unwieldy.
EDIT: Forgot the link
https://www.twitch.tv/jefmajor/v/105049663

[thepaperpilot]

This issue is still occuring, here's another link to try (fails at 32.9%): https://www.twitch.tv/videos/132560238

[3id0]

Another one I think: https://go.twitch.tv/videos/73751733