Periscope videos stuck downloading forever (HLS)

[shaicoleman]

Some Periscope videos don't download correctly, and get stuck downloading forever e.g.
youtube-dl https://www.periscope.tv/w/1yNxanpMDrWKj

A workaround is to use the --hls-prefer-native, e.g.
youtube-dl --hls-prefer-native https://www.periscope.tv/w/1yNxanpMDrWKj

The options --hls-prefer-ffmpeg and --hls-use-mpegts do not work correctly with this video.

youtube-dl 2016.09.24 / Python 2.7.12 / Ubuntu 16.04 x64 / ffmpeg 3.1.3-1

# youtube-dl -v https://www.periscope.tv/w/1yNxanpMDrWKj
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://www.periscope.tv/w/1yNxanpMDrWKj']
[debug] Encodings: locale ANSI_X3.4-1968, fs ANSI_X3.4-1968, out ANSI_X3.4-1968, pref ANSI_X3.4-1968
[debug] youtube-dl version 2016.09.24
[debug] Python version 2.7.12 - Linux-4.4.0-38-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 3.1.3-1, ffprobe 3.1.3-1
[debug] Proxy map: {}
[periscope] 1yNxanpMDrWKj: Downloading JSON metadata
[periscope] 1yNxanpMDrWKj: Downloading JSON metadata
[debug] Invoking downloader on u'https://replay.periscope.tv/kpEtvIcYhps43Rm6Yj0M8TsEhACfEM9p9t_KkboZfaGhXWrAN_mO_ZovXHfUF9dYeOdJQapfRhT9uEYkm3KKyA==/playlist_1474458473402408337.m3u8'
[download] Destination: Lisa Stokke Official - @avaaz Bus campaign through #London to get US citizens abroad to register to vote!!! Dump Trump! Vote for Hillary!!!-1yNxanpMDrWKj.mp4
[debug] ffmpeg command line: ffmpeg -y -headers 'Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip, deflate
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Cookie: CloudFront-Signature=CQgWEp4TSplm8UN8xdzEDZOLCO4zv1D0Gv332XYElmEw8hPa6J8spHckRtret35lsYW-ARx3dXZOUUt13eK827ECgFEsl-p1bEBry2riMjGALfM2ATiIM88qs2F9ZMz0k0eHAn4hxFL6SPVlG7aen3x-lBHpwNLlJ5ypGObwd8Olt0VtPlh0hCyh2GaQW6vuj0FokWwidvX6BqGKKfZhO1~ShpRoMhPvNakCXtNkvkqTyTQ18OQILcjn9sCYszoBfjrB2YuhjEC9I50IJt2sVqtpyRe0IiKaOCnQy7brqmNYmYL7eLiv9SYc37U~bsCkUBAD0Z-EgPdgsFMV07khuQ__; CloudFront-Key-Pair-Id=APKAIHCXHHQVRTVSFRWQ; CloudFront-Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9yZXBsYXkucGVyaXNjb3BlLnR2L2twRXR2SWNZaHBzNDNSbTZZajBNOFRzRWhBQ2ZFTTlwOXRfS2tib1pmYUdoWFdyQU5fbU9fWm92WEhmVUY5ZFllT2RKUWFwZlJoVDl1RVlrbTNLS3lBPT0qIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNDc1MDcyNjY5fX19XX0_
' -i https://replay.periscope.tv/kpEtvIcYhps43Rm6Yj0M8TsEhACfEM9p9t_KkboZfaGhXWrAN_mO_ZovXHfUF9dYeOdJQapfRhT9uEYkm3KKyA==/playlist_1474458473402408337.m3u8 -c copy -f mp4 -bsf:a aac_adtstoasc 'file:Lisa Stokke Official - @avaaz Bus campaign through #London to get US citizens abroad to register to vote!!! Dump Trump! Vote for Hillary!!!-1yNxanpMDrWKj.mp4.part'
ffmpeg version 3.1.3-1~16.04.york2 Copyright (c) 2000-2016 the FFmpeg developers
  built with gcc 6.2.0 (Ubuntu 6.2.0-3ubuntu15~16.04.york0) 20160914
  configuration: --prefix=/usr --extra-version='1~16.04.york2' --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libebur128 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librubberband --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-chromaprint --enable-libopencv --enable-libx264
  libavutil      55. 28.100 / 55. 28.100
  libavcodec     57. 48.101 / 57. 48.101
  libavformat    57. 41.100 / 57. 41.100
  libavdevice    57.  0.101 / 57.  0.101
  libavfilter     6. 47.100 /  6. 47.100
  libavresample   3.  0.  0 /  3.  0.  0
  libswscale      4.  1.100 /  4.  1.100
  libswresample   2.  1.100 /  2.  1.100
  libpostproc    54.  0.100 / 54.  0.100
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4731570, dts=4735260, size=1845
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4739040, dts=4742730, size=1721
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4746600, dts=4750290, size=1486
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4754070, dts=4757760, size=1191
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4761540, dts=4765230, size=1051
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4769100, dts=4772790, size=1394
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4776570, dts=4780260, size=1731
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4784040, dts=4787730, size=1352
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4791600, dts=4795290, size=1330
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4799070, dts=4802760, size=1265
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4806540, dts=4810230, size=1325
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4814010, dts=4817700, size=1086
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4825260, dts=4828950, size=787
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4832820, dts=4836510, size=906
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4840290, dts=4843980, size=986
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4847760, dts=4851450, size=977
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4855320, dts=4859010, size=964
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4862790, dts=4866480, size=1106
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4870260, dts=4873950, size=923
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4877820, dts=4881510, size=951
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4885290, dts=4888980, size=887
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4892760, dts=4896450, size=1037
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4900320, dts=4904010, size=1138
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4907790, dts=4911480, size=1029
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4915260, dts=4918950, size=1346
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4922820, dts=4926510, size=1323
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4930290, dts=4933980, size=1424
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4937760, dts=4941450, size=1273
[mpegts @ 0xfa9c60] Invalid timestamps stream=1, pts=4945320, dts=4949010, size=1145
[hls,applehttp @ 0xaf77e0] No longer receiving playlist 0
[hls,applehttp @ 0xaf77e0] Now receiving playlist 0, segment 0
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4731570, dts=4735260, size=1859
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4739040, dts=4742730, size=1735
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4746600, dts=4750290, size=1500
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4754070, dts=4757760, size=1205
Input #0, hls,applehttp, from 'https://replay.periscope.tv/kpEtvIcYhps43Rm6Yj0M8TsEhACfEM9p9t_KkboZfaGhXWrAN_mO_ZovXHfUF9dYeOdJQapfRhT9uEYkm3KKyA==/playlist_1474458473402408337.m3u8':
  Duration: 00:02:45.84, start: 52.072000, bitrate: 0 kb/s
  Program 0 
    Metadata:
      variant_bitrate : 0
    Stream #0:0: Data: timed_id3 (ID3  / 0x20334449)
    Stream #0:1: Video: h264 (Main) ([27][0][0][0] / 0x001B), yuv420p, 320x568, 24 tbr, 90k tbn, 180k tbc
    Stream #0:2: Audio: aac (LC) ([15][0][0][0] / 0x000F), 44100 Hz, mono, fltp, 86 kb/s
[mp4 @ 0x11cf4e0] Using AVStream.codec to pass codec parameters to muxers is deprecated, use AVStream.codecpar instead.
    Last message repeated 1 times
Output #0, mp4, to 'file:Lisa Stokke Official - @avaaz Bus campaign through #London to get US citizens abroad to register to vote!!! Dump Trump! Vote for Hillary!!!-1yNxanpMDrWKj.mp4.part':
  Metadata:
    encoder         : Lavf57.41.100
    Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 320x568, q=2-31, 24 tbr, 90k tbn, 90k tbc
    Stream #0:1: Audio: aac (LC) ([64][0][0][0] / 0x0040), 44100 Hz, mono, 86 kb/s
Stream mapping:
  Stream #0:1 -> #0:0 (copy)
  Stream #0:2 -> #0:1 (copy)
Press [q] to stop, [?] for help
[mp4 @ 0x11cf4e0] Invalid DTS: 48780 PTS: 45090 in output stream 0:0, replacing by guess
[mp4 @ 0x11cf4e0] Invalid DTS: 56250 PTS: 52560 in output stream 0:0, replacing by guess
[mp4 @ 0x11cf4e0] Invalid DTS: 63810 PTS: 60120 in output stream 0:0, replacing by guess
[mp4 @ 0x11cf4e0] Invalid DTS: 71280 PTS: 67590 in output stream 0:0, replacing by guess
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4761540, dts=4765230, size=1065
[mp4 @ 0x11cf4e0] Invalid DTS: 78750 PTS: 75060 in output stream 0:0, replacing by guess
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4769100, dts=4772790, size=1408
[mp4 @ 0x11cf4e0] Invalid DTS: 86310 PTS: 82620 in output stream 0:0, replacing by guess
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4776570, dts=4780260, size=1745
[mp4 @ 0x11cf4e0] Invalid DTS: 93780 PTS: 90090 in output stream 0:0, replacing by guess
[hls,applehttp @ 0xaf77e0] Invalid timestamps stream=1, pts=4784040, dts=4787730, size=1366
[snip]

[dstftw]

It's not stuck it just takes some time to finish:

...
[NULL @ 00000000023b4d40] missing picture in access unit with size 11
frame= 3982 fps= 39 q=-1.0 Lsize=    8912kB time=00:02:46.47 bitrate= 438.5kbits/s speed=1.62x
video:7816kB audio:983kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.271315%
[ffmpeg] Downloaded 9125386 bytes
[download] 100% of 8.70MiB