Vid.me downloads no longer working - headers missing

[BlohoJo]

Please follow the guide below

• You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
• Put an x into all the boxes [ ] relevant to your issue (like this: [x])
• Use the Preview tab to see what your issue will actually look like

---

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.09.11. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

• I've verified and I assure that I'm running youtube-dl 2017.09.11

Before submitting an issue make sure you have:

• At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

---

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

C:\WIP\temp_ytdl>youtube-dl.exe -v "https://vid.me/k1q1V"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://vid.me/k1q1V']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2017.09.11
[debug] Python version 3.4.4 - Windows-2008ServerR2-6.1.7601-SP1
[debug] exe versions: ffmpeg N-87294-gec1573f, ffprobe N-87294-gec1573f
[debug] Proxy map: {}
[vidme] k1q1V: Downloading JSON metadata
[vidme] k1q1V: Downloading MPD manifest
[vidme] k1q1V: Downloading m3u8 information
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://api.vid.me/video/17606241/stream?format
hls&subformat=61100520-video-avc1-4.m3u8'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 7
[download] Destination: Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V.
hls-2423.mp4
[download] 100% of 16.42MiB in 00:04
[debug] Invoking downloader on 'https://d1wst0behutosd.cloudfront.net/videos/17
06241/61100520-audio-und-mp4a-1.mp4?Expires=1505368692&Signature=cHm6q~ayFFKa0K
lUyRgS7~iPa6BGgXGD4y7IyPU8EX96pYn6WqeUwY9lAAByPt-j1-DIHcgk53qCRDw8l9MCp0uSEfn6u
S1yFkRgvoCeKcQlLgUZ9UxDi6SnXLDtA2PuBbxNLBXnKI8f9hrR1pqW0yudYXFUI7v4ZFIauGPsxG-c
jEu4nrcBQhi~7GRKA2jyEIySIFcQj-VqNgg1j4bY~ZcKdqtKXnaWAA1B7Hk-ZVATVQnNxftnKY6wROh
PFHyalXmk4rIOe9rfyqNv91TkZiZp2Euc4b99-4SPG~NWQBuRaejBiqeykD0qKGx3REHLhhHKbVTVsz
FfsVA7A__&Key-Pair-Id=APKAJJ6WELAPEP47UKWQ'
[download] Destination: Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V.
dash-audio-und-mp4a-1.m4a
[download] 100% of 2.28MiB in 00:00
[ffmpeg] Merging formats into "Teen Drummer _ The Warning Band _ 60 Second Docs
k1q1V.mp4"
[debug] ffmpeg command line: ffmpeg -y -i "file:Teen Drummer _ The Warning Band
_ 60 Second Docs-k1q1V.fhls-2423.mp4" -i "file:Teen Drummer _ The Warning Band
 60 Second Docs-k1q1V.fdash-audio-und-mp4a-1.m4a" -c copy -map "0:v:0" -map "1:
:0" "file:Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V.temp.mp4"
ERROR: file:Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V.fhls-2423.mp
: Invalid data found when processing input
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp24lzs8ny\b
ild\youtube_dl\YoutubeDL.py", line 2012, in post_process
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp24lzs8ny\b
ild\youtube_dl\postprocessor\ffmpeg.py", line 479, in run
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp24lzs8ny\b
ild\youtube_dl\postprocessor\ffmpeg.py", line 204, in run_ffmpeg_multiple_files
youtube_dl.postprocessor.ffmpeg.FFmpegPostProcessorError: file:Teen Drummer _ T
e Warning Band _ 60 Second Docs-k1q1V.fhls-2423.mp4: Invalid data found when pr
cessing input
...
<end of log>

---

Description of your issue, suggested solution and other information

Downloads from vid.me return error, "Invalid data found when processing input." Happens on all videos I've tried so far. Some videos don't return error, but will not play back, they show the same error when running ffprobe:

C:\WIP\temp_ytdl>ffprobe "Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V
.fhls-2423.mp4"
ffprobe version N-87294-gec1573f Copyright (c) 2007-2017 the FFmpeg developers
  built with gcc 7.1.0 (GCC)
  configuration: --enable-gpl --enable-version3 --enable-cuda --enable-cuvid --e
nable-d3d11va --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --
enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv
--enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-li
bfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug -
-enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enabl
e-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-li
bsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolam
e --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx
 --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable
-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-zlib
  libavutil      55. 75.100 / 55. 75.100
  libavcodec     57.106.101 / 57.106.101
  libavformat    57. 82.100 / 57. 82.100
  libavdevice    57.  8.101 / 57.  8.101
  libavfilter     6.105.100 /  6.105.100
  libswscale      4.  7.103 /  4.  7.103
  libswresample   2.  8.100 /  2.  8.100
  libpostproc    54.  6.100 / 54.  6.100
[mov,mp4,m4a,3gp,3g2,mj2 @ 00000000005024c0] could not find corresponding trex
[mov,mp4,m4a,3gp,3g2,mj2 @ 00000000005024c0] error reading header
Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V.fhls-2423.mp4: Invalid da
ta found when processing input
...
<end of log>

Downloaded .m4a appears to pass ffprobe check but will not play back on anything; for example foobar2000 returns error:

Unable to open item for playback (Unsupported format or corrupted file (array access out of range)):
"C:\temp_ytdl\Teen Drummer _ The Warning Band _ 60 Second Docs-k1q1V.fdash-audio-und-mp4a-1.m4a"
...
<end of log>

[BlohoJo]

I tried using the following online tool which worked successfully:

http://www.tubeoffline.com/download-VIDme-videos.php

For the following short video example (which has no sound): https://vid.me/A7zd2

youtube-dl downloaded size: 1,962,749 bytes
tubeoffline downloaded size: 1,963,571 bytes

I attached those files here for convenience.
Video_Example.zip

[BlohoJo]

It would appear, from comparing the above two files, that video file downloaded by youtube-dl is missing the following header:

00000000h: 00 00 00 24 66 74 79 70 69 73 6F 6D 00 00 02 00 ; ...$ftypisom....
00000010h: 69 73 6F 6D 69 73 6F 32 61 76 63 31 6D 70 34 31 ; isomiso2avc1mp41
00000020h: 69 73 6F 35 00 00 02 C5 6D 6F 6F 76 00 00 00 6C ; iso5...Åmoov...l
00000030h: 6D 76 68 64 00 00 00 00 00 00 00 00 00 00 00 00 ; mvhd............
00000040h: 00 00 03 E8 00 00 6E 07 00 01 00 00 01 00 00 00 ; ...è..n.........
00000050h: 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00 00 ; ................
00000060h: 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00 00 ; ................
00000070h: 00 00 00 00 00 00 00 00 40 00 00 00 00 00 00 00 ; ........@.......
00000080h: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ; ................
00000090h: 00 00 00 00 FF FF FF FF 00 00 02 19 74 72 61 6B ; ....ÿÿÿÿ....trak
000000a0h: 00 00 00 5C 74 6B 68 64 00 00 00 07 00 00 00 00 ; ...\tkhd........
000000b0h: 00 00 00 00 00 00 00 01 00 00 00 00 00 00 6E 07 ; ..............n.
000000c0h: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ; ................
000000d0h: 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ; ................
000000e0h: 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ; ................
000000f0h: 40 00 00 00 04 80 00 00 02 D0 00 00 00 00 00 24 ; @....€...Ð.....$
00000100h: 65 64 74 73 00 00 00 1C 65 6C 73 74 00 00 00 00 ; edts....elst....
00000110h: 00 00 00 01 00 00 6E 07 00 00 00 00 00 01 00 00 ; ......n.........
00000120h: 00 00 01 91 6D 64 69 61 00 00 00 20 6D 64 68 64 ; ...‘mdia... mdhd
00000130h: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 3C 00 ; ..............<.
00000140h: 00 00 00 00 55 C4 00 00 00 00 00 35 68 64 6C 72 ; ....UÄ.....5hdlr
00000150h: 00 00 00 00 00 00 00 00 76 69 64 65 00 00 00 00 ; ........vide....
00000160h: 00 00 00 00 00 00 00 00 42 65 6E 74 6F 34 20 56 ; ........Bento4 V
00000170h: 69 64 65 6F 20 48 61 6E 64 6C 65 72 00 00 00 01 ; ideo Handler....
00000180h: 34 6D 69 6E 66 00 00 00 14 76 6D 68 64 00 00 00 ; 4minf....vmhd...
00000190h: 01 00 00 00 00 00 00 00 00 00 00 00 24 64 69 6E ; ............$din
000001a0h: 66 00 00 00 1C 64 72 65 66 00 00 00 00 00 00 00 ; f....dref.......
000001b0h: 01 00 00 00 0C 75 72 6C 20 00 00 00 01 00 00 00 ; .....url .......
000001c0h: F4 73 74 62 6C 00 00 00 A8 73 74 73 64 00 00 00 ; ôstbl...¨stsd...
000001d0h: 00 00 00 00 01 00 00 00 98 61 76 63 31 00 00 00 ; ........˜avc1...
000001e0h: 00 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00 ; ................
000001f0h: 00 00 00 00 00 05 00 02 D0 00 48 00 00 00 48 00 ; ........Ð.H...H.
00000200h: 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 ; ................
00000210h: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ; ................
00000220h: 00 00 00 00 00 00 00 00 18 FF FF 00 00 00 32 61 ; .........ÿÿ...2a
00000230h: 76 63 43 01 64 00 1F FF E1 00 1B 67 64 00 1F AC ; vcC.d..ÿá..gd..¬
00000240h: 2B 40 28 02 DD FF 80 04 80 05 08 00 00 1F 40 00 ; +@(.Ýÿ€.€.....@.
00000250h: 07 53 04 78 E1 95 01 00 04 68 EE 3C B0 00 00 00 ; .S.xá•...hî<°...
00000260h: 10 70 61 73 70 00 00 00 09 00 00 00 0A 00 00 00 ; .pasp...........
00000270h: 14 73 74 73 7A 00 00 00 00 00 00 00 00 00 00 00 ; .stsz...........
00000280h: 00 00 00 00 10 73 74 73 63 00 00 00 00 00 00 00 ; .....stsc.......
00000290h: 00 00 00 00 10 73 74 74 73 00 00 00 00 00 00 00 ; .....stts.......
000002a0h: 00 00 00 00 10 73 74 63 6F 00 00 00 00 00 00 00 ; .....stco.......
000002b0h: 00 00 00 00 38 6D 76 65 78 00 00 00 10 6D 65 68 ; ....8mvex....meh
000002c0h: 64 00 00 00 00 00 00 6E 07 00 00 00 20 74 72 65 ; d......n.... tre
000002d0h: 78 00 00 00 00 00 00 00 01 00 00 00 01 00 00 00 ; x...............
000002e0h: 00 00 00 00 00 00 00 00 00 00 00 00 50 73 69 64 ; ............Psid
000002f0h: 78 00 00 00 00 00 00 00 01 00 00 3C 00 00 00 00 ; x..........<....
00000300h: 00 00 00 00 00 00 00 00 04 00 06 9A 13 00 01 F4 ; ...........š...ô
00000310h: 00 80 00 00 00 00 09 70 BE 00 01 F4 00 80 00 00 ; .€.....p¾..ô.€..
00000320h: 00 00 09 C8 56 00 01 F4 00 80 00 00 00 00 04 1F ; ...ÈV..ô.€......
00000330h: 77 00 00 BE 00 80 00 00 00                      ; w..¾.€...
...
<end of log>

[remitamine]

youtube-dl hls native downloader does not support fragmented mp4 in m3u8 manifests(https://tools.ietf.org/html/draft-pantos-http-live-streaming-23#section-4.3.2.5).
the file linked with EXT-X-MAP is the equivalent to DASH initialization file.

[BlohoJo]

Not sure I understand. Is there a command line switch that will make vid.me downloads work properly, or should vid.me be removed from the list of supported sites?

[remitamine]

adding -f '(bestvideo+bestaudio)[format_id^=dash]' to the command should be enough to workaround this problem for now.

[BlohoJo]

OK, thanks very much!