unknown_video extension while downloading VK video playlist #472

iG8R · 2022-11-29T02:56:27Z

Hi.
Windows 10 (21H1, 19043.1415)
Tartube v2.4.165

While downloading VK video playlist Tartube can't determine the extensions of videos replacing with "unknown_video" ext.
E.g. https://vk.com/video/playlist/-24440848_54694294

Screenshot

axcore · 2022-11-29T06:58:36Z

I tested the playlist. This is what I see:

Only the video in the top-left is downloaded (the "Download all" button), the other videos are only checked (the "Check all" button).

The size of the checked videos is unknown. YouTube sends the size, but other websites do not.

The size of the downloaded video is known, because Tartube examines the video file that you downloaded.

Are you seeing something different?

iG8R · 2022-11-29T12:44:21Z

The following is what's happening on my side.
PS."Blank" screenshot only appeared after having started downloading 19th-video file. At the beginning after "Checking playlist" all videos have their corresponding screenshots.
PS2. Is it possible to turn on more detailed "Output" log during download session like yt-dpl itself shows in console?

axcore · 2022-11-29T14:06:45Z

It seems to be a yt-dlp problem. I tried downloading the playlist in a terminal window, no Tartube, just yt-dlp:

Is it possible to turn on more detailed "Output" log during download session like yt-dpl itself shows in console?

Tartube does not hide anything, the Output tab shows everything that's visible in a terminal window.

iG8R · 2022-11-29T15:09:15Z

There is "mp4" extension in "Расколотая битвой синева небес： Целый год (серия 19).info.json" file, could Tartube take it from there?
Or to solve this problem I need to report the issue on yt-dlp github?

Расколотая битвой синева небес： Целый год (серия 19).info.json

{"id": "-24440848_456240561", "formats": [{"format_id": "hls-200", "url": "https://vkvd210.mycdn.me/expires/1669982302997/srcIp/104.28.224.95/pr/40/srcAg/CHROME/ms/185.226.53.201/type/4/sig/ARlv_reMmkA/ct/8/urls/185.226.52.165/clientType/13/id/3121993812541/video/", "manifest_url": "https://vkvd210.mycdn.me/video.m3u8?cmd=videoPlayerCdn&expires=1669982302544&srcIp=104.28.224.95&srcAg=CHROME&ms=185.226.53.201&mid=3967944894525&type=4&sig=Ov4N_XrBi50&ct=8&urls=185.226.52.165&clientType=13&id=3121993812541", "tbr": 200.095, "ext": "mp4", "fps": 25.0, "protocol": "m3u8_native", "width": 256, "height": 106, "video_ext": "mp4", "audio_ext": "none", "vbr": 200.095, "abr": 0.0, "format": "hls-200 - 256x106", "resolution": "256x106", "dynamic_range": "SDR", "filesize_approx": 30734592, "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "hls-390", "url": "https://vkvd210.mycdn.me/expires/1669982302997/srcIp/104.28.224.95/pr/40/srcAg/CHROME/ms/185.226.53.201/type/0/sig/ok5w_qDNaEA/ct/8/urls/185.226.52.165/clientType/13/id/3121993812541/video/", "manifest_url": "https://vkvd210.mycdn.me/video.m3u8?cmd=videoPlayerCdn&expires=1669982302544&srcIp=104.28.224.95&srcAg=CHROME&ms=185.226.53.201&mid=3967944894525&type=4&sig=Ov4N_XrBi50&ct=8&urls=185.226.52.165&clientType=13&id=3121993812541", "tbr": 390.834, "ext": "mp4", "fps": 25.0, "protocol": "m3u8_native", "width": 426, "height": 178, "video_ext": "mp4", "audio_ext": "none", "vbr": 390.834, "abr": 0.0, "format": "hls-390 - 426x178", "resolution": "426x178", "dynamic_range": "SDR", "filesize_approx": 60032102, "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "url240", "url": "https://vkvd210.mycdn.me/?expires=1669982302544&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=185.226.53.201&type=0&sig=xH9HJQZ1uJo&ct=0&urls=185.226.52.165&clientType=13&appId=512000384397&id=3121993812541", "height": 240, "protocol": "https", "ext": "unknown_video", "video_ext": "unknown_video", "audio_ext": "none", "format": "url240 - 240p", "resolution": "240p", "dynamic_range": "SDR", "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "hls-786", "url": "https://vkvd210.mycdn.me/expires/1669982302997/srcIp/104.28.224.95/pr/40/srcAg/CHROME/ms/185.226.53.201/type/1/sig/32RokkOaYZo/ct/8/urls/185.226.52.165/clientType/13/id/3121993812541/video/", "manifest_url": "https://vkvd210.mycdn.me/video.m3u8?cmd=videoPlayerCdn&expires=1669982302544&srcIp=104.28.224.95&srcAg=CHROME&ms=185.226.53.201&mid=3967944894525&type=4&sig=Ov4N_XrBi50&ct=8&urls=185.226.52.165&clientType=13&id=3121993812541", "tbr": 786.99, "ext": "mp4", "fps": 25.0, "protocol": "m3u8_native", "width": 640, "height": 268, "video_ext": "mp4", "audio_ext": "none", "vbr": 786.99, "abr": 0.0, "format": "hls-786 - 640x268", "resolution": "640x268", "dynamic_range": "SDR", "filesize_approx": 120881664, "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "hls-1286", "url": "https://vkvd210.mycdn.me/expires/1669982302997/srcIp/104.28.224.95/pr/40/srcAg/CHROME/ms/185.226.53.201/type/2/sig/i60_VzuK9O8/ct/8/urls/185.226.52.165/clientType/13/id/3121993812541/video/", "manifest_url": "https://vkvd210.mycdn.me/video.m3u8?cmd=videoPlayerCdn&expires=1669982302544&srcIp=104.28.224.95&srcAg=CHROME&ms=185.226.53.201&mid=3967944894525&type=4&sig=Ov4N_XrBi50&ct=8&urls=185.226.52.165&clientType=13&id=3121993812541", "tbr": 1286.718, "ext": "mp4", "fps": 25.0, "protocol": "m3u8_native", "width": 852, "height": 356, "video_ext": "mp4", "audio_ext": "none", "vbr": 1286.718, "abr": 0.0, "format": "hls-1286 - 852x356", "resolution": "852x356", "dynamic_range": "SDR", "filesize_approx": 197639884, "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "url360", "url": "https://vkvd210.mycdn.me/?expires=1669982302544&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=185.226.53.201&type=1&sig=Elsy6lmmGBU&ct=0&urls=185.226.52.165&clientType=13&appId=512000384397&id=3121993812541", "height": 360, "protocol": "https", "ext": "unknown_video", "video_ext": "unknown_video", "audio_ext": "none", "format": "url360 - 360p", "resolution": "360p", "dynamic_range": "SDR", "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "url480", "url": "https://vkvd210.mycdn.me/?expires=1669982302544&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=185.226.53.201&type=2&sig=LlUCOHVCyWs&ct=0&urls=185.226.52.165&clientType=13&appId=512000384397&id=3121993812541", "height": 480, "protocol": "https", "ext": "unknown_video", "video_ext": "unknown_video", "audio_ext": "none", "format": "url480 - 480p", "resolution": "480p", "dynamic_range": "SDR", "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "hls-2729", "url": "https://vkvd210.mycdn.me/expires/1669982302997/srcIp/104.28.224.95/pr/40/srcAg/CHROME/ms/185.226.53.201/type/3/sig/i3xQmWwHcm0/ct/8/urls/185.226.52.165/clientType/13/id/3121993812541/video/", "manifest_url": "https://vkvd210.mycdn.me/video.m3u8?cmd=videoPlayerCdn&expires=1669982302544&srcIp=104.28.224.95&srcAg=CHROME&ms=185.226.53.201&mid=3967944894525&type=4&sig=Ov4N_XrBi50&ct=8&urls=185.226.52.165&clientType=13&id=3121993812541", "tbr": 2729.885, "ext": "mp4", "fps": 25.0, "protocol": "m3u8_native", "width": 1280, "height": 536, "video_ext": "mp4", "audio_ext": "none", "vbr": 2729.885, "abr": 0.0, "format": "hls-2729 - 1280x536", "resolution": "1280x536", "dynamic_range": "SDR", "filesize_approx": 419310336, "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "url720", "url": "https://vkvd210.mycdn.me/?expires=1669982302544&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=185.226.53.201&type=3&sig=K8i1s_aWRuU&ct=0&urls=185.226.52.165&clientType=13&appId=512000384397&id=3121993812541", "height": 720, "protocol": "https", "ext": "unknown_video", "video_ext": "unknown_video", "audio_ext": "none", "format": "url720 - 720p", "resolution": "720p", "dynamic_range": "SDR", "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "hls-4665", "url": "https://vkvd210.mycdn.me/expires/1669982302997/srcIp/104.28.224.95/pr/40/srcAg/CHROME/ms/185.226.53.201/type/5/sig/A6cH3lISEmE/ct/8/urls/185.226.52.165/clientType/13/id/3121993812541/video/", "manifest_url": "https://vkvd210.mycdn.me/video.m3u8?cmd=videoPlayerCdn&expires=1669982302544&srcIp=104.28.224.95&srcAg=CHROME&ms=185.226.53.201&mid=3967944894525&type=4&sig=Ov4N_XrBi50&ct=8&urls=185.226.52.165&clientType=13&id=3121993812541", "tbr": 4665.619, "ext": "mp4", "fps": 25.0, "protocol": "m3u8_native", "width": 1920, "height": 804, "video_ext": "mp4", "audio_ext": "none", "vbr": 4665.619, "abr": 0.0, "format": "hls-4665 - 1920x804", "resolution": "1920x804", "dynamic_range": "SDR", "filesize_approx": 716639078, "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}, {"format_id": "url1080", "url": "https://vkvd210.mycdn.me/?expires=1669982302544&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=185.226.53.201&type=5&sig=HE3018pFQQo&ct=0&urls=185.226.52.165&clientType=13&appId=512000384397&id=3121993812541", "height": 1080, "protocol": "https", "ext": "unknown_video", "video_ext": "unknown_video", "audio_ext": "none", "format": "url1080 - 1080p", "resolution": "1080p", "dynamic_range": "SDR", "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}}], "title": "Расколотая битвой синева небес: Целый год (серия 19)", "thumbnail": "https://sun6-20.userapi.com/D83MnSfCpNHjRE-4eVwx2sBcXqmNowz9DXHERg/K3NJ_3J1Aco.jpg", "uploader": "<Shanteau Store>", "uploader_id": "-24440848", "duration": 1200, "timestamp": 1669062098, "like_count": 513, "comment_count": 12, "is_live": false, "subtitles": {}, "webpage_url": "http://vk.com/video-24440848_456240561", "webpage_url_basename": "video-24440848_456240561", "webpage_url_domain": "vk.com", "extractor": "vk", "extractor_key": "VK", "thumbnails": [{"url": "https://sun6-20.userapi.com/D83MnSfCpNHjRE-4eVwx2sBcXqmNowz9DXHERg/K3NJ_3J1Aco.jpg", "id": "0"}], "display_id": "-24440848_456240561", "fulltitle": "Расколотая битвой синева небес: Целый год (серия 19)", "duration_string": "20:00", "upload_date": "20221121", "format_id": "url1080", "url": "https://vkvd210.mycdn.me/?expires=1669982302544&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=185.226.53.201&type=5&sig=HE3018pFQQo&ct=0&urls=185.226.52.165&clientType=13&appId=512000384397&id=3121993812541", "height": 1080, "protocol": "https", "ext": "unknown_video", "video_ext": "unknown_video", "audio_ext": "none", "format": "url1080 - 1080p", "resolution": "1080p", "dynamic_range": "SDR", "http_headers": {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.20 Safari/537.36", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8", "Accept-Language": "en-us,en;q=0.5", "Sec-Fetch-Mode": "navigate", "Cookie": "tstc=p"}, "epoch": 1669723105, "_type": "video", "_version": {"version": "2022.11.11", "release_git_head": "8b64402", "repository": "yt-dlp/yt-dlp"}}

Concerning "Output" tab, I was referring to this missing line in your screenshot:
[download] 6.3% of 644.38MiB at 2.57MiB/s ETA 03:55

axcore · 2022-11-29T15:57:21Z

Or to solve this problem I need to report the issue on yt-dlp github?

Yes. Your complaint is, this command creates a file called VIDEONAME.unknown_video, instead of a file called VIDEONAME.mp4:

yt-dlp https://vk.com/video/playlist/-24440848_54694294

Concerning "Output" tab, I was referring to this missing line in your screenshot:

I checked the Tartube code, and you are correct: that line is hidden. There are several reasons, one is that I don't want to spam the Output tab. Another reason is that it's not simple to replace existing text in a Gtk textview (not impossible, just not simple), so I didn't add that functionality. Another reason is that you might receive half a line, instead of a whole line (because of network delays), and that is alsy tricky to handle (not impossible, just not simple).

iG8R · 2022-12-02T15:18:48Z

I submitted the issue yt-dlp/yt-dlp#5675 but it's unknown how it'll be solved.
Since solution is unclear is it possible to add an option in Tartube where if the extension of video is unknown_video Tartube uses beforehand-selected by user format?

And one more issue I stumbled upon.
After updating playlist the order of videos is incorrect.

Screenshot

axcore · 2022-12-02T16:53:09Z

I think it will be fixed long before I can update Tartube, so let's wait a few days before doing anything.

After updating playlist the order of videos is incorrect.

Make sure Tartube is sorting videos by date. Click the small green icon at the bottom of the window, and check the Sort box is set to Upload time.

The button next to it will force a re-sort of videos, so that will probably solve your problem.

iG8R · 2022-12-03T00:04:18Z

This issue with unknown_video isn't connected only with VK, based on the Issues section of yt-dlp github there are 7 opened and 12 closed topics related to this case and it's unknown how many there'll be in the future. Maybe it's worth to implement above-mentioned option that lets Tartube to use selected by user format in case of facing unknown_video extension per all and individual playlists?
Concerning incorrect sorting. Here is what's happening on my side.

Screenshot

Sorry, I get another issue.
https://vk.com/video/playlist/-179915138_55
There are 86 videos in this playlist, but Tartube doesn't process it correctly:

in View window there are only videos from 86 till 37
Information window that appears after checking playlist says that Tartube processed 84 videos
Output tabs shows that yt-dlp successfully processed 86 videos

Screenshots

Also while downloading videos from VK very often in either Progress or Classic Mode tabs numbers of Speed and therefore ETA isn't displayed despite yt-dlp's console contains all information.

Screenshots & log

[debug] Command-line config: ['-vU', 'https://vk.com/video/playlist/-179915138_55']
[debug] Encodings: locale cp65001, fs utf-8, pref cp65001, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.11.11 [8b64402] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.19043-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3
[debug] Optional libraries: Cryptodome-3.15.0, brotli-1.0.9, certifi-2022.09.24, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1723 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2022.11.11, Current version: 2022.11.11
yt-dlp is up to date (2022.11.11)
[debug] [vk:uservideos] Extracting URL: https://vk.com/video/playlist/-179915138_55
[vk:uservideos] -179915138_55: Downloading webpage
[download] Downloading playlist: Идеальный мир
[vk:uservideos] -179915138: Downloading JSON metadata
[vk:uservideos] -179915138: Downloading JSON metadata
[vk:uservideos] Playlist Идеальный мир: Downloading 86 videos of 86
[download] Downloading video 1 of 86
[debug] [vk] Extracting URL: http://vk.com/video-179915138_456244509
[vk] -179915138_456244509: Downloading JSON metadata
[vk] -179915138_456244509: Downloading m3u8 information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] -179915138_456244509: Downloading 1 format(s): hls-4562
[debug] Invoking hlsnative downloader on "https://vkvd122.mycdn.me/expires/1670284459334/srcIp/104.28.192.94/pr/40/srcAg/CHROME/ms/185.226.53.166/type/5/sig/UndxR7d9WuE/ct/8/urls/45.136.21.136/clientType/13/id/3214569376506/video/"
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 92
[download] Destination: Идеальный мир - 86 серия (Безупречный мир) [-179915138_456244509].mp4
[debug] File locking is not supported. Proceeding without locking
[download]   5.4% of ~ 524.45MiB at    3.61MiB/s ETA 01:59 (frag 5/92)

iG8R · 2022-12-03T00:12:48Z

One more question:)
While downloading playlist is it somehow possible to download several videos simultaneously not in order one by one automatically?

iG8R · 2022-12-04T01:06:53Z

Sorry for my third-point report, my bad.

in View window there are only videos from 86 till 37
Parameter "Size" would need to be changed according to the preferred View window's list size.
Information window that appears after checking playlist says that Tartube processed 84 videos
There are in fact 84 videos - 7th and 10th episodes are missed.
I downloaded them manually from other site.
Is it possible to integrate them in database?

But still there is an issue:
After all existing episodes were downloaded, in View window's list some episodes still have "unknown" parameter where there would to be the file-size.

Screenshots

axcore · 2022-12-04T10:35:41Z

Please - one problem per issue. It is impossible to keep track or ten different problems, when they are all added to one issue!

Maybe you are thinking, "If I add 10 new issues today, he will kill me." But I will not kill you, I will be happy that you found 10 bugs that I did not notice before.

axcore · 2022-12-04T10:41:14Z

Sorting problem

Please "check" the playlist, and then show me the yellow text at the top of the Output tab. Then I will try to reproduce your exact problem.

Try adding https://vk.com/video/playlist/-24440848_54694294 as a channel (not a playlist). Do you still see the same problem? (Tartube tries to sort playlists so the order is the same, as the order on the video website.)

axcore · 2022-12-04T10:50:41Z

Tartube does not display all videos in https://vk.com/video/playlist/-179915138_55

By default, there are only 50 videos per page. Do you see "Page 1 / 2 Size 50" in your Tartube window? Can you click the button, to open the next page?

Edit: I just noticed your screenshot. You should definitely try that :)

Information window that appears after checking playlist says that Tartube processed 84 videos

Output tabs shows that yt-dlp successfully processed 86 videos

No, the output tab only processed 84 videos. For example, video #10 is not processed. This video is also not visible on the website (perhaps it is deleted?)

axcore · 2022-12-04T10:52:53Z

While downloading playlist is it somehow possible to download several videos simultaneously not in order one by one automatically?

Yes, use custom downloads, see [here](https://github.com/axcore/tartube#custom-downloads). For downloading several videos simultaneously from the same playlist, see this section.

axcore · 2022-12-04T11:04:54Z

I downloadeded videos manually, Is it possible to integrate them into [Tartube] database?

Yes, see here.

…A detection/reset file size on refresh #472

axcore · 2022-12-04T11:51:52Z

The video file size is not set

I can't test your problem because VK is refusing downloads on that playlist, at the moment.

But in v2.4.174 I tweaked the refresh operation, so that it updates the file size. From Tartube's menu, click Operations > Refresh database...

By the way, v2.4.174 is only released to PyPI/Github. If you want to update your Windows installation, see here.

axcore · 2022-12-04T11:52:30Z

Tartube does not detect the ETA

Also fixed in v2.4.174. The format of yt-dlp's output has been changed, and no-one told me ;)

iG8R · 2022-12-04T21:41:52Z

Please - one problem per issue. It is impossible to keep track or ten different problems, when they are all added to one issue!

I really understand what you're talking about hence I'm very sorry, my bad.

While downloading playlist is it somehow possible to download several videos simultaneously not in order one by one automatically?

Yes, use custom downloads, see [here](https://github.com/axcore/tartube#custom-downloads). For downloading several videos simultaneously from the same playlist, see this section.

I downloadeded videos manually, Is it possible to integrate them into [Tartube] database?

Yes, see here.

Tartube does not detect the ETA

Also fixed in v2.4.174. The format of yt-dlp's output has been changed, and no-one told me ;)

Thank you! It's awesome!

iG8R · 2022-12-04T21:48:35Z

The video file size is not set

I can't test your problem because VK is refusing downloads on that playlist, at the moment.

But in v2.4.174 I tweaked the refresh operation, so that it updates the file size. From Tartube's menu, click Operations > Refresh database...

Many thanks! It works:)

iG8R · 2022-12-04T21:50:54Z

By the way, v2.4.174 is only released to PyPI/Github. If you want to update your Windows installation, see here.

Thank you.

Some clarifications:

It's 2.4.173 version
Copying the downloaded source code into Tartube script folder, replacing old files with new ones, didn't work as it turned out settings.json from 2.4.165 version doesn't compatible with 2.4.173.
It's necessary to fix correct version number and insert the missing strings to make Tartube to start otherwise bash.exe and conhost.exe processes are launching but Tartube doesn't start:
- correct "script_version": "2.4.165", to "script_version": "2.4.173", in line #3
- insert "override_locale": "en_GB", in line #7
- insert "match_nickname_flag": true, in line #316

axcore · 2023-01-09T14:34:36Z

I confirmed that v2.4.165 config files can't be read by v2.4.173. The reason was some temporary code that I forgot to remove. The temporary code was removed in later versions, though.

axcore · 2023-02-26T12:45:30Z

Is this one done too? Re-open it if not :)

iG8R · 2023-02-26T13:20:01Z

@axcore
This issue still exists, unfortunately. And the same issue is still opened in the yt-dlp repository.
Could, please, add an option to assign a user-defined file extension when yt-dlp retrieves .unknown_video?

axcore · 2023-02-26T14:12:16Z

Today I downloaded the whole of https://vk.com/video/playlist/-24440848_54694294 but I only received .mp4 videos, I didn't receive any .unknown_video

Do you have a playlist URL which is currently sending .unknown_video files?

iG8R · 2023-02-26T14:20:01Z


yt-dlp --newline -i --abort-on-unavailable-fragment --hls-prefer-native --write-description --cookies H:/TarTube(Downloader)/cookies.txt --write-thumbnail --concurrent-fragments 3 --windows-filenames --output H:/TarTube(Downloader)/Расколотая битвой/%(title)s.%(ext)s -vU http://vk.com/video-24440848_456240588
[debug] Command-line config: ['--newline', '-i', '--abort-on-unavailable-fragment', '--hls-prefer-native', '--write-description', '--cookies', 'H:/TarTube(Downloader)/cookies.txt', '--write-thumbnail', '--concurrent-fragments', '3', '--windows-filenames', '--output', 'H:/TarTube(Downloader)/Расколотая битвой/%(title)s.%(ext)s', '-vU', 'http://vk.com/video-24440848_456240588']
[debug] Encodings: locale cp65001, fs utf-8, pref cp65001, out utf-8 (No ANSI), error utf-8 (No ANSI), screen utf-8 (No ANSI)
[debug] yt-dlp version 2023.02.17 [a0a7c01] (pip)
[debug] Python 3.10.8 (CPython AMD64 64bit) - Windows-10-10.0.19045-SP0 (OpenSSL 1.1.1s  1 Nov 2022)
[debug] Optional libraries: certifi-2022.09.24, pycrypto-3.15.0, sqlite3-2.6.0
[debug] exe versions: ffmpeg 4.4.3 (setts), ffprobe 4.4.3, rtmpdump 2.4
[debug] Proxy map: ()
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
[debug] Loaded 1782 extractors
Latest version: 2023.02.17, Current version: 2023.02.17
yt-dlp is up to date (2023.02.17)
[vk] -24440848_456240588: Downloading JSON metadata
[vk] Extracting URL: http://vk.com/video-24440848_456240588
[vk] -24440848_456240588: Downloading m3u8 information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] -24440848_456240588: Downloading 1 format(s): url2160
[info] There's no video description to write
[info] Downloading video thumbnail 0 ...
[info] Writing video thumbnail 0 to: H:/TarTube(Downloader)/Расколотая битвой/Расколотая битвой синева небес： Целый год (серия 27).jpg
[debug] Invoking http downloader on "https://vkvd200.mycdn.me/?expires=1677680303037&srcIp=104.28.224.95&pr=40&srcAg=CHROME&ms=45.136.21.199&type=7&sig=ghcPEjH7Upc&ct=0&urls=185.226.52.186&clientType=13&appId=512000384397&zs=12%3B43&id=3406493649540"
[debug] File locking is not supported. Proceeding without locking
[download] Destination: H:/TarTube(Downloader)/Расколотая битвой/Расколотая битвой синева небес： Целый год (серия 27).unknown_video

axcore · 2023-02-27T13:39:30Z

Could, please, add an option to assign a user-defined file extension when yt-dlp retrieves .unknown_video?

It is not feasible without a code rewrite that will take many days. I spent two hours on it today, and I could not find a practical solution.

axcore · 2023-02-27T13:53:18Z

You can change the file endings manually, then in Tartube's window, select Operations > Refresh database, which will add the videos to your database.

Also, the .unknown_video extension doesn't appear if you select a video format in Edit > General download options... > Formats, for example Any format [1440p].

iG8R · 2023-02-27T14:22:00Z

Thank you, I already do this operation such as manual renaming and refreshing database, but it looks like a misconception of the very idea of making life easier for users through programming.

axcore · 2023-02-27T15:59:46Z

I could not find a simple way to do it.

iG8R · 2023-02-27T16:05:42Z

Could you, please, add this issue in your to-do list, maybe, you'll find a solution over time.

axcore · 2023-02-27T17:17:19Z

The workaround I described above works too: just add any video format to yt-dlp's download options, for example Any format [1440p].

iG8R · 2023-02-27T18:35:31Z

Any format [1440p] doesn't work too.

yt-dlp --newline -i --abort-on-unavailable-fragment --hls-prefer-native --write-description --cookies H:/TarTube(Downloader)/cookies.txt --write-thumbnail -f bestvideo[height<=?1440]+bestaudio/best[height<=?1440] --concurrent-fragments 3 --windows-filenames --output H:/TarTube(Downloader)/Расколотая битвой/%(title)s.%(ext)s -vU http://vk.com/video-24440848_456240595
[debug] Command-line config: ['--newline', '-i', '--abort-on-unavailable-fragment', '--hls-prefer-native', '--write-description', '--cookies', 'H:/TarTube(Downloader)/cookies.txt', '--write-thumbnail', '-f', 'bestvideo[height<=?1440]+bestaudio/best[height<=?1440]', '--concurrent-fragments', '3', '--windows-filenames', '--output', 'H:/TarTube(Downloader)/Расколотая битвой/%(title)s.%(ext)s', '-vU', 'http://vk.com/video-24440848_456240595']
[debug] Encodings: locale cp65001, fs utf-8, pref cp65001, out utf-8 (No ANSI), error utf-8 (No ANSI), screen utf-8 (No ANSI)
[debug] yt-dlp version 2023.02.17 [a0a7c01] (pip)
[debug] Python 3.10.8 (CPython AMD64 64bit) - Windows-10-10.0.19045-SP0 (OpenSSL 1.1.1s  1 Nov 2022)
[debug] exe versions: ffmpeg 4.4.3 (setts), ffprobe 4.4.3, rtmpdump 2.4
[debug] Optional libraries: certifi-2022.09.24, pycrypto-3.15.0, sqlite3-2.6.0
[debug] Proxy map: ()
[debug] Loaded 1782 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2023.02.17, Current version: 2023.02.17
yt-dlp is up to date (2023.02.17)
[vk] Extracting URL: http://vk.com/video-24440848_456240595
[vk] -24440848_456240595: Downloading JSON metadata
[vk] -24440848_456240595: Downloading m3u8 information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[info] -24440848_456240595: Downloading 1 format(s): url1440
[info] There's no video description to write
Deleting existing file H:/TarTube(Downloader)/Расколотая битвой/Расколотая битвой синева небес： Целый год (серия 28).jpg
[info] Downloading video thumbnail 0 ...
[info] Writing video thumbnail 0 to: H:/TarTube(Downloader)/Расколотая битвой/Расколотая битвой синева небес： Целый год (серия 28).jpg
[debug] Invoking http downloader on "https://vkvd203.mycdn.me/?srcIp=104.28.192.95&pr=40&expires=1677981947641&srcAg=CHROME&fromCache=1&ms=45.136.21.202&type=6&subId=3695934310965&sig=9MIhEi5Y2tU&ct=0&urls=45.136.22.177&clientType=13&appId=512000384397&zs=43&id=3568901425782"
[download] Resuming download at byte 67107840
[debug] File locking is not supported. Proceeding without locking
[download] Destination: H:/TarTube(Downloader)/Расколотая битвой/Расколотая битвой синева небес： Целый год (серия 28).unknown_video

axcore · 2023-02-28T06:09:58Z

That's a shame, it worked with https://vk.com/video-24440848_456240588

iG8R · 2023-02-28T12:25:05Z

What one wants is consistency:)

axcore · 2023-03-01T07:25:41Z

I am getting extremely slow downloads from VK, so testing a problem with many videos is not always possible :)

axcore · 2023-03-01T12:00:12Z

In v2.4.255 I added a new setting in the 'Tidy files' window (Operations > Tidy up files) to convert .unknown_video files to .mp4. You can then run Operations > Refresh database to update the database.

It's not the automatic conversion that you wanted, but it's still better than renaming all the files yourself.

iG8R · 2023-03-01T13:35:56Z

Thank you :)

iG8R added the bug Something isn't working label Nov 29, 2022

axcore pushed a commit that referenced this issue Dec 4, 2022

Fix Missing Videos folder #473, all locales available #471, broken ET…

63cabe0

…A detection/reset file size on refresh #472

iG8R mentioned this issue Dec 4, 2022

After updating playlist the order of videos is incorrect #476

Closed

axcore closed this as completed Feb 26, 2023

unknown_video extension while downloading VK video playlist #472

unknown_video extension while downloading VK video playlist #472

Comments

iG8R commented Nov 29, 2022

axcore commented Nov 29, 2022

iG8R commented Nov 29, 2022

axcore commented Nov 29, 2022

iG8R commented Nov 29, 2022

axcore commented Nov 29, 2022 • edited

iG8R commented Dec 2, 2022

axcore commented Dec 2, 2022

iG8R commented Dec 3, 2022 • edited

iG8R commented Dec 3, 2022 • edited

iG8R commented Dec 4, 2022

axcore commented Dec 4, 2022 • edited

axcore commented Dec 4, 2022

axcore commented Dec 4, 2022

axcore commented Dec 4, 2022

axcore commented Dec 4, 2022

axcore commented Dec 4, 2022

axcore commented Dec 4, 2022

iG8R commented Dec 4, 2022

iG8R commented Dec 4, 2022

iG8R commented Dec 4, 2022

axcore commented Jan 9, 2023

axcore commented Feb 26, 2023

iG8R commented Feb 26, 2023 • edited

axcore commented Feb 26, 2023

iG8R commented Feb 26, 2023 • edited

axcore commented Feb 27, 2023 • edited

axcore commented Feb 27, 2023 • edited

iG8R commented Feb 27, 2023

axcore commented Feb 27, 2023

iG8R commented Feb 27, 2023

axcore commented Feb 27, 2023

iG8R commented Feb 27, 2023

axcore commented Feb 28, 2023

iG8R commented Feb 28, 2023

axcore commented Mar 1, 2023

axcore commented Mar 1, 2023

iG8R commented Mar 1, 2023

axcore commented Nov 29, 2022 •

edited

iG8R commented Dec 3, 2022 •

edited

iG8R commented Dec 3, 2022 •

edited

axcore commented Dec 4, 2022 •

edited

iG8R commented Feb 26, 2023 •

edited

iG8R commented Feb 26, 2023 •

edited

axcore commented Feb 27, 2023 •

edited

axcore commented Feb 27, 2023 •

edited