Why "no file extension" is a thing on Bunkr but not on Gofile?

[baccccccc]

I vaguely remember asking multiple times why CDL insists that every file needs to have an extension. IIRC the answer has been that we rely on extension for doing some pre-processing. This was mostly in the context of Bunkr links such as these.

https://bunkr.site/f/MissAlexaPearl---Fucking-Step-Bro-After-School-tsYbtd7G
https://bunkr.site/f/MissAlexaPearl---Step-Bro-Gets-A-Taste-a18Xwnvp
https://bunkr.site/f/MissAlexaPearl---Squirting-Her-Milk-On-You-XE3vAnGp

These files legitimately have no extension, which is indeed unfortunate. But I understand that CDL requires extensions, and I assumed that's true for every filehost.

So, today I was surprised when I encountered more files with no extensions. But this time it was on Gofile—and apparently CDL has no problem downloading them. Here's a full folder of such files: https://gofile.io/d/LdhOVy.

How comes this limitation only applies to Bunkr but no other filehosts? Is it because Gofile is smart and returns MIME type for the file while Bunkr is not?

If yes, is this something we could try to solve with the new ffmpeg integration? E.g., if file has no extension, try to probe it with ffmpeg just in case it's some know video type, and assign an extension based on that?

[NTFSvolume]

I tried a file form the GoFile link and still got a No File Extension Error.

DEBUG    Finishing scrape GET request to https://api.gofile.io/contents/crXQtY -> response status: 200
DEBUG    Pre-cache checks for response from https://api.gofile.io/contents/crXQtY: {'disabled cache': False, 'disabled method': False, 'disabled status': False, 'disabled by filter': True,
                             'disabled by headers or expiration params': False, 'expired': False}
ERROR    Scrape Failed: https://gofile.io/d/crXQtY (No File Extension)

You can force CDL to download files even if they have no extension: --no-exclude-files-with-no-extension

https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#exclude_files_with_no_extension

[baccccccc]

yeah, I have this in my config file: exclude_files_with_no_extension: false. Regardless, Bunkr links fail to download. (And that's why I completely forgot that I set this in the config.)

[NTFSvolume]

Found the bug. It's because bunkr uses custom filenames. We can fix it but i think we will have to drop the UUIDs from the database.

[baccccccc]

Thanks! While we're on it, can we try to get the extension from MIME type at least for the most common types? Gofile for sure does have it even in the web UI. Not sure about other filehosts.

[NTFSvolume]

That's not possible right now. We don't make request to the actual file until it is already at the downloader, which means it already cleared all the "should we download this file?" checks, including the file extension check