Archive setting doesn't seem to work when file is below downloader.filesize-min

[Skaronator]

I configured extractor.archive to avoid downloading files twice. So far, everything works except for files that are below my downloader.filesize-min limit.

[urllib3.connectionpool][debug] https://coomer.su:443 "GET /api/v1/fansly/user/xxxx?o=500 HTTP/1.1" 200 35303
[urllib3.connectionpool][debug] https://coomer.su:443 "GET /data/13/03/xxxx.mp4 HTTP/1.1" 302 138
[urllib3.connectionpool][debug] Resetting dropped connection: c2.coomer.su
[urllib3.connectionpool][debug] https://c2.coomer.su:443 "GET /data/13/03/xxxx.mp4 HTTP/1.1" 200 92190141
[downloader.http][warning] File size smaller than allowed minimum (92190141 < 104857600)
[download][error] Failed to download 2021-08-24 - Past post 2021.02.20 - 01.mp4

(I run gallery-dl in a cronjob every day and this file is from 2021 and its "still" not in my archive.db)

It looks like gallery-dl will try to download these files just to find out (via HTTP Header, not actually downloading it) that they are too small.

Is there any way to avoid re-checking these files with each run? Ideally, these should be added to my archive.db just like finished downloaded objects.

[mikf]

downloader.filesize-min and -max get currently handled as download failure, and a failed download does not get added to the archive.

You could do a second run with --no-download to fill in all the missing files into your archive.

[Skaronator]

Thanks for the prompt response. --no-download would work for the initial batch of all files, but doesn't really solve the underling issue.

It would be great to have an option to configure this behavior. Maybe filesize-error-mode that can either be error or success?

[mikf]

Downloads now get skipped when they don't pass a filesize-min/max check and get properly written to an archive. (ea78f67)

[Skaronator]

Awesome!