Release 3.16.6 · cloakedkeys/OF-Scraper-Community

Size limits

DRM videos below -sm are skipped, not failed: the size limits were checked on the audio and video tracks one by one, so with a minimum size the small audio track was "under size min" for almost every video, and the video then failed after all its retries. The limits now see the whole video (audio + video), and a video outside them is skipped straight away with no retries. #321, fixes #316
Size-skipped files are no longer saved as downloaded: a file skipped by -sm / -sx was recorded as done, so it was never tried again when you changed the limit. It is now counted as skipped and tried again next run. #326, fixes #319
Old rows from that bug are repaired: on the first start after upgrading, files the bug saved as downloaded with no file on disk are set back to not downloaded, so they're tried again. A backup is made first. Files that really were downloaded, and permanent skips, are left alone. #359, fixes #352
Files sent without a size now get the size limits and the skip script too. #342, fixes #336
A size skip stays a skip when a later error hits the same attempt, and the .part of a resumed file that's then skipped is removed. #347, #349, fixes #345 #348
DRM: when the audio track is skipped, the video track isn't downloaded either. #344, fixes #343
After-download script: size-skipped items reach your script as skipped with their real media type, not Forced_skipped. #337, fixes #332 #341

A skip is asked again next run: printing false (or nothing) skips the file for this run only. It's counted as skipped, not saved as downloaded, and the script is asked again next time. Each file is asked once per run. #357, fixes #350 #351
New: permanent skips: print skip-permanent to skip a file for good. It's saved as done with no file and not asked again. #357
New: undo permanent skips: --retry-permanent-skips asks the script again about permanently skipped files on a normal run, and ofscraper db --unmark-permanent-skips un-marks them by creator, --post-id or --media-id. Only permanent skips are touched. #362, fixes #354
DRM: when the script skips one track of a DRM video, the whole video is skipped. #331, fixes #325

Items skipped from the check table aren't marked downloaded, and the Downloaded column updates straight away. Skipped items can be added again. #355, fixes #353 #358
post_check lists streams posts, and applies timeline_strict to timeline posts. #327 #333, fixes #324 #329
msg_check skips inputs that don't match a creator, and reads usernames that contain digits. #338, fixes #334
24-hour times in the check table and the scrape summary. #339, fixes #335
--metadata no longer writes cached check data over newer rows. #346, fixes #340
The check table no longer crashes on posts with no date; they sort last. #370

Reading changes nothing: ofscraper db used to switch a database to WAL mode just by reading it, failed on read-only files, and created an empty file and folder for creators with no database. It now opens databases read-only, works on read-only files and network shares (\\server\share), and skips a creator with no database with a short message. A database it can't read is named and skipped, and the other creators still show. #374, fixes #373
Older databases work: databases missing newer columns no longer fail with "no such column", over all areas or picked areas. #365, fixes #364
Rows with no date show an empty date instead of crashing, and --export works with a custom date format. The table's columns stay in the same order every run. #367, fixes #366 #368
Shared databases: over all areas, a database that holds several creators now shows only the chosen creator's media. Per-area output gains the skip_permanent column. #372, fixes #371
--post-id and --media-id work: they never matched anything before. They take one id, or several separated by commas or spaces. #362, fixes #363

Downloaded state and post links are kept when merging databases. #297 #299, fixes #296 #298
A failed database no longer crashes the end of the merge, and failed databases are listed in the summary. #301 #308, fixes #300 #305
The merge screen works as asked: "Do another merge" Yes starts another merge, and No on the backup question or Back to Main Menu closes it. #303 #306, fixes #302 #304
The source folder is checked before the target is created, and no backup is made for a database created just now. #311 #313, fixes #310 #312

Posts and messages with no date no longer stop a scan without a word or crash the media filters. They're kept, downloaded with their media's date (or 1970-01-01), and logged with a warning, once per file. This covers OnlyFans and Fansly. #370 #377, fixes #369 #375
The last page of a timeline, archived or streams scan is kept. #330, fixes #322
Deleted posts are skipped in archived and streams lookups, and posts and messages that come back keep a cleared deleted flag. #320 #328, fixes #318 #323

A failed creator is shown: when something fails for one creator, a warning names the creator and the error at normal output, and the run moves on. Before, it only reached the traceback log. The same goes for a failed area of a scrape (timeline, messages, paid and so on), a failed daemon pass and the scheduler. A repeating scheduler error now waits its normal interval instead of looping. #380, fixes #379
metadata no longer crashes after locking stray items. #378, fixes #376
Main-menu actions that fail say so on screen. #309, fixes #307
The download count says how many files download at once. #293, fixes #291

New: Stash sync copies the OnlyFans and Fansly details of your downloads into Stash. See STASH.md for setup. #140
Purchase type, Fansly conversation id and mentions are now saved, and Stash sync uses them to link bought OnlyFans posts and Fansly messages to their pages. A Fansly message links to its conversation. #317 #356 #361, fixes #315 #360

Upgrade: uv tool upgrade ofscraper-community, pipx upgrade ofscraper-community or pip install -U ofscraper-community.

Full list: 3.16.5...3.16.6