Skip to content
This repository has been archived by the owner on Jan 31, 2024. It is now read-only.

Commit

Permalink
update to version 0.4
Browse files Browse the repository at this point in the history
- rewrote major parts of the codebase
- rebranded to Fansly Downloader
- additonal module requirements: json, m3u8, av, time, mimetypes
    - from which only: m3u8 & av need to be installed
- option naming_convention is now deprecated & gets removed automatically
- re-named all major variables, to be more descriptive
- now reading value types, properly out of the config.ini file
- config.ini input values are now actually being validated for correctness
    - e.g. user-agent is automatically guessed now, if invalid
- update_recent_download has been improved drastically
    - now only supports Auto or False
    - its enabled by default now
    - it will be way quicker, by utilising deduplication
    - deduplication is done through 1. media id & 2. hashing now
    - hashes are added to filenames initially
    - filenames with hashes, will not get hashed again
- epoch timestamps are now converted into local systems timezone
- added alot of comments to codebase, for easier understanding
- CWD is now way more intelligently handled for all modules utilising generate_base_dir()
- added type annotations to function arguments for functions
- adapted fansly scraper for the new m3u8 video format
    - required: pyav -> pip install av
    - required: m3u8 -> pip intall m3u8
- added DUPLICATE_THRESHOLD; prevents unnecessary computation or requests to fansly
    - raises DuplicateCountError if dynamically calculated limit is exceeded
- all "modules" (Timeline, Messages etc.) are now tunneled through sort_download()
    - sort_download is a re-written version of the old namesaked function
    - it handles allocating downloads way more efficiently
    - adds media ids to filenames initially
    - if media ids are in filenames; uses them to perform deduplication with media id
    - supports all types of file extensions & mimetypes now
    - imagehash performance improved, by resizing image to 10% of original resolution b4
- all "modules" will now utilise parse_media_info() to interact with the fansly api
    - way more efficent; it doesn't just iterate & try / except blocks everything as b4
- all functions of fansly scraper are separated in modules / sections w/e
    - improves maintenance in the future & increases human readability
- re-wrote & improved logic for timeline & messages downloads
- added module for collections (#12)
- fansly downloader will now output more descriptive texts, to the currently taken action
- improved error robustness a little, need to more in the future though

fixed issues:
- fixed a issue with not escaping apostrophes on macOS (#78)
- fixed subscriber content missing (#59)
- all media file extensions are now supported (#75)
- fixed download_mode: single
    - fixed key-pair-id missing
    - fixed incorrect parsing of post creator
  • Loading branch information
Avnsx committed May 21, 2023
1 parent 7040b70 commit 8c591cb
Show file tree
Hide file tree
Showing 2 changed files with 1,235 additions and 783 deletions.

0 comments on commit 8c591cb

Please sign in to comment.