v1.23.0

Changes

• [twitter] update user and author metdata fields
  • for URLs with a single username or ID like https://twitter.com/USER or a search with a single from: statement, user will now always refer to the user referenced in the URL.
  • for all other URLs like https://twitter.com/i/bookmarks, user and author refer to the same user
  • author will always refer to the original Tweet author
• [twitter] update quote_id and quote_by metadata fields
  • quote_id is now non-zero for quoted Tweets and contains the Tweet ID of the quotng Tweet (was the other way round before)
  • quote_by is only defined for quoted Tweets like before, but now contains the screen name of the user quoting this Tweet
• [skeb] improve archive IDs for thumbnails and article images

Additions

• [artstation] add num and count metadata fields (#2764)
• [catbox] add album extractor (#2410)
• [blogger] emit metadata for posts without files (#2789)
• [foolfuuka] update supported domains
• [gelbooru] add support for api_key and user_id (#2767)
• [gelbooru] implement pagination for pool results (#2853)
• [instagram] add support for a user's saved collections (#2769)
• [instagram] provide date for directory format strings (#2830)
• [kemonoparty] add favorites option (#2826, #2831)
• [oauth] add host config option (#2806)
• [rule34] implement pagination for pool results (#2853)
• [skeb] add option to download article images (#1031)
• [tumblr] download higher-quality images (#2761)
• [tumblr] add count metadata field (#2804)
• [wallhaven] implement metadata option (#2803)
• [zerochan] add tag and image extractors (#1434)
• [zerochan] implement login with username & password (#1434)
• [postprocessor:metadata] implement mode: modify and mode: delete (#2640)
• [formatter] add g conversion for slugifying a string (#2410)
• [formatter] apply :J only to lists (#2833)
• implement path-metadata option (#2734)
• allow comments after input file URLs (#2808)
• add global warnings option to control urllib3 warning behavior (#2762)

Fixes

• [bunkr] fix extraction (#2788)
• [deviantart] use public access token for journals (#2702)
• [e621] fix extraction of popular posts
• [fanbox] download cover images in original size (#2784)
• [mastodon] allow downloading without access token (#2782)
• [hitomi] update cache expiry time (#2863)
• [hitomi] fix error when number of tag results is a multiple of 25 (#2870)
• [mangahere] fix page-reverse option (#2795)
• [poipiku] fix posts with more than one image (#2796)
• [poipiku] update filter for static images (#2796)
• [slideshare] fix metadata extraction
• [twitter] unescape + in search queries (#2226)
• [twitter] fall back to unfiltered search (#2766)
• [twitter] ignore invalid user entries (#2850)
• [vk] prevent exceptions for broken/invalid photos (#2774)
• [vsco] fix collection extraction
• [weibo] prevent exception for missing playback_list (#2792)
• [weibo] prevent errors when paginating over album entries (#2817)

v1.22.4

Additions

• [instagram] add pinned metadata field (#2752)
• [itaku] categorize sections by group (#1842)
• [khinsider] extract platform metadata
• [tumblr] support /blog/view URLs (#2760)
• [twitter] implement strategy option (#2712)
• [twitter] add count metadata field (#2741)
• [formatter] implement O format specifier (#2736)
• [postprocessor:mtime] add value option (#2739)
• add --no-postprocessors command-line option (#2725)
• implement format-separator option (#2737)

Changes

• [pinterest] handle section pins with separate extractors (#2684)
• [postprocessor:ugoira] enable mtime by default (#2714)

Fixes

• [bunkr] fix extraction (#2732)
• [hentaifoundry] fix metadata extraction
• [itaku] fix user caching (#1842)
• [itaku] fix date parsing
• [kemonoparty] ensure all files have an extension (#2740)
• [komikcast] update domain
• [mangakakalot] update domain
• [newgrounds] only attempt to login if necessary (#2715)
• [newgrounds] prevent exception on empty results (#2727)
• [nozomi] reduce memory consumption during searches (#2754)
• [pixiv] fix default background filenames
• [sankaku] rewrite file URLs to s.sankakucomplex.com (#2746)
• [slideshare] fix description extraction
• [twitter] ignore previously seen Tweets (#2712)
• [twitter] unescape HTML entities in content (#2757)
• [weibo] handle invalid or broken status objects
• [postprocessor:zip] ensure target directory exists (#2758)
• make brotli an optional dependency (#2716)
• limit path length for --write-pages output on Windows (#2733)

Removals

• [foolfuuka] remove archive.wakarimasen.moe

v1.22.3

Changes

• [twitter] revert strategy changes for user URLs (#2712, #2710)
• update default User-Agent headers

v1.22.2

Additions

• [cyberdrop] add fallback URLs (#2668)
• [horne] add support for horne.red (#2700)
• [itaku] add gallery and image extractors (#1842)
• [poipiku] add user and post extractors (#1602)
• [skeb] add following extractor (#2698)
• [twitter] implement expand option (#2665)
• [twitter] implement csrf option (#2676)
• [unsplash] add collection_title and collection_id metadata fields (#2670)
• [weibo] support tabtype=video listings (#2601)
• [formatter] implement slice operator as format specifier
• support cygwin/BSD/etc for --cookies-from-browser

Fixes

• [instagram] improve metadata generated by _parse_post_api() (#2695, #2660)
• [instagram} fix tag extractor (#2659)
• [instagram] automatically invalidate expired login sessions
• [twitter] fix pagination for conversion tweets
• [twitter] improve "replies": "self" (#2665)
• [twitter] improve strategy for user URLs (#2665)
• [vk] take URLs from *_src entries (#2535)
• [weibo] fix URLs generated by user extractor (#2601)
• [weibo] fix retweets (#2601)
• [downloader:ytdl] update _set_outtmpl() (#2692)
• [formatter] fix !j conversion for non-serializable types (#2624)
• [snap] Fix missing libslang dependency (#2655)

v1.22.1

Additions

• [gfycat] add support for collections (#2629)
• [instagram] support specifying users by ID
• [paheal] extract more metadata (#2641)
• [reddit] add home extractor (#2614)
• [weibo] support usernames in URLs (#1662)
• [weibo] support livephoto and gif files (#2146)
• [weibo] add support for several different tabtype listings (#686, #2601)
• [postprocessor:metadata] write to stdout by setting filename to "-" (#2624)
• implement output.ansi option (#2628)
• support user-defined output.mode settings (#2529)

Changes

• [readcomiconline] remove default browser setting (#2625)
• [weibo] switch to desktop API (#2601)
• fix command-line argument name of --cookies-from-browser (#1606, #2630)

Fixes

• [bunkr] change domain to app.bunkr.is (#2634)
• [deviantart] fix folder listings with "pagination": "manual" (#2488)
• [gofile] fix 401 Unauthorized errors (#2632)
• [hypnohub] move to gelbooru_v02 instances (#2631)
• [instagram] fix and update extractors (#2644)
• [nozomi] remove slashes from search terms (#2653)
• [pixiv] include .gif in background fallback URLs (#2495)
• [sankaku] extend URL patterns (#2647)
• [subscribestar] fix date metadata (#2642)

v1.22.0

Additions

• [gelbooru_v01] add favorite extractor (#2546)
• [Instagram] add tagged_users to keywords for stories (#2582, #2584)
• [lolisafe] implement domain option (#2575)
• [naverwebtoon] support (best)challenge comics (#2542)
• [nijie] support /history_nuita.php listings (#2541)
• [pixiv] provide more data when metadata is enabled (#2594)
• [shopify] support several more sites by default (#2089)
• [twitter] extract alt texts as description (#2617)
• [twitter] recognize vxtwitter URLs (#2621)
• [weasyl] implement metadata option (#2610)
• implement --cookies-from-browser (#1606)
• implement output.colors options (#2532)
• implement string literals in replacement fields
• support using extended format strings for archive keys

Changes

• [foolfuuka] match 4chan filenames (#2577)
• [pixiv] implement include option
  • provide avatar/background downloads as separate extractors (#2495)
• [twitter] use a better strategy for user URLs
• [twitter] disable cards by default
• delay directory creation (#2461, #2474)
• flush writes to stdout/stderr (#2529)
• build executables on GitHub Actions with Python 3.10

Fixes

• [artstation] use "browser": "firefox" by default (#2527)
• [imgur] prevent exception with empty albums (#2557)
• [instagram] report redirects to captcha challenges (#2543)
• [khinsider] fix metadata extraction (#2611)
• [mangafox] send Referer headers (#2592)
• [mangahere] send Referer headers (#2592)
• [mangasee] use randomly generated PHPSESSID cookie (#2560)
• [pixiv] make retrieving ugoira metadata non-fatal (#2562)
• [readcomiconline] update deobfuscation code (#2481)
• [realbooru] fix extraction (#2530)
• [vk] handle photos without width/height info (#2535)
• [vk] fix user ID extraction (#2535)
• [webtoons] extract real episode numbers (#2591)
• create missing directories for archive files (#2597)
• detect circular references with -K (#2609)
• replace "\f" in --filename arguments with a form feed character (#2396)

Removals

• [gelbooru_v01] remove tlb.booru.org from supported domains

v1.21.2

Additions

• [deviantart] implement pagination option (#2488)
• [pixiv] implement background option (#623, #1124, #2495)
• [postprocessor:ugoira] report ffmpeg/mkvmerge errors (#2487)

Fixes

• [cyberdrop] match cyberdrop.to URLs (#2496)
• [e621] fix 403 errors (#2533)
• [issuu] fix extraction (#2483)
• [mangadex] download from available chapters despite externalUrl (#2503)
• [photovogue] update domain and api endpoint (#2494)
• [sexcom] add fallback for empty files (#2485)
• [twitter] improve syndication video selection (#2354)
• [twitter] fix various syndication issues (#2499, #2354)
• [vk] fix extraction (#2512)
• [weibo] fix infinite retries for deleted accounts (#2521)
• [postprocessor:ugoira] use compatible paths with mkvmerge (#2487)
• [postprocessor:ugoira] do not auto-select the image2 demuxer (#2492)

v1.21.1

Additions

• [gofile] add gofile.io extractor (#2364)
• [instagram] add previews option (#2135)
• [kemonoparty] add duplicates option (#2440)
• [pinterest] add extractor for created pins (#2452)
• [pinterest] support multiple files per pin (#1619, #2452)
• [telegraph] Add telegra.ph extractor (#2312)
• [twitter] add syndication option (#2354)
• [twitter] accept fxtwitter.com URLs (#2484)
• [downloader:http] support using an arbitrary method and sending POST data (#2433)
• [postprocessor:metadata] implement archive options (#2421)
• [postprocessor:ugoira] add mtime option (#2307)
• [postprocessor:ugoira] support setting timecodes with mkvmerge (#1550)
• [formatter] support evaluating f-string literals
• add --ugoira-conv-copy command-line option (#1550)
• implement a contains() function for filter statements (#2446)

Fixes

• [aryion] provide correct date metadata independent of DST
• [furaffinity] fix search result pagination (#2402)
• [hitomi] update and fix metadata extraction (#2444)
• [kissgoddess] extract all images (#2473)
• [mangasee] unescape manga names (#2454)
• [newgrounds] update and fix pagination (#2456)
• [newgrounds] warn about age-restricted posts (#2456)
• [pinterest] do not force m3u8_native for video downloads (#2436)
• [twibooru] fix posts without name (#2434)
• [unsplash] replace dash with space in search API queries (#2429)
• [postprocessor:mtime] fix timestamps from datetime objects (#2307)
• fix yet another bug in _check_cookies() (#2372)
• fix loading/storing cookies without domain

v1.21.0

Additions

• [fantia] add num enumeration index (#2377)
• [fantia] support "Blog Post" content (#2381)
• [imagebam] add support for /view/ paths (#2378)
• [kemonoparty] match beta.kemono.party URLs (#2348)
• [kissgoddess] add gallery and model extractors (#1052, #2304)
• [mememuseum] add tag and post extractors (#2264)
• [newgrounds] add post_url metadata field (#2328)
• [patreon] add image_large file type (#2257)
• [toyhouse] support art listings (#1546, #2331)
• [twibooru] add extractors for searches, galleries, and posts (#2219)
• [postprocessor:metadata] implement mtime option (#2307)
• [postprocessor:mtime] add event option (#2307)
• add fish shell completion (#2363)
• add timedelta class to global namespace in filter expressions

Changes

• [seiga] require authentication with user_session cookie (#2372)
  • remove username & password login due to 2FA
• refactor proxy support (#2357)
  • allow gallery-dl proxy settings to overwrite environment proxies
  • allow specifying different proxies for data extraction and download

Fixes

• [bunkr] fix mp4 downloads (#2239)
• [fanbox] fetch data for each individual post (#2388)
• [hentaicosplays] send Referer header (#2317)
• [imagebam] set nsfw_inter cookie (#2334)
• [kemonoparty] limit default filename length (#2373)
• [mangadex] fix chapters without translatedLanguage (#2352)
• [newgrounds] fix video descriptions (#2328)
• [skeb] add sent-requests option (#2322, #2330)
• [slideshare] fix extraction
• [subscribestar] unescape attachment URLs (#2370)
• [twitter] fix handling of 429 Too Many Requests responses (#2339)
• [twitter] warn about age-restricted Tweets (#2354)
• [twitter] handle Tweets with "softIntervention" entries
• [twitter] update query hashes
• fix another bug in _check_cookies() (#2160)

v1.20.5

Additions

• [furaffinity] add layout option (#2277)
• [lightroom] add Lightroom gallery extractor (#2263)
• [reddit] support standalone submissions on personal user pages (#2301)
• [redgifs] support i.redgifs.com URLs (#2300)
• [wallpapercave] add extractor for images and search results (#2205)
• add signals-ignore option (#2296)

Changes

• [danbooru] merge danbooru and e621 extractors
  • support atfbooru (#2283)
  • remove support for old e621 tag search URLs

Fixes

• [furaffinity] improve new/old layout detection (#2277)
• [imgbox] fix ImgboxExtractor (#2281)
• [inkbunny] rename search parameters to their API equivalents (#2292)
• [kemonoparty] handle files without names (#2276)
• [twitter] fix extraction (#2275, #2295)
• [vk] fix infinite pagination loops (#2297)
• [downloader:ytdl] make ImportError non-fatal (#2273)