yt-dlp 2023.09.24

A description of the various files are in the README

---

Important changes

• The minimum recommended Python version has been raised to 3.8
  Since Python 3.7 has reached end-of-life, support for it will be dropped soon. Read more
• Security: [CVE-2023-40581] Prevent RCE when using --exec with %q on Windows
  • The shell escape function is now using "" instead of \".
  • utils.Popen has been patched to properly quote commands.

Changelog

Core changes

• Fix HTTP headers and cookie handling by bashonly, pukkandan
• Fix --check-formats by pukkandan
• Fix support for upcoming Python 3.12 (#8130) by Grub4K
• Merged with youtube-dl 66ab08 by coletdjnz
• Prevent RCE when using --exec with %q (CVE-2023-40581) by Grub4K
• Raise minimum recommended Python version to 3.8 (#8183) by Grub4K
• FFmpegFixupM3u8PP may need to run with ffmpeg by pukkandan
• compat
  • Add types.NoneType by pukkandan (With fixes in 25b6e8f)
  • Deprecate old functions (#2861) by coletdjnz, pukkandan
  • Ensure submodules are imported correctly by pukkandan
• cookies: Containers JSON should be opened as utf-8 (#7800) by bashonly
• dependencies: Handle deprecation of sqlite3.version (#8167) by bashonly
• outtmpl: Fix replacement for playlist_index by pukkandan
• utils
  • Add temporary shim for logging by pukkandan
  • Improve parse_duration by bashonly
  • HTTPHeaderDict: Handle byte values by pukkandan
  • clean_podcast_url: Handle more trackers (#7556) by bashonly, mabdelfattah
  • js_to_json: Handle Array objects by Grub4K, std-move

Extractor changes

• Extract subtitles from SMIL manifests (#7667) by bashonly, pukkandan
• Fix --load-pages by pukkandan
• Make _search_nuxt_data more lenient by std-move
• abematv
  • Fix proxy handling (#8046) by SevenLives
  • Temporary fix for protocol handler by pukkandan
• amazonminitv: Fix extractors by bashonly, GautamMKGarg
• antenna: Support antenna.gr (#7584) by stdedos
• artetv: Fix HLS formats extraction by bashonly
• axs: Add extractor (#8094) by barsnick
• banbye: Support video ids containing a hyphen (#8059) by kshitiz305
• bbc: Extract tracklist as chapters (#7788) by garret1317
• bild.de: Extract HLS formats (#8032) by barsnick
• bilibili
  • Add support for series, favorites and watch later (#7518) by c-basalt
  • Extract Dolby audio formats (#8142) by ClosedPort22
  • Extract format_id (#7555) by c-basalt
• bilibilibangumi: Fix extractors (#7337) by GD-Slime
• bpb: Overhaul extractor (#8119) by Grub4K
• brilliantpala: Add extractors (#6680) by pzhlkj6612
• canal1, caracoltvplay: Add extractors (#7151) by elyse0
• cbc: Ignore any 426 from API (#7689) by makew0rld
• cbcplayer: Extract HLS formats and subtitles (#7484) by trainman261
• cbcplayerplaylist: Add extractor (#7870) by trainman261
• cineverse: Add extractors (#8146) by garret1317
• crunchyroll: Remove initial state extraction (#7632) by Grub4K
• douyutv: Fix extractors (#7652) by c-basalt
• dropbox: Fix extractor (#7926) by bashonly, denhotte, nathantouze (With fixes in 099fb1b by bashonly)
• eplus: inbound: Add extractor (#5782) by pzhlkj6612
• expressen: Improve _VALID_URL (#8153) by kylegustavo
• facebook
  • Add dash manifest URL (#7743) by ringus1
  • Fix webpage extraction (#7890) by ringus1
  • Improve format sorting (#8074) by fireattack
  • reel: Fix extraction (#7564) by bashonly, demon071
• fox: Support foxsports.com (#7724) by ischmidt20
• funker530: Fix extraction (#8040) by 04-pasha-04
• generic
  • Fix KVS thumbnail extraction by bashonly
  • Fix generic title for embeds by pukkandan
• gofile: Update token by bashonly
• hotstar
  • Extract release_year (#7869) by Rajeshwaran2001
  • Make metadata extraction non-fatal by bashonly
  • Support /clips/ URLs (#7710) by bashonly
• hungama: Overhaul extractors (#7757) by bashonly, Yalab7
• indavideoembed: Fix extraction (#8129) by aky-01
• iprima: Fix extractor (#7216) by std-move
• lbry: Fix original format extraction (#7711) by bashonly
• lecturio: Improve _VALID_URL (#7649) by simon300000
• magellantv: Add extractor (#7616) by bashonly
• massengeschmack.tv: Fix title extraction (#7813) by sb0stn
• media.ccc.de: lists: Fix extraction (#8144) by Rohxn16
• mediaite: Fix extraction (#7923) by Grabien
• mediaklikk: Fix extractor (#8086) by bashonly, zhallgato
• mediastream: Make embed extraction non-fatal by bashonly
• mixcloud: Update API URL (#8114) by garret1317
• monstercat: Add extractor (#8133) by garret1317
• motortrendondemand: Update _VALID_URL (#7683) by AmirAflak
• museai: Add extractor (#7614) by bashonly
• mzaalo: Improve _VALID_URL by bashonly
• n1info: article: Fix extractor (#7373) by u-spec-png
• nfl.com: plus, replay: Fix extractor (#7838) by bashonly
• niconicochannelplus: Add extractors (#5686) by pzhlkj6612
• nitter: Fix title extraction fallback (#8102) by ApoorvShah111
• noodlemagazine: Fix extraction (#7830) by RedDeffender (With fixes in 69dbfe0 by bashonly)
• novaembed: Fix extractor (#7910) by std-move
• patreoncampaign: Fix extraction (#7664) by bashonly
• pbs: Add extractor PBSKidsIE (#7602) by snixon
• piapro: Support /content URL (#7592) by FinnRG
• piaulizaportal: Add extractor (#7903) by pzhlkj6612
• picartovod: Fix extractor (#7727) by Frankgoji
• pornbox: Add extractor (#7386) by niemands
• pornhub: Update access cookies for UK (#7591) by zhong-yiyu
• pr0gramm: Rewrite extractor (#8151) by Grub4K
• radiofrance: Add support for livestreams, podcasts, playlists (#7006) by elyse0
• rbgtum: Fix extraction and support new URL format (#7690) by simon300000
• reddit
  • Extract subtitles by bashonly
  • Fix thumbnail extraction by bashonly
• rtvslo: Fix format extraction (#8131) by bashonly
• rule34video: Extract tags (#7117) by soundchaser128
• rumble: Fix embed extraction (#8035) by trislee
• s4c
  • Add extractor (#7730) by ifan-t
  • Add series support and extract subs/thumbs (#7776) by ifan-t
• sohu: Fix extractor (#7628) by bashonly, c-basalt
• stageplus: Fix m3u8 extraction (#7929) by bashonly
• streamanity: Remove (#7571) by alerikaisattera
• svtplay: Fix extraction (#7789) by dirkf, wader
• tbsjp: Add episode, program, playlist extractors (#7765) by garret1317
• tiktok
  • Fix audio-only format extraction (#7712) by bashonly
  • Fix webpage extraction by bashonly
• triller: Fix unlisted video extraction (#7670) by bashonly
• tv5mondeplus: Fix extractor (#7952) by dirkf, korli
• twitcasting
  • Improve _VALID_URL (#8120) by c-basalt
  • Support --wait-for-video (#7975) by at-wat
• twitter
  • Add fallback, improve error handling (#7621) by bashonly
  • Fix GraphQL and legacy API (#7516) by bashonly
  • Fix retweet extraction and syndication API (#8016) by bashonly
  • Revert 92315c03774cfabb3a921884326beb4b981f786b by pukkandan
  • spaces
    • Fix format protocol (#7550) by bashonly
    • Pass referer header to downloader by bashonly
• unsupported: List more sites with DRM by pukkandan
• videa: Fix extraction (#8003) by aky-01, hatsomatt
• vrt: Update token signing key (#7519) by Zprokkel
• wat.tv: Fix extraction (#7898) by davinkevin
• wdr: Fix extraction (#7979) by szabyg
• web.archive: vlive: Remove extractor (#8132) by bashonly
• weibo: Fix extractor and support user extraction (#7657) by c-basalt
• weverse: Support extraction without auth (#7924) by seproDev
• wimbledon: Add extractor (#7551) by nnoboa
• wrestleuniverseppv: Fix HLS AES key extraction by bashonly
• youtube
  • Add player_params extractor arg (#7719) by coletdjnz
  • Fix player_params arg being converted to lowercase by coletdjnz
  • Fix consent cookie (#7774) by coletdjnz
  • tab: Detect looping feeds (#6621) by coletdjnz
• zaiko: Improve thumbnail extraction (#8054) by pzhlkj6612
• zee5: Update access token endpoint (#7914) by bashonly
• zoom: Extract duration by bashonly

Downloader changes

• external
  • Fix ffmpeg input from stdin (#7655) by bashonly
  • Fixes to cookie handling by bashonly

Postprocessor changes

• embedthumbnail: Support m4v (#7583) by Neurognostic

Networking changes

• Add module (#2861) by pukkandan
• Add request handler preference framework (#7603) by coletdjnz
• Add strict Request extension checking (#7604) by coletdjnz
• Fix POST requests with zero-length payloads (#7648) by bashonly
• Fix --legacy-server-connect (#7645) by bashonly
• Fix various socks proxy bugs (#8065) by coletdjnz
• Ignore invalid proxies in env (#7704) by coletdjnz
• Rewrite architecture (#2861) by coletdjnz
• Request Handler
  • urllib
    • Remove dot segments during URL normalization (#7662) by coletdjnz
    • Simplify gzip decoding (#7611) by Grub4K (With fixes in 77bff23)

Misc. changes

• build: Make sure deprecated modules are added by pukkandan
• cleanup
  • Add color to download-archive message (#5138) by aaruni96, Grub4K, pukkandan
  • Miscellaneous
    • 6148833, 62b5c94 by pukkandan
    • 5ca095c by barsnick, bashonly, coletdjnz, gamer191, Grub4K, sqrtNOT
    • 088add9 by Grub4K
• devscripts: make_changelog: Fix changelog grouping and add networking group (#8124) by Grub4K
• docs: Update collaborators by Grub4K
• test
  • Add tests for socks proxies (#7908) by coletdjnz
  • Fix httplib_validation_errors test for old Python versions (#7677) by coletdjnz
  • Fix test_load_certifi by pukkandan
  • download: Test for expected_exception by at-wat