Find interesting timestamps in VTuber VODs using Youtube chat logs and use them to generate video clips.
Use to generate links from YouTube chat logs.
A Python 3.7+ environment with pip installed. Tested on Windows 10 and Linux. Should work with Mac OS. Also requires a YouTube Data API v3 key saved to key.txt. YouTube API keys are free but have a daily quota. It is recommended to set the terminal font to one that supports Japanese characters, such as "NSimSun" in Windows 10.
- Install the required Python dependencies"
pip3 install -r requirements.txt. - Ensure YouTube API key is saved to key.txt.
usage: auto_clip.py [-h] [-s START_DATE] [-e END_DATE] [-i IGNORE] [-y] [-o] [-f] [-u] [-r] [-c] [-x] [-d] group dir
Required arguments:
group - Name of group or one or more streamers (comma seperated) defined in streamers.py
dir - Output directory. Subdirectories are created in this directory. Output CSVs are stored in "dir/start_date/". Chat logs are stored in "dir/start_date/logs".
Optional arguments:
-h, --help Help message
-s START_DATE Provide a start date. If given, an end date is required. Default: 8 days ago.
-e END_DATE Provide an end date. If given, a start date is required. Default: 1 day ago.
-i IGNORE Provide a list of YouTube video IDs to skip. The script will freeze if there is an unaired premiere created before the end date.
-n Number of links to attempt to generate of each type. Less may be generated depending on number of chat regions of interest. Manual inspection is recommended to ensure links don't overlap.
-f FEATURE Provide one or more features to generate links for (comma seperated). By default all types of links are generated in seperate CSVs. Current feature types:
humor - Generate funny links (groupings of LOL, kusa, etc., sometimes generates links with discussions of these terms instead, or scenes about grass)
teetee - Generate wholesome (teetee) links (wholesome moments, works best on JP language streams)
faq - Generate FAQ links (may also generate links to "We Will Rock You" renditions)
lewd - Generate links to what chat believed was lewd
clip - Generate requested links (groupings of "clip this")
fail - Generate links to fails (F, RIP, and fail)
hic - Generate links to HIC groupings (for Amelia Watson streams)
superchat - Generate links to superchat groupings
Other options:
-o Adjust negative offset for feature grouping. Groupings are in 30-second buckets. Default: 30
-t Specify tz database timezone for start and end dates. Default: Asia/Tokyo
-c Compress logs (compress the log directory as a .tar.xz, requires tar utility)
-x Decompress logs (decompress the log directory, requires tar utility)
-d Download logs without generating links
-
Generate all links from 2021-05-03 to 2021-05-06 for Amelia and save to ./output directory. CSVs are in ./output/2021-05-03/.
python3 ./auto_link.py -s 2021-05-03 -e 2021-05-06 Amelia ./output -
Generate funny links only for HoloID Gen 2 from the past week and save to ./output directory. CSVs are in ./output/DATE_OF_8_DAYS_AGO/.
python3 ./auto_link.py -f humor hlid2 ./output -
Generate FAQ links for Miko and Calli from 2021-04-01 to 2021-04-30 and save to ./output directory. CSVs are in ./output/2021-04-01/.
python3 ./auto_link.py -s 2021-04-01 -e 2021-04-30 -f faq miko,calli ./output
Generate video clips / compilations from Auto-Link datasets. Requires Python 3.7+, youtube-dl and ffmpeg (in same directory or PATH).
Optionally requires the vcsi Python package for thumbnail generation. This YouTube channel has examples of generated videos.
- Generate data using Auto-Link or use the dataset from https://github.com/mipacd/auto-clip.
- Run on a CSV to generate a compilation:
python3 ./auto-clip-vid-gen.py -s hlen -t ../auto-clip/csv/hl/humor/2021-4-25.csv hlen-funny-comp-2021-04-25.mp4 - One minute clips from each stream are downloaded to ./clips/. Timestamps and channel citations are saved in description.txt.
--length, -l Length of clip. Clip starts from 30 seconds before region of interest and continues for 1 minute by default.
--streamer, -s Channel/Streamer. Use individual names seperated by commas or use a grouping defined in streamers.py
--no-concat, -n Download clips without concatinating into a compilation. Clips can be modified and combined in a subsequent run without the -n flag, given that all videos remain in the same format and the -d flag is not used.
--delete, -d Delete all clips from ./clips/ directory
--thumb, -t Lazy thumbnail generation. Requires the vcsi Python package: pip3 install vcsi
- Create video compilation from output of Auto-Link example 1
python3 ./auto_clip.py -c ./output/2021-05-03/funny_amelia_2021-05-03.csv output.mp4