e621updater rewritten in Python.
This script is mostly written by OpenAI ChatGPT. It works, at least on my PC.
There are a lot of things to improve in this code. Contributions are welcome.
You will need exiftool.exe (https://www.sno.phy.queensu.ca/~phil/exiftool/) in the working folder. It will be downloaded automatically if it doesn't exist.
Tested and working as python scripts via Python 3.10.11 and a bunch of dependencies listed in requirements.txt on Windows 10\11.
You can download the script in your Terminal:
git clone https://github.com/AyoKeito/e621updater-python
Or you can download a zip archive from Releases.
If needed, it creates a venv in the script's folder, installing needed requirements.
After that, it simply runs both scripts using this venv. database.py will start first with -m flag. tagger.py will start after that, with -f flag.
If you need to add or change any flags, you can do that using Notepad.
You can also run scripts manually, and\or without venv.
usage: tagger.py [-h] [-f] [-t] [-p FOLDER_PATH] [-n]
tagger.py SHOULD be run with -f, --in-file or -t, --in-txt command line arguments:
| Flag | Description |
|---|---|
-f, --in-file |
Write tags to image EXIF |
-t, --in-txt |
Write tags to sidecar txt files (useful for ML databases) |
Optionally, you can use the following command-line flags:
| Flag | Description |
|---|---|
-p FOLDER_PATH, --folder-path FOLDER_PATH |
Path to the folder containing the images, for example: F:\myfiles\test. If not set, will be selected via GUI. |
-n, --no-rename |
Do not rename the images if they are found by MD5 and not by name (you WON'T be able to tag them again) |
Warning: tagger.py requires parquet database of e621 posts and an additional tag database to separate artists from other tags.
usage: database.py [-h] [-p PROXY] [-m]
Optionally, you can use these flags:
| Flag | Description |
|---|---|
-p PROXY, --proxy PROXY |
The proxy to use for all network calls. Usage examples: http://proxy.server:8888 or http://user:password@proxy.server:8888 |
-m, --multithreaded |
Use Modin RAY engine for multithreaded operations on database. |
Warning: database.py downloads around 1.1GB of data from https://e621.net/db_export/ each time it's run. You will be asked if you want to update the local database if it was downloaded before. If local database doesn't exist, it will be downloaded unconditionally.
~7.5GB of free RAM is required to run it.
Around 4GB of files will be written to disk as a result: trimmed databases posts.parquet and artists.parquet and a temporary latest_posts.csv file.
You don't need to update them unless you want to tag files added to e621 since the last time you've updated the database.
Tagger WILL NOT succeed without the correctly prepared databases in it's working folder.
It will also fail to find any files uploaded to e621 after you've last updated the database via database.py.
If you have any problems running Modin\Ray with -m flag, simply remove it. If you want to avoid using temporary files for any reason, you can remove this flag and avoid 3GB of latest_posts.csv written to disk.