Skip to content

Tag & Pool downloading

matty edited this page Oct 27, 2022 · 1 revision

Tag downloading is as fast as entering in a valid tag for the provider to search for, and letting the program do the work.

Notice: The information here is based on the INTERNAL e621 provider. Plugin providers may not include all functionalities it provides, it may also contain functionality not accounted for by the form. If a provider has information about how it works, read it.

Basic information about the form

There are two different forms that are used, depending on the booru selected: the danbooru-style 3 rating form and the philomena-style 5 rating form.

The top of both forms include a label that shows the current provider being used for downloading, and a text box with tag/pool name (or pool id before the first parse). The "?" button in the text box on the right side displays a message box with settings used for the current download. Each download has a cache of the settings before the download starts that will not be changed if settings are modified during the download.

The middle of the forms contain an array of textboxes. Each number represents a single file with that rating and designation. Currently, it should look like this:

downloading files 0
clean 0 0 0* 0 0* 0
graylisted 0 0 0* 0 0* 0
blacklisted 0 0 0* 0 0* 0
black-gray 0 0 0* 0 0* 0
existing files 0
clean 0 0 0* 0 0* 0
graylisted 0 0 0* 0 0* 0
blacklisted 0 0 0* 0 0* 0
black-gray 0 0 0* 0 0* 0
total explicit mature* questionable suggestive* safe

*suggestive and mature ratings do not appear if the form is not a philomena downloader.

Each column contains a value, the header with the single text box represents the total of the group, ie total download or total exist.

Below that is 6 more values, which are:

  • Inconsistent
    The files are not in their right folder or location, or they should not have been downloaded. They have been corrected.

  • Replaced
    The file hosted on the booru was changed in-place, and will be redownloaded. The existing file has been moved to a replaced folder in the designation folder.

  • Unavailable
    The file is deleted or cannot be downloaded for any reason.

  • Total parsed
    The amount of files parsed (so far).

  • Never download
    The amount of posts that are never download designated. If a tag download is being ran, it will not download those files. If a pool download is being ran, it will download them if save never download pages is enabled.

  • download size
    The size of the download, if the provider supports it and increments the download size value.

Finally, below that are two progress bars and the status bar. The top one displays current file progress, while the bottom one displays total files downloaded and will appear on the taskbar. The status bar displays the URL being accessed.

Inconsistent files

These files are either in the wrong location or they should not be downloaded. If a file is inconsistent, the downloader should move the file to the right location or delete it on the spot.

Replaced files

These files are posts that have had their file changed since the last download, such as a higher quality version. The downloader should move the file to a replaced folder to preserve the old version, in cases it may be desired, and it should add the updated version to the download queue.

Unavailable files

These files are not available to be downloaded. This may occur in cases where the file was deleted and cannot be downloaded even when knowing the link, or if the file link cannot be re-created or accessed without special access requirements, such in the case of the blocklist. See the next section.

Blocklist (e621)

e621 includes a type of "blocklist" that prevents posts with certain tags from appearing without an account. There is a workaround for this which allows the program to access them without logging in. If the file links could not be generated for whatever reason, the file will be considered unavailable and won't be downloaded.

Any plugin providers that have this functionality as well may require authentication. It's up to the provider to add this functionality when they need to (in a safe manner).

Clone this wiki locally