v2.9-b11

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

Changes:

• The following changes have been made to the Tag/Caption Editor tab:
  • Tags to remove, Tags to replace, and Tags to append now sit under the Batch Tag Operations dropdown.
  • Made a change into the tag search that accounts for underscores.
  • Removed the button that switches between .txt and .caption file types.
  • Moved a button that lets you copy the tags of the current image to clipboard.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b10

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

Changes:

• Converted the Text Box in the Process Tags tab to be a List Box.
  • Double-clicking an item will add a tag to the Tags to remove box.
  • Shift + Double-clicking will add a tag to the Tags to emphasize box.
• Replaced the blurring function in Tag/Caption Editor tab. Clicking on the image display will pop it open in full resolution.
  • Use the mouse to zoom and pan around the image.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b09

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

Changes:

• Made improvements to the csv reader in Tag Editor.
  • Filter box uses fuzzy search now.
  • Shift + Double-clicking a tag now takes you to its respective Danbooru wiki page.
  • Adjusted the conditions when adding a tag from the list.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b08

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

New Features:

• Added a csv reader in the Tag Editor.
  • Added a filter box.
  • Double-clicking the tag will add the tag to the image.
  • Added a setting so you don't have to point to the .csv file every time the app is opened.
  • Note: This is best used with danbooru's tag spreadsheet as it follows a specific format. I don't know if this works with other spreadsheets like e621's.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b07

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

New Features:

• Added Tags to append in Process Tags.
  • Useful for adding after tags that already exist in each caption file.

Changes:

• Carried over changes to the logger from Particle1904's repo.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b06

What's Changed

• [QoL] GenerateTags - Added recursive (sub-folder) tag generation for easier & faster multi-folder datasets tagging by @LittleJ3lly in #2

Full Changelog: v2.9.0-b05...v2.9.0-b06

v2.9-b05

What's Changed

• [QoL] Generate tags same/diff output folder checkbox by @LittleJ3lly in #1
• Added a setting that can change tag highlighter colors
• Added WD ViT Large auto tagger model

New Contributors

• @LittleJ3lly made their first contribution in #1

Full Changelog: v2.9.0-b04...v2.9.0-b05

v2.9-b04

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

New Features:

• Added navigation hotkeys in Manual Crop.
  • Press F2/Mouse Button 4 to go to the next image. Press F1/Mouse Button 5 to go to the previous.
  • Press F3 to skip 10 images and F4 to go back 10.
  • Press F5 to skip 100 images and F6 to go back 100.
  • Notes: If you're navigating with your mouse, make sure it isn't over the image or else it'll try to create the crop area.
• Added new highlight colors in Tag/Caption Editor. Just add a line break. There are five colors and I'm considering the option to let users customize these colors.

Changes:

• The interface has been rearranged again in Manual Crop.
• Increased token limit counter to 225 in Tag/Caption Editor.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b03

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

New Features:

• Added option to save multiple crops in Manual Crop.
• Added slider to resize image preview in Manual Crop.

Changes:

• The interface has been rearranged to suit the additions in Manual Crop.

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!

v2.9-b02

Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.

The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.

For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.

New Features:

• Added aspect ratio constraints to Manual Crop.
• Added options to hide tabs in Settings (requires restart).

Requirements:

This software requires the following runtimes or newest versions, so be sure to install them:

.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model

For MAC users please check this issue on how to build yourself, don't forget to read Particle1904's comment!