Skip to content

(Client) Seth's AI Tools: An interactive Unity3D based Stable Diffusion front-end and testbed

License

Notifications You must be signed in to change notification settings

hbqdev/aitools_client

 
 

Repository files navigation

Seth's AI Tools: A Unity based front-end for Stable Diffusion WebUI (and other AI stuff)

License: BSD style attribution, see LICENSE.md

To use this, you'll need at least one Stable Diffusion WebUI server running somewhere. (same machine as the client is ok) This client supports either of the following servers:

AUTOMATIC1111's Stable Diffusion WebUI (must run with the --api parm)

or

Seth's AI Tools Server (Same as above but with a few extra features, including background removal)

Features

  • It's not a web app, it's a native locally run Windows .exe
  • Live update integration (image and masking) with Photoshop or other image editors
  • text to image, inpainting, image interrogation, face fixing, upscaling, tiled texture generation with preview, alpha mask subject isolation (background removal)
  • Drag and drop images in as well as paste images from the windows clipboard
  • Pan/zoom with thousands of images on the screen
  • Mask painting with controllable brush size
  • Can utilize multiple servers (three video cards on one machine? Run three servers!) allowing seamless use of all GPUs for ultra fast generation and a single click to change the active model
  • Neat workflow that allows evolving images with loopback while live-selecting the best alternatives to shape the image in real-time
  • Open source, uses the Unity game engine and C# to do stuff with AI art
  • Privacy respected - does not phone home or collect any statistics, purely local usage

Current version: V0.54 (released Dec 18th 2022) Recent changes:

  • Now also compatible with AUTOMATIC1111's stable-diffusion-webui server
  • BUGFIX in 0.54: Fixed problem where switching models would do nothing, choose wrong model, or not reflect the active model (cooperdk)
  • GUI in 0.54: Renamed Inpaint Strength to Denoising Strengh and Text Strength to CFG Scale. I originally named these when I was using my own backend. For clarity I've switched to Auto1111's naming scheme
  • FEAT in 0.54: If you click the gear icon next to the Generate button you get a generate options menu. This menu can also be opened during generation to see status info on what's happening.
  • FEAT in 0.54: Can adjust maximum images to generate/inpaint (y0himba)
  • FEAT in 0.54: Can enable a randomize prompt option. (cooperdk)

You only need to download the zip and run the .exe to use this, However, the source might be useful to generate a build for other platforms, fork or steal pieces to use for yourself. Go ahead!

Media (outdated movies of the app)

Setup

If using AUTOMATIC1111's Stable Diffusion WebUI, make sure it has been started with the --api parm. (additionally, with the --listen parm if it isn't on the local machine)

On Windows, an easy way to do that is to edit webui-user.bat and add them after the "set COMMANDLINE_ARGS=" part. Start the server by double clicking webui-user.bat.

Next run aitools_client.exe. Click on the "Configuration" button and a text editor will open with the default settings:

#add as many add_server commands as you want, just replace the localhost:7860 part with the
#server name/ip and port.  You can control any number of servers at the same time.

#You need at least one server running to work. It can be either an automatic1111 Stable Diffusion WebUI server or
#a Seth's AI Tools server which supports a few more features.  It will autodetect which kind it is.

add_server|http://localhost:7860

#kids around?  Then uncomment below to turn on the NSFW filter. 
#enable_safety_filter

#Set the below path and .exe to an image editor to use the Edit option. Changed files will auto
#update in here.

set_image_editor|C:\Program Files\Adobe\Adobe Photoshop 2023\Photoshop.exe

#set_default_sampler|DDIM
#set_default_steps|50

If your Stable Diffusion WebUI server isn't running locally or at port 7860, change the http://localhost:7860 part to where it is. Add multiple add_server commands for multiple servers.

NOTE: Using automatic1111, on the server side, you will see a scary error saying "RuntimeError: File at path D:\pro\stable-diffusion-webui\aitools\get_info.json does not exist.", this is ok, the app checks for the file to see what kind of server it is once at the start. It doesn't break anything.

Building from source

  • Requires Unity 2022.2+
  • Open the scene "Main" and click play to run

Credits and links

About

(Client) Seth's AI Tools: An interactive Unity3D based Stable Diffusion front-end and testbed

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C# 82.1%
  • ShaderLab 10.5%
  • HTML 2.7%
  • HLSL 2.2%
  • Batchfile 1.0%
  • GLSL 0.8%
  • Other 0.7%