Skip to content

Latest commit

 

History

History
35 lines (20 loc) · 3.97 KB

suggested_tools.md

File metadata and controls

35 lines (20 loc) · 3.97 KB

Tools and Notebooks

The AI art community has been sharing notebooks and making tools to use these models at an ever-increasing rate, to the point where lists of available options like this one from @pharmapsychotic can be fairly overwhelming! So, here are a chosen few that you might want to check out as a starting point.

Easy online tools

Dreamstudio is a fast and easy online interface for stable diffusion. You can do ~200 generations for free and then credits cost about $0.01 per image. There is also an API which let's you use their servers for inference, which is what powers things like this photoshop plugin for quickly generating images without a local GPU.

Artbreeder's new beta collage feature is a fun (and free) interface for image-to-image style generations.

There are a number of other online tools (midjourney, Wombo, NighCafe), typically with some sort of subscription or membership needed. And if you don't mind the occasional wait there are also spaces on HuggingFace that remain free and typically keep the interface simple.

Fancier Interfaces

People in the community have rushed to create new interfaces with additional advanced options for generation. For example, this stable diffusion webui by hlky has a choice of several slick interfaces. It has tabs for multiple tasks, batch functionality, integration of things like textual inversion, support for managing a number of model versions and much more. Settings are saved in the metadata of the resulting images, making it easy to access or share your favourite presets. This is great for running SD locally, but there is also a colab notebook if you'd prefer to use Google's GPUs. The InvokeAI Stable Diffusion toolkit is another new alternative worth exploring, and features a number of tools as well as optimizations for running locally with as little as 4GB RAM.

The other notable mention in terms of local interfaces is Softology's 'Visions of Chaos' tool, which makes it fairly easy to run a stagering number different notebooks/pipelines locally on Windows.

Colab Notebooks

There are hundreds of notebooks floating around adding different bits of functionality, but two of the most popular and fully-featured versions are

Deforum - a community-built notebook with lots of features (and many more planned) including settings for animations and video. Browsing Twitter for results will show the kinds of trippy animation this can make - by including a depth estimation model in the pipeline they've made it easy to get all sorts of interesting perspective warping motion into animations.

Disco Diffusion. Before we had Stable Diffusion, we had to use CLIP to guide unconditional diffusion models. This notebook shows how much you can do with that concept, producing amazing imagery and animations by steering the generation of an unconditional 512x512px diffusion model.

Keeping up with the space

News tools appear daily. Rather than chasing every new thing, I recommend spending some time learning a couple of tools well. YouTube channels like this one are a good place to see new things in action and evaluate whether you really need that new feature. Many tools also have a community where you can get involved sharing feedback or helping to add new features - keep an eye out for Discord links and get involved :)