Watchlist: Interesting new Models / Papers / Tech

[Acly]

This is a list of AI models, papers and ComfyUI nodes which might be candidates for integration into the plugin.

Guide to posting feature suggestions and requests:

• You found out about a project or new model? You want to post a link because you think it will make a good addition?
  • You're welcome to post links here in this discussion.
• You want to share an evaluation or image comparisons?
  • Feel free to open a separate discussion topic about your results .
• You want to contribute by implementing a new feature (in code)?
  • It's a good idea to create an "enhancement" issue to let everyone know.

Important

Please do not open separate issues / discussions just to post a link!

This helps avoid clutter. Keep in mind there are many shiny new things coming out all the time, and realistically only a fraction of them will be integrated.

How to make it happen?

In order of most likely success:

1. Implement it! (If you're unsure, discuss it first)
2. Evaluate and compare techniques (eg in ComfyUI), share images and workflows. It's a significant portion of the work, so it helps!
3. Comment/upvote in this discussion. One comment per feature allows people to thumbs-up to show support.

Control Layer

Project	Description	Comment
MistoLine / AnyLine	Line art detector and ControlNet	✅ v1.19.0
Xinsir CN models	Scribble, OpenPose, Canny for SDXL	✅ v1.19.0
IC-Light	Lighting/shading control	requires Layer-Diffusion
PuLID	Face adapter
Recolor	SDXL Control Lora
PhotoMaker	Face adapter (SDXL)	#388 No insightface

Performance

Project	Description	Comment
Trajectory Consistency Distillation (TCD)	Disstilled LoRA models + sampler for low-step (SD1.5, SDXL)	❌ LoRA, ❓ Sampler
Phased Consistency Model (PCM)	Distilled LoRA models (SD1.5, SDXL), allows CFG	Models, already works
Distribution Matching Distillation (DMD2)	Distilled 4-step LoRA models (SD1.5, SDXL)	❌ Prefer Hyper-SD
Automatic CFG	Rescaled CFG, can disable CFG to boost performance
Hyper-SD	Distilled 1/4/8-step LoRA models, allows CFG	✅ v1.19.0
HiDiffusion	High resolutions w/o 2-pass at improved speed	#651 ComfyUI Node
Align-Your-Steps (AYS)	Custom scheduler for low-step	#691
T-GATE	Attention caching
Improved ToMe (ToDo)	Token merging

Other

Project	Description	Comment
Layer-Diffusion	Alpha channel for image generation	#453
BrushNet	Inpaint extension model (SD1.5, SDXL)	ComfyUI node
ToonCrafter	Animation keyframe interpolation	ComfyUI node
SUPIR	Upscale model, diffusion	ComfyUI node
APISR	Upscale model, transformer	ComfyUI node

[syl1130]

nice work,please

[moonwhaler]

Vote: Control Layer - Xinsir CN models

[moonwhaler]

Vote: Other - Layer-Diffusion

[Rogal80]

Vote: MistoLine

[Rogal80]

Vote: Improved ToMe

[Towering-Toska]

Vote: Layer-Diffusion. Layer-Diffusion sounds exactly like what I would now like the most after using Krita-AI for a night. I wasn't aware of this type of plugin, I wonder if we can already manually install and use that with the Krita plugin.

[DaVinchik]

We need supir!

[xingewh]

InstantID。InstantID seems to perform better than FaceID.
(https://github.com/InstantID/InstantID)

[dkqjhoifh]

yes