Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature?] Deforum can use Batch Controlnet (but it's pretty jank) #268

Closed
FizzleDorf opened this issue Feb 21, 2023 · 1 comment
Closed

Comments

@FizzleDorf
Copy link

I found a way to leak controlnet into Deforum img2img modes to create this sort of effect when I was doing some tests. Keep in mind it was pretty sloppy and took a few gens for me to realize what was happening.

Original video, Deforum only + Deforum project txt: 20230129152804_settings.txt

Controlnet + Deforum + Deforum project txt (same as original): 20230221114219_settings.txt

Controlnet input from batch img2img

"It's a feature"

Steps to reproduce:

  1. use controlnet in batch img2img using only controlnet (skip img2img process).
  2. Using Deforum img2img modes (2D or 3D modes) prompt an animation in the animation promt input.
  3. generate.

I haven't played around with the camera controls yet as I thought I should share for the possibility this gets implemented in a cleaner way but it is already possible without any sort of implementation in Deforum.

@yengalvez
Copy link

Steps to reproduce:

  1. use controlnet in batch img2img using only controlnet (skip img2img process).
  2. Using Deforum img2img modes (2D or 3D modes) prompt an animation in the animation promt input.
  3. generate.

I don't understand well... I'm trying to use Batch img2img to force Multi-ControlNet over 3D mode of Deforum. It's supposed that with this method I can do it? I tried this process but it doesn't work even with only canny. Deforum ControlNet works well, but i want to try multicontrolnet + deforum. Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants