Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to connect the node like A111 "my prompt is more important" #24

Closed
xueqing0622 opened this issue Nov 2, 2023 · 9 comments
Closed

Comments

@xueqing0622
Copy link

I'm going to make a single image use controlnet like A111, is this the right way to connect the node like this?
image

image
image

@Kosinkadink
Copy link
Owner

Yep, that would be one way to hook it up. To clarify, the Scaled Soft ControlNet Weights node and the Soft ControlNet Weights node, with the default values, are the same:
image

The only difference is, Scaled Soft ControlNet Weights will automatically scale the values as you wish, while Soft ControlNet Weights lets you manually change any layer of the controlnet, which is more involved. So you can just use the Scaled Soft ControlNet Weights node instead - and changing the base_multiplier on it can let you give the controlnet more freedom (AKA, make prompt even more important) if decreasing the value, or give controlnet less freedom (AKA, make prompt 'less' important) if increasing the value closer to 1. The default value, 0.825, is the value used by "my prompt is more important" in Auto1111 as explained in that screenshot you have, so that's why it's that value by default.

If you are not using any other features of the Timestep Keyframe node, you can also skip it by connecting the TIMESTEP_KEYFRAME output of the ControlNet Weights nodes to Load ControlNet Model (Advanced). Internally, it creates a placeholder Timestep Keyframe with default values so that you don't have to have a middleman Timestep Keyframe to just use the weights if not using anything else on the Timestep Keyframe:
image

@xueqing0622
Copy link
Author

Thx, Kosinkadink, This helps me a lot to understand this node.
Have a nice day!

@curlysasha
Copy link

What value for "controlnet is more important"?

@alenknight
Copy link

my prompt is more important

i too am curious about this. i figured out how to get it "balanced" and "my prompt is more important"... but controlnet is more important seems to be confusing me. i can KINDA get there by "flip weights" option.... and reducing it very low... but it's not 1:1... not even close.

@Kosinkadink
Copy link
Owner

Kosinkadink commented Feb 22, 2024

"ControlNet is more important" is not implemented yet. I'll look into it at end of February/start of March

@rohitpaul23
Copy link

@Kosinkadink any improvement ?

@yano
Copy link

yano commented Apr 26, 2024

comfyanonymous/ComfyUI#605 This connection is similar to 'My prompt is more important' and may be helpful.

@Kosinkadink
Copy link
Owner

Kosinkadink commented Apr 26, 2024

"My prompt is more important" is already implemented via Scaled Soft Weights. It's "controlNet is more important" that is not implemented yet. I'll be circling back to Advanced-ControlNet dev work soon, where that will be one of the things I'll look into implementing in some way.

@Kosinkadink
Copy link
Owner

Kosinkadink commented May 16, 2024

"ControlNet is more important" is now also supported as of the latest Advanced-ControlNet update, explained here and on the README:
#87 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants