Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to set clip skip value in comfyui #2223

Open
lucasjinreal opened this issue Dec 8, 2023 · 11 comments
Open

How to set clip skip value in comfyui #2223

lucasjinreal opened this issue Dec 8, 2023 · 11 comments

Comments

@lucasjinreal
Copy link

In webui there is a slider which set clip skip value,

how to do it in comfyui

image

Also, I am very confused by why comfy ui can not genreate same images compare with webui of same model

not even close.

https://civitai.com/models/43331/majicmix-realistic

this model image are really far from what I get, any body knows why?

this is my workflow.

workflow_sd1.5_upscale_fixed.json

@ltdrdata
Copy link
Contributor

ltdrdata commented Dec 8, 2023

image

Just ComfyUI's node requires negative value.
stop_at_clip_layer = -2 is equivalent to clipskip = 2

@lucasjinreal
Copy link
Author

@ltdrdata thanku! very helpful.
I setted clip skip, but still can not really get a approximate result as the model announced,

this is I got:

image

I have using 30 steps, generate, same prompt, and I scaled, the result like oil painint, but this is what I want:

image

Can u see why?

@ltdrdata
Copy link
Contributor

ltdrdata commented Dec 8, 2023

Your token weights are too high. You should not give weights same with A1111.

@lucasjinreal
Copy link
Author

lucasjinreal commented Dec 8, 2023

@ltdrdata hi, how to set the token weights can u elebrate?
Do u mean cfg? from the webiste it says using 7.0,

does there any a calculate formate between A1111 and comfyui? How?

@lucasjinreal
Copy link
Author

@ltdrdata You might know magic, bro!

image

@JarekDerp
Copy link

Don't raise issues if you have a question. Ask on Reddit or Discord somewhere. This area is for bugs and report problems with the apps to devs. Also, mark your issues as closed when it's solved.

@rovo79
Copy link

rovo79 commented Dec 21, 2023

@lucasjinreal

up and down weighting

The importance of parts of the prompt can be up or down-weighted by enclosing the specified part of the prompt in brackets using the following syntax: (prompt:weight). E.g. if we have a prompt flowers inside a blue vase and we want the diffusion model to empathize the flowers we could try reformulating our prompt into: (flowers:1.2) inside a blue vase. Nested loops multiply the weights inside them, e.g. in the prompt ((flowers:1.2):.5) inside a blue vase flowers end up with a weight of 0.6. Using only brackets without specifying a weight is shorthand for (prompt:1.1), e.g. (flower) is equal to (flower:1.1). To use brackets inside a prompt they have to be escaped, e.g. \(1990\). ComfyUI can also add the appropriate weighting syntax for a selected part of the prompt via the keybinds Ctrl+Up and Ctrl+Down. The amount by which these shortcuts up or down-weight can be adjusted in the settings.

https://blenderneko.github.io/ComfyUI-docs/Interface/Textprompts/#up-and-down-weighting

@Volantarius
Copy link

Thank you this was very confusing for me to find this setting!

@PHI6kai
Copy link

PHI6kai commented Mar 6, 2024

@lucasjinreal Can you share your workflow, I'd like to learn how to use clip step layer.

@airtonix
Copy link

for anyone else wondering, the node is called CLIPSetLastLayer found under Conditioning

image

image

@Amit30swgoh
Copy link

what is clipskip what does it do whats the different betweern no clip skip to -1 -2 0 1 2 etc and please show photo comparrsion examples ty

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants