Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not Work! #7

Closed
jesenzhang opened this issue Mar 18, 2024 · 16 comments · Fixed by #12
Closed

Not Work! #7

jesenzhang opened this issue Mar 18, 2024 · 16 comments · Fixed by #12

Comments

@jesenzhang
Copy link

I tried the workflow, not worked!
workflow (2)

@yuvraj108c
Copy link

same here :((

@JPW0080
Copy link

JPW0080 commented Mar 18, 2024

It can work though:

ComfyUIVisualStylePrompting

@jesenzhang
Copy link
Author

It can work though:

ComfyUIVisualStylePrompting

It seems like not working with '--force-fp16' or sdxl . and I added controlnet , It did a little effect ,no more. How can I get the correct result?
workflow (3)

@tanglup
Copy link

tanglup commented Mar 19, 2024

但它可以工作:
ComfyUI视觉风格提示

似乎无法使用 '--force-fp16' 或 sdxl 。然后我加了controlnet,起到了一点作用,仅此而已。我怎样才能得到正确的结果? 工作流程 (3)

“true” off

@jesenzhang
Copy link
Author

I just can't get satisfactory results.
workflow (4)

@ExponentialML
Copy link
Owner

Hey. I can confirm that there's something that's preventing the condition from inferring properly.
I'm busy with some other projects, but I will look to address this soon.

@shiloh92
Copy link

Yeah the example doesn't seem to work.

@joshua76y
Copy link

no work too

@roobt233
Copy link

微信截图_20240321092714
经过大量测试,在目前插件版本下,将“apply visual style prompting"的denoise,和采样器的cfg值降低,会有一定效果,期待作者的下一个版本。

@ExponentialML
Copy link
Owner

Hey everyone here. I've released an update that fixes some bugs, as well as adds an option to select which blocks to utilize (thanks @ziyaxuanyi!), so please pull the latest request.

The block selection at the moment is "lazy" in the sense that only the block group is chosen, and not the specific layers recommended in the paper. Using only the output blocks seems to work very well in my tests.

This has only been tested on 1.5 based models, but should work with SDXL as well.

Let me know if anything has improved or if anything is working for you!

image

@julien-blanchon
Copy link

This is working but in a pretty chaotic way with the default CFG (7.0/8.0): 2/3 of the time I'm getting not related generation. By taking an higher CFG like 10 I'm now following the prompt more often

Screenshot 2024-03-22 at 00 04 29 Screenshot 2024-03-22 at 00 04 49 Screenshot 2024-03-22 at 00 05 17 Screenshot 2024-03-22 at 00 05 28

@julien-blanchon
Copy link

julien-blanchon commented Mar 21, 2024

@ExponentialML, this is very unstable. I have a lot of bleeding between reference content and generation. I'm giving you examples here so we can debug this together: I don't want the rabbit 😂

workflow (1)
workflow (2)

Workflow is in the screenshot payload if you want to reproduce

@ExponentialML
Copy link
Owner

ExponentialML commented Mar 22, 2024

There is in ComfyUI that's not updating the state of my node (you have to reload the model on each prompt / settings change), but other than that it seems to be working as intended.

image

EDIT: To get around the Comfy bug, simply update both the reference and conditioning prompts. I'll try to find a workaround for this.

@ExponentialML
Copy link
Owner

I applied a major update. Please read the main README and use the updated workflow.

@jesenzhang
Copy link
Author

test on sdxl ,It seems that there is still room for improvement.
visualstyleprompt

@julien-blanchon
Copy link

julien-blanchon commented Mar 22, 2024

The new version did work at first try for my example!!!

Huge kudo to you @ExponentialML, I really like your job here <3.

Screenshot with payload here:
workflow (3)

workflow (4)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
9 participants