Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Incompatible with the latest Automatic1111 updates #46

Open
1 task done
Zetaphor opened this issue Mar 30, 2023 · 16 comments
Open
1 task done

[Bug]: Incompatible with the latest Automatic1111 updates #46

Zetaphor opened this issue Mar 30, 2023 · 16 comments
Assignees
Labels
external There is some external dependency for this issue

Comments

@Zetaphor
Copy link

Is ths issue about the extension?

  • Yup, this is for sure about the extension

What happened?

Automatic1111 recently merged a large number of PR's, which included changes to the frontend, gradio version, and I believe even the API. Currently the "Send to OpenOutpaint" buttons are non-functional, and the Dream and Img2Img options are not functioning.

Steps to reproduce the problem

  1. Update Automatic1111 to the latest release (the commits start on March 25'th)
  2. Attempt to send an image to the OpenOutpaint tab
  3. Attempt to use the dream or img2img options

What should have happened?

The options should have produce output. Instead they are producing console errors

Commit where the problem happens

46534e8

What platforms do you use to access openOutpaint?

Windows, Linux

What browsers do you use to access the UI ?

Mozilla Firefox, Google Chrome

Browser Extensions/Addons

uBlock origin

AUTOMATIC1111 webUI Commandline Arguments

--api --cors-allow-origins=*

Additional information

My extensions also broke lol, the madlad merged like 40+ PR's in a single day and then they've been pushing bugfixes since

@Zetaphor Zetaphor added the bug Something isn't working label Mar 30, 2023
@zero01101
Copy link
Owner

hey, so the send-to buttons were definitely broken but should be fixed as of 566a8a5 - that said, the base functionality (dream/img2img) is certainly working as expected in my main webUI with a billion extensions as well as a "clean" install... what are the console errors you're getting?

@kutyadog
Copy link

kutyadog commented Mar 31, 2023

The changes shown below seem to be causing issues for these colab instances:
https://github.com/camenduru/stable-diffusion-webui-colab

Fixed by adding:

!git clone https://github.com/zero01101/openOutpaint-webUI-extension /content/stable-diffusion-webui/extensions/openoutpaint-webui-extension
%cd /content/stable-diffusion-webui/extensions/openoutpaint-webui-extension
!git checkout 46534e840476dcbea4791d938f711a0d461c1ba5

hey, so the send-to buttons were definitely broken but should be fixed as of 566a8a5 - that said, the base functionality (dream/img2img) is certainly working as expected in my main webUI with a billion extensions as well as a "clean" install... what are the console errors you're getting?

@Zetaphor
Copy link
Author

hey, so the send-to buttons were definitely broken but should be fixed as of 566a8a5 - that said, the base functionality (dream/img2img) is certainly working as expected in my main webUI with a billion extensions as well as a "clean" install... what are the console errors you're getting?

Testing again with the following commits:

All other extensions disabled:

image

Restart webui, run test prompt in txt2img, click "Send to OpenOutpaint", getting the following in the console:

[openoutpaint] Add message listener [openoutpaint-ext.js:117:10](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
[openoutpaint] Sending init message [openoutpaint-ext.js:184:11](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
[layers] Collection 'Image Layers' at layers.collections.image registered [layers.js:677:11](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[layers] Layer 'Background' at layers.collections.image.layers.bg registered [layers.js:632:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[layers] Layer 'Image' at layers.collections.image.layers.image registered [layers.js:632:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[layers] Layer 'Mask Paint' at layers.collections.image.layers.mask registered [layers.js:632:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[layers] Layer 'Overlay' at layers.collections.image.layers.overlay registered [layers.js:632:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[layers] Layer 'Debug Layer' at layers.collections.image.layers.debug registered [layers.js:632:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[commands] Running 'Initial Layer Creation'[addLayer] [commands.js:168:14](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/commands.js?v=ad60afc)
[layers] Layer 'Default Image Layer' at layers.collections.image.layers.default registered [layers.js:632:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/lib/layers.js?v=26b7436)
[stamp] Connected to IndexedDB [stamp.js:651:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[openoutpaint] Sending init message [openoutpaint-ext.js:184:11](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
blob:http://127.0.0.1:7860/30c4b0c9-0c61-4237-a33a-8a50ff34eef5 [index.js:882:12](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/index.js?v=e10fcb1)
[webui] key.json loaded successfully [webui.js:38:11](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/webui.js?v=ccd423a)
[webui] Window is child of 'http://127.0.0.1:7860/' [webui.js:57:12](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/webui.js?v=ccd423a)
[webui] Loaded key [webui.js:77:30](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/webui.js?v=ccd423a)
[openoutpaint] Sending init message [openoutpaint-ext.js:184:11](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
[webui] Communication with 'http://127.0.0.1:7860/' has been initialized [webui.js:101:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/webui.js?v=ccd423a)
[index] Fixed host to 'http://127.0.0.1:7860/' [index.js:179:10](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/index.js?v=e10fcb1)
[openoutpaint] Received Init Ack [openoutpaint-ext.js:123:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
[stamp] Creating Resource Element [resource-03e9-939e-eef2] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-050d-0113-5a71] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-114b-4144-8a02] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-1bc8-bf37-14ff] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-203b-a5be-78d6] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-28b0-54c7-dcba] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-29e1-753d-9a88] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-2de6-36f1-e97d] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-3b5c-39b2-ee9d] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-4876-ef73-a809] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-4aaf-e4cf-e97a] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-4fab-a3a1-d759] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-55fe-e4d7-145e] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-83e0-db19-b8f9] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-8f66-5851-70b1] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-9838-13ac-857d] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-ab88-b0fa-1cf1] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-b805-9fb9-fbc1] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-c813-1b1e-a092] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-c879-57d1-fb9a] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-cbd3-c1c4-da93] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-cd74-4518-8a3d] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-e00e-5935-4234] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-e76f-d249-d8d4] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-f790-0abe-71e1] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-f90d-02ad-3ff1] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[stamp] Creating Resource Element [resource-fd51-b6fa-0019] [stamp.js:214:16](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/ui/tool/stamp.js?v=4494df6)
[index] WebUI Settings set as recommended. [index.js:1162:12](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/index.js?v=e10fcb1)
[openoutpaint] Sending init message [openoutpaint-ext.js:184:11](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
[webui] Communication with 'http://127.0.0.1:7860/' has been initialized [webui.js:101:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/webui.js?v=ccd423a)
[index] Fixed host to 'http://127.0.0.1:7860/' [index.js:179:10](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/index.js?v=e10fcb1)
[openoutpaint] Received Init Ack [openoutpaint-ext.js:123:15](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/javascript/openoutpaint-ext.js?1680291519.0955958)
Current model: Realism/deliberate_v2.safetensors [9aba26abdf] [index.js:1068:12](http://127.0.0.1:7860/file=extensions/openOutpaint-webUI-extension/app/js/index.js?v=e10fcb1)
Uncaught (in promise) TypeError: v is undefined
    ct Blocks.5efe22d4.js:76
    ze Blocks.5efe22d4.js:76
    promise callback*ze Blocks.5efe22d4.js:76
    to Blocks.5efe22d4.js:76
    zr index.37b24c07.js:4
    zr index.37b24c07.js:4
    _ Button.svelte:12
    zr index.37b24c07.js:4
    zr index.37b24c07.js:4
    c Button.svelte:11
    Le index.37b24c07.js:1
    m Button.svelte:16
    ue index.37b24c07.js:4
    m Button.svelte:21
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
    m Row.svelte:11
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
    m Column.svelte:14
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
    m Column.svelte:14
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    ue index.37b24c07.js:4
    m Blocks.5efe22d4.js:31
    m Blocks.5efe22d4.js:31
[Blocks.svelte:214:2](http://127.0.0.1:7860/ui/packages/app/src/Blocks.svelte)

​

@Zetaphor
Copy link
Author

Same setup, reload webui, go to OpenOutpaint tab and attempt to dream with "test prompt" and same DeliberateV2 model loaded:

image

500 error on http://127.0.0.1:7860/sdapi/v1/txt2img

{"error":"RuntimeError","detail":"","body":"","errors":"There is no current event loop in thread 'AnyIO worker thread'."}

HAR link: https://drive.google.com/file/d/1p9l52kdWbXfOQfxgzJwg0j3d16MZ9yAN/view?usp=share_link

@Zetaphor
Copy link
Author

Zetaphor commented Mar 31, 2023

Same process except I added content to the canvas with a resource stamp, response from Img2Img:

{"error":"RuntimeError","detail":"","body":"","errors":"There is no current event loop in thread 'AnyIO worker thread'."}

@Zetaphor
Copy link
Author

Just to be safe I also nuked the extension folder and did a fresh checkout, same issues present

@Zetaphor
Copy link
Author

I also have a separate installation of Automatic1111 that is locked in at the pre-March 25'th commits where it works perfectly fine. That is where this installation came from, I duplicated that folder and then did a git pull to setup the second installation

@zero01101
Copy link
Owner

zero01101 commented Mar 31, 2023

@kutyadog yeah, apologetically i have like almost no familiarity with colabs in general for the most part, but if a previous version of the extension works better for that there's actually a commandline flag specifically for those instances - just add --lock-oo-submodule to your launch flags and it'll disable the submodule update checks. that commit's the last one that had the tags for any versions of webUI prior to the new gradio changes
[edit]... yeah that flag is only for the openOutpaint submodule itself :| i'm not too bright, you shouldn't need that cmdline flag unless you're moving the actual application back in time, not just the wrapper extension

@Zetaphor i can confirm that svelte throws up an error about v being null in web console but the extension still works as expected and i have no clue where to even start with minimized gradio lol; have you seen this issue? could you try going to http://127.0.0.1:7860/docs#/default/text2imgapi_sdapi_v1_txt2img_post, click try it out and populate the request body input with

{
	"batch_size": 1,
	"cfg_scale": 7,
	"enable_hr": false,
	"height": 512,
	"n_iter": 1,
	"negative_prompt": "test",
	"prompt": "test",
	"restore_faces": false,
	"sampler_index": "DDIM",
	"seed": "1",
	"steps": 1,
	"width": 512
}

and execute it? it should return a base64 image

@Zetaphor
Copy link
Author

Zetaphor commented Apr 3, 2023

Apologies for the delay @zero01101, looks like that's also failing on the server side:

image

@Zetaphor
Copy link
Author

Zetaphor commented Apr 3, 2023

It also fails with the default parameters, looks like the API is busted for some reason?

@zero01101 zero01101 added external There is some external dependency for this issue and removed bug Something isn't working labels Apr 5, 2023
@zero01101
Copy link
Owner

yeah, there's AUTOMATIC1111/stable-diffusion-webui#9319 open right now to deal with that, but openOutpaint definitely relies on the API functionality to be operational. tested send-to buttons on native linux as well which also work as expected on current commits for webUI, openOutpaint, and oo-extension so this is all seeming to point at colab vs webUI updates

@Zetaphor
Copy link
Author

Zetaphor commented Apr 5, 2023

Strange, I'm running on Linux, not colab or docker. I guess I'll try reinstalling from the latest commit

@253189147cc
Copy link

Hi bro, thanks a lot for the excellent work. I thought outpainting was cool but never had success using it. I am using automatic1111 colab version, I read the instructions carefully and know that the code --api is added to the web user.sh file, but every time after saving it, the --api disappears when I start it again, so it never works, how should I do it?

@Raivshard
Copy link

Has there been any progress with this? I still can't run it in automatic, and the same issue seems to exist with vlad diffusion

@zero01101
Copy link
Owner

terribly sorry for the extended delay; this project isn't abandoned but i've had to step away from it due to Reasons for a while, and i admit additional responses may (aka will probably) be delayed but hopefully not nearly as long

@253189147cc thanks for the kind words; i think that's a separate issue to the topic at hand, but i believe there's a different way of enabling API on colabs? looking at https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast_stable_diffusion_AUTOMATIC1111.ipynb it appears to be enabled by default in the bottom block?

image

@Raivshard i can definitely at least confirm that base functionality should still work almost seamlessly in chrome/chromium-based browsers, and firefox just needs to get kicked in the refresh button on the openOutpaint tab to fire up on both windows and linux hosted instances, but is still kind of frustrating... i tried the extension in vlad's fork like RIGHT when the whole dustup was starting and it worked out of the box, but that was also about when i had to step back for a bit so things may have changed since then.

are you getting any particular errors in f12 console logs or webUI console? does the txt2img API test mentioned above pass?

@Raivshard
Copy link

Raivshard commented Jun 11, 2023

If you had asked me this a couple of weeks ago, the answer would have been no, which is why I removed the extension in the first place, but it does seem to work n--

Nope.
https://i.imgur.com/q6c4p6s.jpeg
It's "offline" and there is absolutely zero log window output.

@zero01101 the API test is not useable on vlad's fork, as the link still returns {"detail":"Not Found"}

edit: did a fresh install of vlad's and everything works fine now. Something stopped breaking something else, I guess. 😁

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
external There is some external dependency for this issue
Projects
None yet
Development

No branches or pull requests

6 participants