-
Notifications
You must be signed in to change notification settings - Fork 10
feat(webui): ComfyUI&Gradio #36
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…l GPU/Docker/Gradio)
|
also need a section in overall readme https://github.com/intel/llm-scaler/tree/main/vllm |
lalalapotter
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Others LGTM.
| Access the web interface at: `http://localhost:8188` | ||
|
|
||
| ## Post-Installation Configuration | ||
| 1. Replace the final component node with `Preview Any` in your workflow |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe we can just provide a workflow json file for users.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
done |
vllm/README.md
Outdated
| --max-model-len 114432 | ||
| ``` | ||
|
|
||
| ### 2.8 Multi-modal Webui |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Multi-modal -> Multi-Modal
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
also change multimodal_gradio to multi-modal-gradio, and multimodal_comfyui to multi-modal-comfyui
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
| ### 3. Launch Gradio Interface on Host | ||
| ```bash | ||
| conda create -n qwen_gradio python=3.11 | ||
| conda activate qwen_gradio |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we need to install gradio here?
Also, I think we can directly install the gradio with pip
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
gc-fu
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Qwen2.5-VL-3B-Instruct Deployment Guide (ComfyUI + Intel GPU + Linux)
Qwen2.5-VL-7B-Instruct Multimodal Deployment Guide (Intel GPU/Docker/Gradio)