Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

qwen 1.5 error with intelanalytics/ipex-llm-xpu:2.1.0-SNAPSHOT #10834

Closed
zhm-algo opened this issue Apr 22, 2024 · 2 comments
Closed

qwen 1.5 error with intelanalytics/ipex-llm-xpu:2.1.0-SNAPSHOT #10834

zhm-algo opened this issue Apr 22, 2024 · 2 comments
Assignees
@gc-fu
Labels
user issue

Comments

@zhm-algo
Copy link

zhm-algo commented Apr 22, 2024 •
edited

Image
@glorysdj glorysdj assigned glorysdj and gc-fu and unassigned glorysdj Apr 22, 2024
@gc-fu
Copy link
Contributor

gc-fu commented Apr 22, 2024

Can you try this image intelanalytics/ipex-llm-serving-vllm-xpu:2.1.0-SNAPSHOT?

From the figure you posted, it seems that you try to run vllm-v2 in intelanalytics/ipex-llm-xpu:2.1.0-SNAPSHOT. However, this image does not provide the service.

@gc-fu
Copy link
Contributor

gc-fu commented Apr 24, 2024

Closed as completed.

@gc-fu gc-fu closed this as completed Apr 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gc-fu gc-fu

Labels
user issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@jason-dai @glorysdj @zhm-algo @gc-fu