Skip to content

Issues: xorbitsai/inference

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

187 Open 1,927 Closed
187 Open 1,927 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

VLLM和SGLang都无法拉起Qwen3 32B fp8，用SGLang也无法拉起Qwen2.5，但是VLLM可以。 gpu
#3517 opened May 24, 2025 by dllucyboy
1 of 3 tasks
v1.x
1
Request for Xinference Team to Develop and Maintain the Xinference Plugin in Dify feature
#3515 opened May 22, 2025 by moshilangzi v1.x
1
xinference-supervisor 支持多节点高可用部署么？
#3514 opened May 22, 2025 by wuhaolei v1.x
单显卡同时部署两个以上副本时失败，Server error: 400 - laddress=xinference supervisor:9999, pid=136 Model not found in the model list, uid: gpu
#3513 opened May 22, 2025 by berg-wang
1 of 3 tasks
v1.x
supervisor 已经识别到worker节点，但是worker节点任然报错 cannot connect to supervisor gpu
#3512 opened May 22, 2025 by ziwei-SUE
1 of 3 tasks
v1.x
v1.5.1 qwen3模型启动报错 gpu
#3510 opened May 21, 2025 by Starnight-Y
1 of 3 tasks
v1.x
Qwen3-30B-A3B 启动报错
#3509 opened May 21, 2025 by Qixiao02
1 of 3 tasks
v1.x
Custom Model Not Found in Multi-Worker Docker Compose on First Boot gpu
#3508 opened May 21, 2025 by onaka-ga-pkpk
1 of 3 tasks
v1.x
1
[version 1.6.0 and 1.6.0.post1] have huge problems：don't use them and use version 1.5.1
#3507 opened May 21, 2025 by usun1997 v1.x
1
qwen3-235-gptq模型加载失败 gpu
#3505 opened May 21, 2025 by jiasu-hezhip
1 of 3 tasks
v1.x
v1.6.0.post1 Multi-gpu environment must set CUDA_DEVICE_ORDER=PCI_BUS_ID. gpu
#3504 opened May 21, 2025 by Starnight-Y
1 of 3 tasks
v1.x
Failed to execute 'json' on 'Response' :Unexpected end of JSON input gpu
#3503 opened May 21, 2025 by jiasu-hezhip
1 of 3 tasks
v1.x
1
qwen2.5-VL-32B部署后运行报错 gpu
#3502 opened May 21, 2025 by ybsbbw
1 of 3 tasks
v1.x
Register image model CogView4 启动报错 IndexError: [address=0.0.0.0:34449, pid=57] list index out of range gpu
#3501 opened May 21, 2025 by GinKry
1 of 3 tasks
v1.x
Remote server unixsocket.///73924608 closed: 0 bytes read on a total of 11 expected bytes gpu
#3500 opened May 21, 2025 by usun1997
2 of 3 tasks
v1.x
1
单独测试接口是OK的，但是几百个并发偶尔会报错502 gpu
#3499 opened May 21, 2025 by closer-finger
1 of 3 tasks
v1.x
1
[Version: 1.6.0.post1] ModelActor.__init__() got an unexpected keyword argument 'replica_model_uid
#3498 opened May 21, 2025 by usun1997 v1.x
1
1.6.0-post1 运行qwen3，卡住，不完成也不报错
#3496 opened May 21, 2025 by leshjmail
1 of 3 tasks
v1.x
2
Qwen2.5-VL-32B 多图推理报502 gpu
#3495 opened May 20, 2025 by Qixiao02
1 of 3 tasks
v1.x
用sglang加载模型的时候，一直卡着无法加载
#3494 opened May 20, 2025 by DringWellG
1 of 3 tasks
v1.x
2
部署嵌入模型时怎么自定义维度Dimensions gpu
#3493 opened May 20, 2025 by tahitimoon v1.x
@llyycchhee
1
docker安装启动sglang启动qwen3报错 gpu
#3492 opened May 20, 2025 by liukaifei
1 of 3 tasks
v1.x
@amumu96
2
Qwen2-VL-72B-Instruct 模型启动说模型配置缺少配置 gpu
#3491 opened May 20, 2025 by Qixiao02
1 of 3 tasks
v1.x
4
加载GLM4-0414模型失败 gpu
#3490 opened May 20, 2025 by FortunX
1 of 3 tasks
v1.x
3
qwen3_moe显示模型类型不支持
#3489 opened May 20, 2025 by noahachao
1 of 3 tasks
v1.x
6
ProTip! Find all open issues with in progress development work with linked:pr.