Skip to content

Issues: sgl-project/sglang

Development Roadmap
#157 opened Feb 7, 2024 by Ying1123
Open 14
Add SGLang usage examples
#166 opened Feb 8, 2024 by Ying1123
Open 6
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

166 Open 120 Closed
166 Open 120 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

model_override_args with server
#591 opened Jul 5, 2024 by ValeKnappich
[Bug?] gen() without max_token parameter is limited to 16 tokens long by default.
#590 opened Jul 4, 2024 by objnf-dev
Qwen2-1.5B not work. Only output many “!”
#589 opened Jul 4, 2024 by DouHappy
Add support for independent model support, such as huggingface-hub remote code for faster iterations
#587 opened Jul 4, 2024 by cloneofsimo
OpenAI ChatCompletionRequest max_tokens defaults to None causing error
#582 opened Jul 2, 2024 by brandonbiggs
@ChuyueSun
Add Support to Florence-2
#572 opened Jun 29, 2024 by KaifAhmad1
Why using 16 bit dtype in memory pool state？
#570 opened Jun 28, 2024 by yileld
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
Llava CUDA error: device-side assert triggered
#543 opened Jun 13, 2024 by dmilcevski
3
M2 Mac Attempted Installation: LLVM ERROR: Option 'pbqp' already exists!
#537 opened Jun 12, 2024 by velocity33
[Bug]: Random model output using sglang backend server
#535 opened Jun 12, 2024 by PanJason
2
peft not found
#534 opened Jun 12, 2024 by charul15
CUDA error: device-side assert triggered in self.forward_extend_multi_modal(batch)
#528 opened Jun 11, 2024 by LetheRiver0
1
SG-Lang Runtime Stuck Launching in Docker Container
#527 opened Jun 11, 2024 by schopra8
1
The choices normalised logprobs calculation returns poor results due to bias for longer-token options
#523 opened Jun 10, 2024 by AidanCooper
1
Mistral v0.3 Weight Loading
#519 opened Jun 9, 2024 by huyiwen
Support for Qwen2MoeForCausalLM? good first issue Good for newcomers
#513 opened Jun 7, 2024 by fedshyvana
1
Does llava-next-video deploy only focus on first frames?
#510 opened Jun 7, 2024 by LetheRiver0
1
Mac support? (vLLM)
#508 opened Jun 6, 2024 by shiftbug
2
Unable to load 72b llava qwen on 8*A100 40GB
#507 opened Jun 5, 2024 by jeffhernandez1995
3
Addition of Support of IDEFICS2
#506 opened Jun 5, 2024 by MohdSadiqRyff
guide for implementing multimodal models?
#501 opened Jun 4, 2024 by amosyou
Error when using the langchain wrapper to access the sglang openai server
#499 opened Jun 3, 2024 by brunorigal
llava-next-video inference result is empty
#498 opened Jun 3, 2024 by AmazDeng
4
Any plan to support cascading feature of flashinfer?
#495 opened Jun 3, 2024 by wellhowtosay
@Ying1123
3
ProTip! Adding no:label will show everything without a label.