Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q3)
#634 opened Jul 17, 2024 by Ying1123
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

159 Open 132 Closed
159 Open 132 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] process not terminated after PM2 is kill await-response
#680 opened Jul 21, 2024 by Desmond819
2 tasks done
1
Do we have plan to support Siglip model for new llava-next-video architecture?
#639 opened Jul 17, 2024 by LetheRiver0
3
Development Roadmap (2024 Q3)
#634 opened Jul 17, 2024 by Ying1123
28 tasks
3
select() on first assistant token broken (in different ways in Mistral and Llama). Likely tokenization issue.
#608 opened Jul 12, 2024 by max99x
1
Slow import
#606 opened Jul 11, 2024 by bgyoon
1
model_override_args with server good first issue Good for newcomers
#591 opened Jul 5, 2024 by ValeKnappich
1
[Bug?] gen() without max_token parameter is limited to 16 tokens long by default. good first issue Good for newcomers
#590 opened Jul 4, 2024 by objnf-dev
1
Qwen2-1.5B not work. Only output many “!”
#589 opened Jul 4, 2024 by DouHappy
3
Add a HuggingFace backend good first issue Good for newcomers
#587 opened Jul 4, 2024 by cloneofsimo
1
Add Support to Florence-2 good first issue Good for newcomers
#572 opened Jun 29, 2024 by KaifAhmad1
1
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
Llava CUDA error: device-side assert triggered
#543 opened Jun 13, 2024 by dmilcevski
3
M2 Mac Attempted Installation: LLVM ERROR: Option 'pbqp' already exists!
#537 opened Jun 12, 2024 by velocity33
[Bug]: Random model output using sglang backend server v100 sm70 (low priority)
#535 opened Jun 12, 2024 by PanJason
2
peft not found
#534 opened Jun 12, 2024 by charul15
CUDA error: device-side assert triggered in self.forward_extend_multi_modal(batch)
#528 opened Jun 11, 2024 by LetheRiver0
1
SG-Lang Runtime Stuck Launching in Docker Container
#527 opened Jun 11, 2024 by schopra8
1
The choices normalised logprobs calculation returns poor results due to bias for longer-token options
#523 opened Jun 10, 2024 by AidanCooper
8
Mistral v0.3 Weight Loading
#519 opened Jun 9, 2024 by huyiwen
Does llava-next-video deploy only focus on first frames?
#510 opened Jun 7, 2024 by LetheRiver0
1
Mac support? (vLLM)
#508 opened Jun 6, 2024 by shiftbug
2
Unable to load 72b llava qwen on 8*A100 40GB
#507 opened Jun 5, 2024 by jeffhernandez1995
3
Addition of Support of IDEFICS2
#506 opened Jun 5, 2024 by MohdSadiqRyff
guide for implementing multimodal models?
#501 opened Jun 4, 2024 by amosyou
Error when using the langchain wrapper to access the sglang openai server
#499 opened Jun 3, 2024 by brunorigal
ProTip! Find all open issues with in progress development work with linked:pr.