issues Search Results · repo:sgl-project/sglang language:Python

Filter by

• • Code... (...)results
  • Issues1k (1k)results
  • Pull requests3k (3k)results
  • Discussions186 (186)results
  • Commits0 (0)results
  • Packages0 (0)results
  • Wikis0 (0)results

• State

  • Open
  • Closed

• Advanced

  • Owner
  • State
  • Close reason
  • Has linked pull request
  • Author
  • Assignee
  • Mentioned user
  • Mentioned team
  • Commenter
  • Involved user
  • Label
  • Milestone
  • Number of comments
  • Number of interactions
• Advanced search

Issues1k (1k)

1k results

 (102 ms)

1k results

insgl-project/sglang (press backspace or delete to remove)

Sort by: Best match

Filter

sgl-project/sglang

[Bug] AMD ROCm system: Inference error

Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. - [x] 3. Please note that if the bug-related issue ...

• daishiqiang123
·
• 1
·
• Opened 
  6 hours ago
·
• #5414

sgl-project/sglang

[Bug] enable metrics and crash when using p/d disaggregation mode.

Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. - [ ] 3. Please note that if the bug-related issue ...

• whybeyoung
·
• Opened 
  7 hours ago
·
• #5411

sgl-project/sglang

[Bug] hiradix_cache encountered an exception while executing self.dec_lock_ref

https://github.com/sgl-project/sglang/blob/8aab7fdb21e86b87a3141951ce498246fd4aae73/python/sglang/srt/mem_cache/hiradix_cache.py#L120 hit an exception in hiradix_cache.py:120: [2025-04-15 07:02:26 TP1] ...

• a4zhangfei
·
• Opened 
  7 hours ago
·
• #5410

sgl-project/sglang

[Bug] Auto-truncation still uses full context length instead of (context_length - max_tokens)

Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. - [x] 3. Please note that if the bug-related issue ...

• BaiMoHan
·
• Opened 
  7 hours ago
·
• #5409

sgl-project/sglang

https://flashinfer.ai/whl/cu124/torch2.5/flashinfer-python is too slow to download!

Why not change to https://flashinfer.ai/whl/cu124/torch2.5/flashinfer in your official install doc ???? Why??? Waste of time!

• Huixxi
·
• Opened 
  7 hours ago
·
• #5407

sgl-project/sglang

[Feature] How to deploy deepseek ep_size=64 on h100?

Checklist - [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. ...

• CSEEduanyu
·
• 1
·
• Opened 
  8 hours ago
·
• #5405

sgl-project/sglang

[Bug] merge_state_v2 issue

Checklist - [ ] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest version. - [ ] 3. Please note that if the bug-related issue ...

bug

high priority

• zhyncs
·
• 7
·
• Opened 
  8 hours ago
·
• #5404

sgl-project/sglang

[Bug] How to build sglang using 5080/5090 gpu

Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest version. - [ ] 3. Please note that if the bug-related issue ...

• mesuzhiben
·
• Opened 
  8 hours ago
·
• #5403

sgl-project/sglang

[Bug] Llama 4 Scout Outputs Garbage with 2xMi300x

Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. - [x] 3. Please note that if the bug-related issue ...

high priority

• Bihan
·
• 1
·
• Opened 
  9 hours ago
·
• #5402

sgl-project/sglang

[Bug] degraded performance after upgrading from sglang v0.4.3 to v0.4.5

Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. - [x] 3. Please note that if the bug-related issue ...

• yf619
·
• 3
·
• Opened 
  12 hours ago
·
• #5396

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues

ProTip! 

Press the

/

key to activate the search input again and adjust your query.

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues

ProTip! 

Press the

/

key to activate the search input again and adjust your query.