Skip to content

Pull requests: sgl-project/sglang

New pull request New
386 Open 4,534 Closed
386 Open 4,534 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[PD] Raise error for incompatible mooncake version and some minor fixes
#7527 opened Jun 25, 2025 by ShangmingCai Loading…
6 tasks
9
P/D load balancer forwards profiling requests to instances
#7525 opened Jun 25, 2025 by gronsti-amd Loading…
1 of 6 tasks
7
[CPU] add c++ kernel to bind CPU cores and memory node
#7524 opened Jun 25, 2025 by chunyuan-w Loading…
7
test: improve test for omni models
#7519 opened Jun 25, 2025 by mickqian Loading…
6 tasks
1
fix: incorrect dtype when load_model
#7517 opened Jun 25, 2025 by yudian0504 Loading…
6 tasks
2
load draft model fix
#7506 opened Jun 24, 2025 by yilian49 Loading…
@ch-wan
3
[CPU] remove process_group from inputs of shm_allreduce and shm_allgather cpu cpu backend performance optimization intel sgl-kernel
#7486 opened Jun 24, 2025 by chunyuan-w Loading…
4
[AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 high priority
#7484 opened Jun 23, 2025 by hubertlu-tw Loading…
3 of 6 tasks
@HaiShaw @Alcanderian
6
[Feature] dynamic server payload size limit
#7475 opened Jun 23, 2025 by khan-yin Loading…
4 of 6 tasks
16
fix(bench_serving): handle None tokenizer.bos_token when apply_chat_template==True
#7466 opened Jun 23, 2025 by renne444 Loading…
1 of 6 tasks
4
[BugFix] Destroy nccl Comm to fix cuda memory leak of destroy_model_parallel
#7465 opened Jun 23, 2025 by wcsjtu Loading…
2 of 6 tasks
3
Support non-contiguous query input for extend/decode attention cpu cpu backend performance optimization intel sgl-kernel
#7462 opened Jun 23, 2025 by yanbing-j Loading…
6 tasks
17
[benchmark] print final benchmark args in json format
#7455 opened Jun 23, 2025 by staugust Loading…
1 of 6 tasks
2
Fix for fp8 quantization failure of qwen 2.5 VL 7B model. high priority
#7448 opened Jun 22, 2025 by PanJason Loading…
2 of 6 tasks
@Alcanderian
5
Support dynamic LoRA loading / unloading in engine/server API ready-for-review
#7446 opened Jun 22, 2025 by lifuhuang Loading…
2 of 6 tasks
20
fix: fix apply_shuffle_mul_sum
#7444 opened Jun 22, 2025 by mickqian Loading…
6 tasks
@Alcanderian @ch-wan
6
fix: minor fix cutlass moe
#7442 opened Jun 22, 2025 by mickqian Loading…
6 tasks
5
OPTForCasualLM Support (facebook/opt Series) new-model
#7440 opened Jun 22, 2025 by b8zhong Loading…
6
Fix: remove duplicate initial assignments in PrefillBootstrapQueue
#7438 opened Jun 22, 2025 by hzh0425 Loading…
1 of 6 tasks
4
Fix: resolve prefill of retracted request out-of-memory issue when ignore_eos is enabled high priority
#7434 opened Jun 22, 2025 by GaoYusong Loading…
1 of 6 tasks
@GaoYusong @hnyls2002
6
Fix stream reasoning parser and Adds Kimi reasoning parser
#7432 opened Jun 22, 2025 by JustinTong0323 Loading…
2 of 6 tasks
6
[env] Organize sglang environ variables.
#7431 opened Jun 22, 2025 by hnyls2002 • Draft
6 tasks
3
[WIP][RL] fix fp8 update weight
#7421 opened Jun 21, 2025 by zhuzilin • Draft
1 of 6 tasks
3
[RL] add pause and continue generation for async rl training
#7419 opened Jun 21, 2025 by zhuzilin Loading…
1 of 6 tasks
6
[RL] Add --nccl-port and --other-ports to prevent port conflict
#7418 opened Jun 21, 2025 by zhuzilin Loading…
1 of 6 tasks
7
ProTip! no:milestone will show everything without a milestone.