Files

sgl-kernel

Name		Name	Last commit message	Last commit date
parent directory ..
3rdparty		3rdparty
benchmark		benchmark
src/sgl-kernel		src/sgl-kernel
tests		tests
.clang-format		.clang-format
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
THIRDPARTYNOTICES.txt		THIRDPARTYNOTICES.txt
build.sh		build.sh
developer_guide.md		developer_guide.md
pyproject.toml		pyproject.toml
setup.py		setup.py
setup_rocm.py		setup_rocm.py

README.md

SGL Kernel

Kernel Library for SGLang

Installation

For CUDA 11.8:

pip3 install sgl-kernel -i https://docs.sglang.ai/whl/cu118

For CUDA 12.1 or CUDA 12.4:

pip3 install sgl-kernel