This branch contains the version 2.0 for release. There are some key updates:
SGLang Upgrade
- Upgrade SGLang version to v0.4.10.post2 #39
Build
- Update CI/CD workflow: #52
Benchmark
- Benchmark workflow added #55
- Performance comparison between SGLang and vLLM #56
Fix
- Bug Fix - Data corruption bug in DP communication #54
Others
- Security Fix: #46 #47 #49 #51
- License: #48
