added sglang arguments

[FrankLeeeee]

Motivation

We previously hard-coded some of the sglang arguments such as mem-fraction-static, which makes specforge inflexible in tuning performance, we should add some arguments for sglang.

Modifications

I have collated the sglang arguments in specforge.args. The reason for not using sglang.srt.server_args.ServerArgs.add_cli_args directly is that we don't actually need SGLang's all arguments, we only need those that are relevant to parallelism and prefill optimization. Adding all args from sglang will cause confusion as the other arguments do not take effect at all. sglang 0.5.4 has some bugs so I updated it to 0.5.5 as well.

Meanwhile, for simplicity, I have also collated tracker args in specforge.args.

Related Issues

Accuracy Test

Benchmark & Profiling

Checklist

• Format your code according to the Code Formatting with Pre-Commit.
• Add unit tests as outlined in the Running Unit Tests.
• Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
• Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
• For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
• Please feel free to join our Slack channel at https://sgl-fru7574.slack.com/archives/C09784E3EN6 to discuss your PR.

[gemini-code-assist]

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!