Skip to content

Add SGLang and TRT-LLM configs for GreenNode runners #1

@aistackdev

Description

@aistackdev

We only run vLLM today. Add SGLang and TRT-LLM equivalents so we can compare engines.

Hardware

  • 1× H100, 2× H100, 1× RTX 5090

Configs to add (in .github/configs/nvidia-master.yaml)

  • gptoss-fp4-h100-1x-sglang
  • dsr1qwen3-bf16-rtx5090-1x-sglang
  • dsr1qwen3-fp8-rtx5090-1x-sglang
  • TRT-LLM variants (check Blackwell consumer support first for 5090)

Each needs: config block + benchmark script + framework-appropriate image.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions