Skip to content

qwen3.6-windows-server v1.3.10, portable Windows launcher

Choose a tag to compare

@github-actions github-actions released this 14 May 16:35
· 2 commits to main since this release

qwen3.6-windows-server v1.3.10

Bugfix release: launcher could loop for 2-3 hours on every boot when the
NVIDIA CUDA 13 Toolkit was installed at its default location (C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.x). The space in the path
broke FlashInfer's JIT build, so trtllm_utils.dll never compiled and
vLLM never reached Application startup complete. Reported in issue #18.

What changed

  • snapshots/_common.py: clean_cuda_env() now prefers a real
    system-installed CUDA 13.x toolkit at a space-free path. When the
    toolkit is found at the default C:\Program Files\... location, the
    launcher creates a junction at C:\cuda13<minor> (no admin required)
    and points CUDA_PATH / CUDA_HOME there so FlashInfer's ninja build
    works. Falls back to the existing bundled cu13 shim when no system
    toolkit is installed, the same as before.

Who is affected

  • Anyone on a Blackwell GPU (5090) who installed the CUDA 13 Toolkit and
    saw boot loop on Tuning fp4_gemm for hours.
  • Drivers-only users are unaffected, the bundled cu13 shim still ships
    and still works for them.

Boot time expectations

Cold first boot on a fresh install is 10-20 minutes on the 5090 NVFP4
snapshot. That's autotune running once per unique GEMM shape and is
unavoidable on the current FlashInfer wheel. Subsequent boots can still
take that long because per-shape tactic selection isn't yet cached on
sm_120; that's gated on upstream FlashInfer work and not something this
release can fix. Keep the server running between requests.

Upgrading

update.bat

venv\, models\, logs\, cuda13_shim\ and user_config.json are
preserved. The bundled wheel is unchanged from v1.3.7, so the runtime
install is not rerun.

Verification

Launch the rtx5090_nvfp4 snapshot. If you previously hit the
hours-long Tuning fp4_gemm loop, the log should now show normal
autotune progress and reach Uvicorn running on http://0.0.0.0:5001
within 10-20 minutes.

Files

  • qwen3.6-windows-server-portable-x64-ampere.zip
  • qwen3.6-windows-server-portable-x64-blackwell.zip
  • SHA256SUMS.txt

Credits

Issue #18 reported and diagnosed by @hiraghi.