qwen3.6-windows-server v1.3.10, portable Windows launcher
qwen3.6-windows-server v1.3.10
Bugfix release: launcher could loop for 2-3 hours on every boot when the
NVIDIA CUDA 13 Toolkit was installed at its default location (C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.x). The space in the path
broke FlashInfer's JIT build, so trtllm_utils.dll never compiled and
vLLM never reached Application startup complete. Reported in issue #18.
What changed
snapshots/_common.py:clean_cuda_env()now prefers a real
system-installed CUDA 13.x toolkit at a space-free path. When the
toolkit is found at the defaultC:\Program Files\...location, the
launcher creates a junction atC:\cuda13<minor>(no admin required)
and pointsCUDA_PATH/CUDA_HOMEthere so FlashInfer's ninja build
works. Falls back to the existing bundled cu13 shim when no system
toolkit is installed, the same as before.
Who is affected
- Anyone on a Blackwell GPU (5090) who installed the CUDA 13 Toolkit and
saw boot loop onTuning fp4_gemmfor hours. - Drivers-only users are unaffected, the bundled cu13 shim still ships
and still works for them.
Boot time expectations
Cold first boot on a fresh install is 10-20 minutes on the 5090 NVFP4
snapshot. That's autotune running once per unique GEMM shape and is
unavoidable on the current FlashInfer wheel. Subsequent boots can still
take that long because per-shape tactic selection isn't yet cached on
sm_120; that's gated on upstream FlashInfer work and not something this
release can fix. Keep the server running between requests.
Upgrading
update.bat
venv\, models\, logs\, cuda13_shim\ and user_config.json are
preserved. The bundled wheel is unchanged from v1.3.7, so the runtime
install is not rerun.
Verification
Launch the rtx5090_nvfp4 snapshot. If you previously hit the
hours-long Tuning fp4_gemm loop, the log should now show normal
autotune progress and reach Uvicorn running on http://0.0.0.0:5001
within 10-20 minutes.
Files
qwen3.6-windows-server-portable-x64-ampere.zipqwen3.6-windows-server-portable-x64-blackwell.zipSHA256SUMS.txt