nvcr.io/nvidia/cuda:13.0.2-cudnn-devel-ubuntu24.04

CUDA 13.0
Toolkit 13.0
cudnn 19
Pytorch 2.9.1+cu130
Python 3.12

pytorch/pytorch:2.9.0-cuda12.8-cudnn9-devel

Updata Docker Image Support：pytorch/pytorch:2.9.0-cuda12.8-cudnn9-devel

Linux Python3.11 Torch2.7.0+cu128

自用轮子

基于 Linux Python3.11 Torch2.7.0+cu128

基于环境：pytorch/pytorch:2.7.0-cuda12.8-cudnn9-devel

下载地址：https://github.com/IAMJOYBO/python_wheel_build/releases

4.7M    apex-0.1-cp311-cp311-linux_x86_64.whl
244K    custom_rasterizer-0.1.0+torch270.cuda128-cp311-cp311-linux_x86_64.whl
240M    flash_attn-2.7.4.post1-cp311-cp311-linux_x86_64.whl
142M    nunchaku-0.3.0.dev20250525+torch2.7-cp311-cp311-linux_x86_64.whl
11M     sageattention-2.1.1-cp311-cp311-linux_x86_64.whl

            .-/+oossssoo+/-.               root@363d0bdac92f 
        `:+ssssssssssssssssss+:`           ----------------- 
      -+ssssssssssssssssssyyssss+-         OS: Ubuntu 22.04.5 LTS x86_64 
    .ossssssssssssssssssdMMMNysssso.       Host: CVM 3.0 
   /ssssssssssshdmmNNmmyNMMMMhssssss/      Kernel: 5.4.241-1-tlinux4-0017.16 
  +ssssssssshmydMMMMMMMNddddyssssssss+     Uptime: 8 hours, 40 mins 
 /sssssssshNMMMyhhyyyyhmNMMMNhssssssss/    Packages: 630 (dpkg) 
.ssssssssdMMMNhsssssssssshNMMMdssssssss.   Shell: bash 5.1.16 
+sssshhhyNMMNyssssssssssssyNMMMysssssss+   Resolution: 1024x768 
ossyNMMMNyMMhsssssssssssssshmmmhssssssso   Terminal: node 
ossyNMMMNyMMhsssssssssssssshmmmhssssssso   CPU: AMD EPYC 9K84 (16) @ 2.600GHz 
+sssshhhyNMMNyssssssssssssyNMMMysssssss+   GPU: NVIDIA 83:00.0 NVIDIA Corporation Device 2329 
.ssssssssdMMMNhsssssssssshNMMMdssssssss.   GPU: NVIDIA 23:00.0 NVIDIA Corporation Device 2329 
 /sssssssshNMMMyhhyyyyhdNMMMNhssssssss/    GPU: NVIDIA a4:00.0 NVIDIA Corporation Device 2329 
  +sssssssssdmydMMMMMMMMddddyssssssss+     GPU: NVIDIA a3:00.0 NVIDIA Corporation Device 2329 
   /ssssssssssshdmNNNNmyNMMMMhssssss/      GPU: NVIDIA 34:00.0 NVIDIA Corporation Device 2329 
    .ossssssssssssssssssdMMMNysssso.       GPU: NVIDIA 43:00.0 NVIDIA Corporation Device 2329 
      -+sssssssssssssssssyyyssss+-         GPU: NVIDIA 63:00.0 NVIDIA Corporation Device 2329 
        `:+ssssssssssssssssss+:`           GPU: NVIDIA 33:00.0 NVIDIA Corporation Device 2329 
            .-/+oossssoo+/-.               Memory: 1506MiB / 65536MiB 

VLLM_0.9.1.dev2

2025-5-28 更新日志

• VLLM 更新至 0.9.1.dev2
• Torch 更新至 2.7.0+cu128
• 适用环境：registry.cn-hangzhou.aliyuncs.com/joybo/vllm