b10870
Pre-release
Pre-release
vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 (#27471)
-
vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1
-
simplify mmp selection in mul_mat_id per review comment
-
vulkan: enable f16 B-type pipeline for dense matmul on all vendors (MoE stays Intel-only)
-
vulkan: add missing ocp_fp4 branches, restrict required_subgroup_size to Intel, fix mmp selection
-
refine mmp selection in mul_mat_id
-
add f16B pipeline selection just like q8_1
-
update f16B pipeline selection in dense function
Website:
Attestations:
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu arm64 (CPU)
- Ubuntu s390x (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu arm64 (Vulkan)
- Ubuntu x64 (ROCm 10.0)
- Ubuntu x64 (OpenVINO)
- Ubuntu x64 (SYCL FP32)
- Ubuntu x64 (SYCL FP16)
Android:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows arm64 (OpenCL Adreno)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.3 DLLs
- Windows arm64 (CUDA 13) (preview) - CUDA 13.4 DLLs
- Windows x64 (Vulkan)
- Windows x64 (OpenVINO)
- Windows x64 (SYCL)
- Windows x64 (ROCm 10.0)
openEuler:
- DISABLED
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)
UI: