Release v0.104.5
Changes in v0.104.5
Performance Improvements
- parallelize fused SSM/linear-attention scan kernels (Mamba, GLA, RWKV-7, GatedDeltaNet, xLSTM) (#703)
- exceed OpenBLAS — JIT small-GEMM (1.5–6×) + scientific multi-thread routing/pinning wins on diffusion shapes (#700)
- kill per-element indexer/numOps dispatch in sampling+distance kernels (GridSample ~50x +3) (#702)
Packages
- AiDotNet.Native.CLBlast
- AiDotNet.Native.CUDA
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.CUDA.Fragments
- AiDotNet.Native.MoltenVK
- AiDotNet.Native.OneDNN
- AiDotNet.Native.OpenBLAS
- AiDotNet.Native.ROCm
- AiDotNet.Tensors
Note: AiDotNet.Native.CUDA bundles the NVIDIA CUDA 12 runtime (cudart / cuBLAS / cuBLASLt / nvRTC, ~770MB). Because that exceeds nuget.org's 250 MB per-package limit, it ships as a small meta package plus a set of
AiDotNet.Native.CUDA.Fragments.*chunk packages that are reassembled into the full DLLs at your build (win-x64) — justdotnet add package AiDotNet.Native.CUDAalongside AiDotNet.Tensors on NVIDIA GPU machines; the fragments restore automatically.
Note: AiDotNet.Native.ROCm requires ROCm installed on the target machine for the kernel library (~496MB).
Installation
dotnet add package AiDotNet.Tensors