NInfer 2026-11-04.1

Native builds from a147b0c2750de216049c5d06c5db569ad70e67ae.

What to download

• Choose one package for your operating system. Download every numbered part of that package and its SHA-256 manifest.
• Default choice: Dual CUDA for your operating system. It includes both backends and selects CUDA 12 for Volta or CUDA 13 for Blackwell. On overlapping GPU targets, it prefers CUDA 13 when the driver supports it. Use --cuda-backend 12 or --cuda-backend 13 to require a backend.
• Single CUDA includes one backend and has a smaller download. Choose CUDA 12.9 for Volta/V100 or a CUDA 12 driver environment. Blackwell/RTX 50 requires the CUDA 13.4 backend and a compatible driver.
• CUDA runtime libraries are included. Install a compatible NVIDIA driver; no CUDA Toolkit is needed. Model weights are downloaded separately.

Downloads

Sizes are compressed download totals: the sum of all parts, excluding the checksum manifest.

Platform	Package	Parts	Total download	Use
Windows x64	Dual CUDA 12.9 + 13.4	3 parts	5.29 GiB (5,678,686,883 bytes)	Automatic backend selection for the GPU and driver.
Windows x64	CUDA 12.9	2 parts	2.64 GiB (2,836,931,937 bytes)	Volta/V100, or a driver that supports CUDA 12 but not CUDA 13.
Windows x64	CUDA 13.4	2 parts	2.65 GiB (2,841,892,258 bytes)	Blackwell/RTX 50, or a CUDA 13 installation on the supported GPUs.
Debian 13 x64	Dual CUDA 12.9 + 13.4	5 parts	7.96 GiB (8,544,538,758 bytes)	Automatic backend selection for the GPU and driver.
Debian 13 x64	CUDA 12.9	3 parts	4.04 GiB (4,337,450,851 bytes)	Volta/V100, or a driver that supports CUDA 12 but not CUDA 13.
Debian 13 x64	CUDA 13.4	3 parts	3.93 GiB (4,220,360,118 bytes)	Blackwell/RTX 50, or a CUDA 13 installation on the supported GPUs.

All six archive alternatives total 26.51 GiB (28,459,860,805 bytes).

Files for each package

Keep all parts of the selected package in one directory. Verify them against its SHA-256 manifest before extraction.

Windows x64 — Dual CUDA 12.9 + 13.4 (3 parts, 5.29 GiB (5,678,686,883 bytes))

Archive part	Size
ninfer-windows-x64-cuda12.9-13.4-a147b0c2750d.7z.001	1.86 GiB (1,992,294,400 bytes)
ninfer-windows-x64-cuda12.9-13.4-a147b0c2750d.7z.002	1.86 GiB (1,992,294,400 bytes)
ninfer-windows-x64-cuda12.9-13.4-a147b0c2750d.7z.003	1.58 GiB (1,694,098,083 bytes)

Checksums: SHA256SUMS-ninfer-windows-x64-cuda12.9-13.4-a147b0c2750d.txt.

Extract the first part with 7-Zip. It reads the remaining parts automatically.

7z x ninfer-windows-x64-cuda12.9-13.4-a147b0c2750d.7z.001

Windows x64 — CUDA 12.9 (2 parts, 2.64 GiB (2,836,931,937 bytes))

Archive part	Size
ninfer-windows-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.7z.001	1.86 GiB (1,992,294,400 bytes)
ninfer-windows-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.7z.002	0.79 GiB (844,637,537 bytes)

Checksums: SHA256SUMS-ninfer-windows-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.txt.

Extract the first part with 7-Zip. It reads the remaining parts automatically.

7z x ninfer-windows-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.7z.001

Windows x64 — CUDA 13.4 (2 parts, 2.65 GiB (2,841,892,258 bytes))

Archive part	Size
ninfer-windows-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.7z.001	1.86 GiB (1,992,294,400 bytes)
ninfer-windows-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.7z.002	0.79 GiB (849,597,858 bytes)

Checksums: SHA256SUMS-ninfer-windows-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.txt.

Extract the first part with 7-Zip. It reads the remaining parts automatically.

7z x ninfer-windows-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.7z.001

Debian 13 x64 — Dual CUDA 12.9 + 13.4 (5 parts, 7.96 GiB (8,544,538,758 bytes))

Archive part	Size
ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.001	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.002	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.003	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.004	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.005	0.54 GiB (575,361,158 bytes)

Checksums: SHA256SUMS-ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.txt.

Concatenate the parts in this order and extract the archive.

sha256sum -c SHA256SUMS-ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.txt
cat ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.001 ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.002 ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.003 ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.004 ninfer-linux-x64-cuda12.9-13.4-a147b0c2750d.tar.gz.005 | tar -xz

Debian 13 x64 — CUDA 12.9 (3 parts, 4.04 GiB (4,337,450,851 bytes))

Archive part	Size
ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.tar.gz.001	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.tar.gz.002	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.tar.gz.003	0.33 GiB (352,862,051 bytes)

Checksums: SHA256SUMS-ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.txt.

Concatenate the parts in this order and extract the archive.

sha256sum -c SHA256SUMS-ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.txt
cat ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.tar.gz.001 ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.tar.gz.002 ninfer-linux-x64-cuda12.9-sm70-75-80-86-89-a147b0c2750d.tar.gz.003 | tar -xz

Debian 13 x64 — CUDA 13.4 (3 parts, 3.93 GiB (4,220,360,118 bytes))

Archive part	Size
ninfer-linux-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.tar.gz.001	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.tar.gz.002	1.86 GiB (1,992,294,400 bytes)
ninfer-linux-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.tar.gz.003	0.22 GiB (235,771,318 bytes)

Checksums: SHA256SUMS-ninfer-linux-x64-cuda13.4-sm75-80-86-89-120a-a147b0c2750d.txt.

Concatenate the parts in this order and extr...