Skip to content

NInfer Windows 0.3.0 (portable, CUDA 13.1)

Choose a tag to compare

View all tags
@natpate natpate released this 18 Aug 09:22
· 16 commits to master since this release
v0.3.0
8f12479

Synced 8 upstream commits (improved media/vision pipeline, gdn snapshot isolation, Qwen3.8 performance docs)

Added context-window reporting: /v1/models and /v1/models/{id} now include meta.n_ctx = the served --max-context ceiling, so clients that auto-detect context need no manual configuration.

All bundled launchers now set a distinct public model id via --model-id so the groupwise-int and NVFP4 builds of the same base model are distinguishable by clients.

Self-contained portable zip: exes, runtime DLLs, per-model launchers (150k baseline), models/ folder, README.txt, SHA256SUMS. Requires Windows 11 x64, RTX 5090 (sm_120a), and a CUDA 13.1-capable NVIDIA driver.

Assets 3
Loading