Skip to content

NInfer Windows 0.2.0 (portable, CUDA 13.1)

Choose a tag to compare

View all tags
@natpate natpate released this 17 Aug 08:36
· 29 commits to master since this release
v0.2.0
457c475

New in 0.2.0:

  • Qwen3.8-27B NVFP4 artifact support (runtime + converter), validated end-to-end
  • In-process Web UI serving (stock llama.cpp WebUI, same port as /v1)
  • Serving fixes from upstream: unified multimodal context admission, ordered instruction turns, thinking-preserving prefix reuse

Self-contained portable zip: executables, all runtime DLLs, one launcher per supported model (all at 150k context), models\ folder, README.txt, SHA256SUMS. Verify against SHA256SUMS after download. Windows 11 x64, RTX 5090, CUDA 13.1-capable driver.

Assets 3
Loading