Skip to content

2026.11.14.05

Choose a tag to compare

@rizagp rizagp released this 13 Nov 21:51

Unpack anywhere, then run setup.cmd (or zero-launcher.cmd once a model is there).

New since 2026.11.14.04 (on one GPU, results and speed unchanged: the same logits bit for bit):

  • Multi-GPU (--gpus): the sums go straight from GPU to GPU where the links allow it. At start the engine times every link (each GPU to host memory and back, and GPU to GPU when the driver reports peer access, as Linux does for B60s on one switch) and logs them with its choice. When direct copies are faster, each sum crosses PCIe once instead of twice and the GPUs read their own memory. The logits are the same bit for bit. ARC_TP_P2P=0 / =1 forces it off / on. On Windows the B60s report no peer access, so nothing changes there. Speed on Linux B60s: to be measured (issue #17).
  • Server: a request that asks for Connection: close (or HTTP/1.0 without keep-alive) gets it, and the connection ends after the reply instead of waiting up to 600 s.