What's the equivalent to --no-mmap?

[yves5141]

So --no-mmap is deprecated, but what's the eqivalent --load-mode?

[lMysticl]

The exact replacement for --no-mmap is:

llama-server ... --load-mode none

Or via the environment:

LLAMA_ARG_LOAD_MODE=none

The current argument parser maps --no-mmap directly to LLAMA_LOAD_MODE_NONE. The old flag still works for now, but is deprecated.

--load-mode mlock is different: it keeps the model locked in RAM. Also, avoid passing both the old and new flags because only the last one takes effect.

Source: current argument parser.

[yves5141]

Thanks!