Something about the latest commits has messed with the server. The same command to start the server now exits like this:
GGML_ASSERT: llama.cpp:1064: addr == NULL && size == 0
fish: Job 1, './server -m "/Users/behnam/Down…' terminated by signal SIGABRT (Abort)
Upgrade to the latest commit and do:
./server -m "<gguf model>" --ctx-size 4096 --threads 8 -ngl 128 --port 8080 --mlock --no-mmap
- Using
--mlock or --no-mmap alone doesn't crash the server.
Something about the latest commits has messed with the
server. The same command to start the server now exits like this:Upgrade to the latest commit and do:
--mlockor--no-mmapalone doesn't crash the server.