Skip to content

Deprecated instructions in llama.cpp docs cause errors #1677

@srai9

Description

@srai9

Bug description
The instructions in the 'Build from source' section on the GGUF usage with llama.cpp page use the deprecated Makefile build, which results in this error:
The Makefile build is deprecated. Use the CMake build instead. For more details, see https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md


Additional context
The modified instructions below worked for me (they're adapted from the llama.cpp documentation here)

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggml-org/llama.cpp

Step 2: Move into the llama.cpp folder and build it with the LLAMA_CURL=ON option along with other hardware-specific options (for ex: GGML_CUDA for Nvidia GPUs on Linux).

cd llama.cpp
cmake -B build -DLLAMA_CURL=ON
cmake --build build --config Release

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions