Skip to content

Bug: Can not load llava projector when running llava-cli #10191

@JuntaoLiu01

Description

@JuntaoLiu01

What happened?

follow thec steps to run llava-v1.5 example,
the image-procejector is generated by:
python ./examples/llava/convert_image_encoder_to_gguf.py -m ../clip-vit-large-patch14-336 --llava-projector ../llava-v1.5-7b/llava.projector --output-dir ../llava-v1.5-7b

when all gguf models are prepared, run:
./llama-llava-cli -m ../llava-v1.5-7b/ggml-model-f16.gguf --mmproj ../llava-v1.5-7b/mmproj-model-f16.gguf --image path/to/an/image.jpg

the errors occured:
gguf_init_from_file: GGUFv1 is no longer supported. please use a more up-to-date version
libc++abi: terminating due to uncaught exception of type std::runtime_error: clip_model_load: failed to load CLIP model

Name and Version

version: 4020 (9f40989)
built with Apple clang version 13.0.0 (clang-1300.0.29.30) for x86_64-apple-darwin23.6.0

What operating system are you seeing the problem on?

Mac

Relevant log output

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bug-unconfirmedlow severityUsed to report low severity bugs in llama.cpp (e.g. cosmetic issues, non critical UI glitches)

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions