-
Notifications
You must be signed in to change notification settings - Fork 14k
Description
What happened?
follow thec steps to run llava-v1.5 example,
the image-procejector is generated by:
python ./examples/llava/convert_image_encoder_to_gguf.py -m ../clip-vit-large-patch14-336 --llava-projector ../llava-v1.5-7b/llava.projector --output-dir ../llava-v1.5-7b
when all gguf models are prepared, run:
./llama-llava-cli -m ../llava-v1.5-7b/ggml-model-f16.gguf --mmproj ../llava-v1.5-7b/mmproj-model-f16.gguf --image path/to/an/image.jpg
the errors occured:
gguf_init_from_file: GGUFv1 is no longer supported. please use a more up-to-date version
libc++abi: terminating due to uncaught exception of type std::runtime_error: clip_model_load: failed to load CLIP model
Name and Version
version: 4020 (9f40989)
built with Apple clang version 13.0.0 (clang-1300.0.29.30) for x86_64-apple-darwin23.6.0
What operating system are you seeing the problem on?
Mac
Relevant log output
No response