readme : clarify MODEL_ENDPOINT usage

[angt]

Overview

ModelScope is not an HF-compatible endpoint.

Additional information

A dedicated -ms option could be added in the future.

Requirements

• I have read and agree with the contributing guidelines
• AI usage disclosure: NO

[yingdachen]

Not sure why this change is made to the readme without any code change? With no code hange, it would appear that the usage

MODEL_ENDPOINT=https://www.modelscope.cn/ ./llama-cli -hf ggml-org/gemma-3-1b-it-GGUF

would still be valid.

There was disccusion before the implementation was oringally merged and the MODEL_ENDPOINT approach was suggested, are the communities now favoring option like

./llama-cli -ms ggml-org/gemma-3-1b-it-GGUF`

instead?

@angt @ggerganov

[angt]

Hi @yingdachen,

Indeed, we updated the -hf option recently to share the same cache as the hf tool and do the discovery of the model and the mmproj locally, not relying on the API. So it is not possible anymore to mix different source under the same -hf flag:

$ MODEL_ENDPOINT=https://www.modelscope.cn/ build/bin/llama-cli -hf ggml-org/gemma-3-1b-it-GGUF
get_repo_commit: JSON error: [json.exception.parse_error.101] parse error at line 2, column 1: syntax error while parsing value - invalid literal; last read: '<U+000A><'
error: failed to download model from Hugging Face

I did a PR especially to clarify that as I was not aware of this usage and so I proposed a -ms for ModelScope.

[yingdachen]

Hi @yingdachen,

Indeed, we updated the -hf option recently to share the same cache as the hf tool and do the discovery of the model and the mmproj locally, not relying on the API. So it is not possible anymore to mix different source under the same -hf flag:

$ MODEL_ENDPOINT=https://www.modelscope.cn/ build/bin/llama-cli -hf ggml-org/gemma-3-1b-it-GGUF
get_repo_commit: JSON error: [json.exception.parse_error.101] parse error at line 2, column 1: syntax error while parsing value - invalid literal; last read: '<U+000A><'
error: failed to download model from Hugging Face

I did a PR especially to clarify that as I was not aware of this usage and so I proposed a -ms for ModelScope.

thanks for the clarification @angt , we will take a look and submit a PR for the -ms option later.