-
Notifications
You must be signed in to change notification settings - Fork 524
Description
TinyLlama 1.1B not working in google collab when i try to run the steps provided. it is failing in 2nd cell itself.
!pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="TinyLlama/TinyLlama-1.1B-Chat-v0.6",
filename="{{GGUF_FILE}}",
)
error:
ValueError Traceback (most recent call last)
/tmp/ipython-input-737212032.py in <cell line: 0>()
3 from llama_cpp import Llama
4
----> 5 llm = Llama.from_pretrained(
6 repo_id="TinyLlama/TinyLlama-1.1B-Chat-v0.6",
7 filename="{{GGUF_FILE}}",
/usr/local/lib/python3.12/dist-packages/llama_cpp/llama.py in from_pretrained(cls, repo_id, filename, additional_files, local_dir, local_dir_use_symlinks, cache_dir, **kwargs)
2290
2291 if len(matching_files) == 0:
-> 2292 raise ValueError(
2293 f"No file found in {repo_id} that match {filename}\n\n"
2294 f"Available Files:\n{json.dumps(file_list)}"
ValueError: No file found in TinyLlama/TinyLlama-1.1B-Chat-v0.6 that match {{GGUF_FILE}}
Available Files:
[".gitattributes", "README.md", "config.json", "generation_config.json", "ggml-model-q4_0.gguf", "model.safetensors", "special_tokens_map.json", "tokenizer.json", "tokenizer.model", "tokenizer_config.json"]