Skip to content

TinyLlama 1.1B not working in google collab #1752

@ravipras8

Description

@ravipras8

TinyLlama 1.1B not working in google collab when i try to run the steps provided. it is failing in 2nd cell itself.

!pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
repo_id="TinyLlama/TinyLlama-1.1B-Chat-v0.6",
filename="{{GGUF_FILE}}",
)

error:


ValueError Traceback (most recent call last)
/tmp/ipython-input-737212032.py in <cell line: 0>()
3 from llama_cpp import Llama
4
----> 5 llm = Llama.from_pretrained(
6 repo_id="TinyLlama/TinyLlama-1.1B-Chat-v0.6",
7 filename="{{GGUF_FILE}}",

/usr/local/lib/python3.12/dist-packages/llama_cpp/llama.py in from_pretrained(cls, repo_id, filename, additional_files, local_dir, local_dir_use_symlinks, cache_dir, **kwargs)
2290
2291 if len(matching_files) == 0:
-> 2292 raise ValueError(
2293 f"No file found in {repo_id} that match {filename}\n\n"
2294 f"Available Files:\n{json.dumps(file_list)}"

ValueError: No file found in TinyLlama/TinyLlama-1.1B-Chat-v0.6 that match {{GGUF_FILE}}

Available Files:
[".gitattributes", "README.md", "config.json", "generation_config.json", "ggml-model-q4_0.gguf", "model.safetensors", "special_tokens_map.json", "tokenizer.json", "tokenizer.model", "tokenizer_config.json"]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions