v1.14.1 ValueError: Unsupported model_provider='groq/xxxxx'

[hamiltonchua]

Describe the bug
I upgraded scapegraphai from 1.13.3 to 1.14.1.
After the upgrade I now get the following error when using groq

ValueError: Unsupported model_provider='groq/llama3_70b_8192'

[goasleep]

@hamiltonchua you can try use model_instance to replace it. Here are the doc for your reference.

[JINO-ROHIT]

replace model_provider with model_instance?

[f-aguzzi]

We had a merge issue last week which broke the code that handles instancing models from the name you put in the config. We fixed in the latest beta, or at least that was the intention. I'll check it out and let you know.

[goasleep]

You used it wrong. and use it like below @hamiltonchua

from langchain_groq import ChatGroq

llm_model_instance = ChatGroq(
    GROQ_API_KEY="xxxxx"
    model="llama3_70b_8192",
    ## other config
)

graph_config = {
    "llm": {
        "model_instance": llm_model_instance, 
        "model_tokens": 5000
    },
}

[JINO-ROHIT]

@goasleep gotcha , this works

[hamiltonchua]

Confirming using model instance works.
Note that GROQ_API_KEY needs to exist in the environment, ChatGroq doesn't accept GROQ_API_KEY as a parameter.

[hamiltonchua]

confirming that using model_instance works in v1.15.0 as well, I think the section on Groq on this page
https://scrapegraph-ai.readthedocs.io/en/latest/scrapers/llm.html
just needs to be updated if we can't use that config anymore

thanks all so much for the assist

[hamiltonchua]

closing this now since using model_instance works