Skip to content

ERROR: LiteLLM call failed: litellm.APIError: APIError: GroqException - Connection error. #1624

Description

@SujayC66

Description

i have created project using command

crewai create crew project folder name

After editing script as per my requirements when Im runniung the code using crewai run Im getting above error

I have use chatgroq from langchain_groq as well crewai class LLM.
Any lead will be appreciated

Steps to Reproduce

No

Expected behavior

markdown report

Screenshots/Code snippets

@crewbase
class QuestionCrew():
"""KPIs questions discovery crew"""

agents_config = 'config/questions/agents.yaml'
tasks_config = 'config/questions/tasks.yaml'

# @llm
# def llm_model(self):
# 	return ChatGroq(model="groq/llama-3.1-70b-versatile",
# 		 	   api_key=os.environ.get("GROQ_API_KEY"),
# 			   max_tokens=8000,
# 			   temperature=0,
# 			   )

# @llm
# def llm_model(self):
# 	return openai.OpenAI(
# 						base_url="https://api.groq.com/openai/v1",
# 						api_key=os.environ.get("GROQ_API_KEY"),
# 						)

@llm
def llm_model(self):
	return LLM(model="groq/llama-3.1-70b-versatile",
		 	   api_key="",
			   max_tokens=8000,
			   temperature=0
			   )


@agent
def business_analyst(self) -> Agent:
	return Agent(
		config=self.agents_config['business_analyst'],
		max_rpm=None,
		verbose=True,
		# llm= LLM(model="groq/llama-3.1-70b-versatile",
		#  	   api_key="",
		# 	   max_tokens=8000,
		# 	   temperature=0,
		# 	   )
	)

Operating System

Windows 11

Python Version

3.11

crewAI Version

0.80.0

crewAI Tools Version

0.80.0

Virtual Environment

Venv

Evidence

ERROR: LiteLLM call failed: litellm.APIError: APIError: GroqException - Connection error.

Possible Solution

NA

Additional context

I tried through multiple ways

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions