No test cases found error

[GantaVenkataKousik]

See this code:

`import json
import asyncio
from deepeval.metrics import AnswerRelevancyMetric, SummarizationMetric, HallucinationMetric
from deepeval.test_case import LLMTestCase
from deepeval import assert_test
import os
import openai # Import OpenAI library

Initialize OpenAI API key

os.environ["OPENAI_API_KEY"] = "MY_OPEN_AI_KEY"

Function to retrieve summary asynchronously (replace with actual implementation)

async def get_summary(input_text):
# Call the OpenAI chatbot to generate a response
response = openai.Completion.create(
engine="text-davinci-003", # Specify the engine to use
prompt=input_text,
max_tokens=150 # Specify the maximum number of tokens for the response
)
return response.choices[0].text.strip()

Function to read questions from JSON file

def read_questions_from_json(file_path):
with open(file_path, 'r') as file:
data = json.load(file)
questions = [item['question'] for item in data['questions']]
return questions

Function to perform analysis

async def perform_analysis(test_cases):
loop = asyncio.new_event_loop()
asyncio.set_event_loop(loop)

for test_case in test_cases:
    assert_test(test_case, metrics=[test_case.metric])

async def create_test_cases(medical_questions, answers, context):
test_cases = []
tasks = []

for i, prompt in enumerate(medical_questions):
    task = asyncio.create_task(get_summary_and_create_test_case(prompt, answers[i], context, test_cases))
    tasks.append(task)

await asyncio.gather(*tasks)

return test_cases

Function to retrieve summary asynchronously and create test case

async def get_summary_and_create_test_case(prompt, expected_output, context, test_cases):
actual_output = await get_summary(prompt)
test_case = LLMTestCase(
input=prompt,
actual_output=actual_output,
expected_output=expected_output,
context=context,
metric=HallucinationMetric(threshold=0.7)
)
test_cases.append(test_case)

Main function

async def main():
# Path to the JSON file containing medical questions
file_path = "medical_questions.json"

# Read questions from JSON file
medical_questions = read_questions_from_json(file_path)

# Placeholder for expected answers
answers = ["Mock expected summary"] * len(medical_questions)

# Placeholder for context if needed
context = None

# Create test cases asynchronously
test_cases = await create_test_cases(medical_questions, answers, context)

# Perform analysis
await perform_analysis(test_cases)

if name == "main":
main()
`

OUTPUT :
`plugins: deepeval-0.21.36, anyio-4.3.0, repeat-0.9.3, xdist-3.6.1
collected 0 items
Running teardown with pytest sessionfinish...

=========================================================================== 2 warnings in 0.01s ===========================================================================
No test cases found, please try again.`

[penguine-ip]

Hey @GantaVenkataKousik there is some formatting errors in your code can you double check your backticks. You're getting this error because you're using assert_test outside of a test file (?) or test function (?) (can't tell properly because of the formatting). Please read the docs to learn how to use the assert_test function properly: https://docs.confident-ai.com/docs/getting-started#create-your-first-metric

[GantaVenkataKousik]

Hey @GantaVenkataKousik there is some formatting errors in your code can you double check your backticks. You're getting this error because you're using assert_test outside of a test file (?) or test function (?) (can't tell properly because of the formatting). Please read the docs to learn how to use the assert_test function properly: https://docs.confident-ai.com/docs/getting-started#create-your-first-metric

I have reviewed the documentation, but I'm still unable to identify the issue. These are the screenshots of the code .

[penguine-ip]

Hey @GantaVenkataKousik I missed your message, can you come to our discord for faster response times? https://discord.com/invite/a3K9c8GRGt

assert_test is not meant to be used in a for loop, nor is it meant to be used outside of deepeval test run. come to discord to talk more

[GantaVenkataKousik]

Hey @GantaVenkataKousik I missed your message, can you come to our discord for faster response times? https://discord.com/invite/a3K9c8GRGt

assert_test is not meant to be used in a for loop, nor is it meant to be used outside of deepeval test run. come to discord to talk more

Sure , I will join discord .