ai_test_util

This is a tool to automate testing prompts against a set of data.

Example config:

OPENAI_API_KEY=""
TEST_DIR="tests"
RESULTS_DIR="results"
MODEL="gpt-4o"
GEN_PROMPT="prompts/gen_prompt.md"
TEST_PROMPT="prompts/test_prompt.md"