Feature/qa2

[Iamsdt]

This pull request introduces two new CLI commands, test and eval, to the agentflow_cli tool, providing a unified interface for running project tests and agent evaluations. It also adds configuration-driven behavior for both commands via agentflow.json, and updates the project templates to reflect these new capabilities. The most important changes are summarized below:

---

New CLI Commands:

• Added a test command that wraps pytest, supporting options for test path, coverage, HTML report, keyword filtering, verbosity, and forwarding extra arguments. The command can read defaults from a new test section in agentflow.json. [1]], [2]], [3]])
• Added an eval command for discovering and running agent evaluation scripts (*_eval.py/eval_*.py), always generating HTML and JSON reports unless disabled. The command supports configuration via a new evaluation section in agentflow.json. [1]], [2]], [3]])

Configuration Enhancements:

• Extended ConfigManager with get_test_config() and get_evaluation_config() methods to access the new config sections, enabling CLI commands to pick up project-specific defaults for test and evaluation runs. ([agentflow_cli/cli/core/config.pyR217-R238])
• Updated the production agentflow.json template to include test and evaluation sections with sample values for test path, coverage, coverage threshold, eval directory, output directory, and pass threshold. ([agentflow_cli/cli/templates/prod/agentflow.jsonR18-R28])

Template and Example Updates:

• Removed the old monolithic weather_agents.py evaluation script and replaced it with a minimal weather_agents_eval.py that only provides a get_eval_set() function, matching the new CLI-driven evaluation workflow. [1]], [2]])

---

These changes modernize and standardize the workflow for running tests and evaluations in agentflow projects, making it easier to configure, automate, and report on both via the CLI and project configuration.

[codecov]

Codecov Report

❌ Patch coverage is 19.38326% with 183 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
agentflow_cli/cli/commands/eval.py	18.24%	121 Missing ⚠️
agentflow_cli/cli/commands/test.py	18.36%	40 Missing ⚠️
agentflow_cli/cli/main.py	30.00%	14 Missing ⚠️
agentflow_cli/cli/core/config.py	20.00%	8 Missing ⚠️

📢 Thoughts on this report? Let us know!