Python 4.1.0

New to deepeval? Get started here.

✨ New Feature

• Add AgentLoopDetectionMetric for deterministic loop detection in agent traces. (#2645 by @Jeel3011)
• Add a deterministic ToolPermissionMetric for metrics evaluation. (#2826 by @gh-raju)

⚡ Improvement

• Add an AI-generated draft body for release notes generation. (#2861 by @A-Vamshi)
• Fix typos in documentation and code comments. (#2865 by @maxtaran2010)

🐛 Bug Fix

• Fix MCP metrics to use tools_called and relax type strictness. (#2864 by @A-Vamshi)
• Fix Ragas integration to call capture_metric_type with the updated telemetry signature. (#2568 by @sachinML)
• Fix task completion to pass tools_called_formatted into the extract_goal_and_outcome template. (#2808 by @ppcvote)
• Fix synthesizer crash by avoiding an UnboundLocalError when a document yields zero chunks. (#2849 by @hassaanch23)
• Fix dotted attribute access to deepeval.evaluate.configs. (#2851 by @ErenAta16)

New contributors: @maxtaran2010, @Jeel3011, @gh-raju, @sachinML, @ppcvote, @hassaanch23, @ErenAta16

A huge thank you to everyone who contributed to this release ❤️