Releases
v1.77.0
Compare
Sorry, something went wrong.
No results found
New Features
c3c5284 - gooddata-eval : record why an agentic simulated-user loop stopped (PR #1789 by @Tomkess )
1daa2c4 - gooddata-eval : add the agentic anomaly-detection evaluator (PR #1801 by @Tomkess )
4fa3949 - gooddata-eval : recognize the report answer part
aaba134 - gooddata-eval : add the agentic report-skill evaluator
cb44617 - gooddata-eval : judge the narrative of a drafted report
8d8a6fe - gooddata-eval : relay user_context on every agentic kind (commit by @myhoai )
38fa9d4 - gooddata-eval : report whether the agent ran the chart it built (commit by @myhoai )
afb8b79 - gooddata-eval : label gen-ai traces through W3C baggage (commit by @tychtjan )
8168136 - eval : capture the detail of every failing run, not just the winning one (PR #1816 by @Tomkess )
92fe97e - gooddata-eval : check that gen-ai sends the Document wire names
a540bcd - gooddata-eval : add --tag to put custom tags on Langfuse traces (commit by @janmatzek )
8cefcde - gooddata-eval : put gen-ai turns under the eval item root trace (commit by @tychtjan )
524f8d1 - gooddata-eval : keep the SSE error reason on every ChatError (commit by @tychtjan )
f62aba3 - gooddata-eval : send an item's scores as one Langfuse request (commit by @tychtjan )
e8eaa31 - gooddata-eval : name gooddata-eval in Langfuse requests and spans (commit by @tychtjan )
7fcae3a - gooddata-eval : score v2 Publisher documents
Bug Fixes
a902b08 - gooddata-eval : log the adhoc-visualization fallback (commit by @myhoai )
8152217 - gooddata-eval : delete a metric again when a concurrent write restores it (commit by @myhoai )
ab84a23 - gooddata-eval : let --gate decide a what-if item, not pass@K alone (PR #1831 by @Tomkess )
ba0494d - gooddata-eval : wait out the Langfuse rate-limit window on a 429 (commit by @tychtjan )
1ec1797 - gooddata-eval : keep sending score batches after one fails (commit by @tychtjan )
Refactors
83473b8 - gooddata-eval : name the report skill evaluator for documents
Tests
e04c1a2 - gooddata-eval : use the real report document in the report-part test
a1ae1c2 - enable pytest strict mode (commit by @hkad98 )
e22419e - gooddata-eval : extend evaluator for dashboard builder skill (commit by @huyenthanh09 )
Chores
You can’t perform that action at this time.