Skip to content

v1.76.0

Choose a tag to compare

@github-actions github-actions released this 01 Oct 08:24
· 99 commits to master since this release

New Features

  • 446e774 - gooddata-eval: report what a run actually did (commit by @xvalovic)
  • b0135f4 - gooddata-eval: generate eval datasets from a workspace's insights (commit by @xvalovic)
  • d12931e - gooddata-eval: evaluate the agentic dashboard-creation skill (commit by @FrankHuynh)
  • 9be051b - gooddata-eval: add the agentic what-if-analysis evaluator (PR #1799 by @Tomkess)
  • 97ec295 - gooddata-eval: score dashboard editing alongside creation (commit by @FrankHuynh)
  • 0e6c832 - gooddata-api-client: add missing workspace permissions (commit by @jeskepetr)
  • f9b198e - gooddata-eval: grade conversations on keeping context (commit by @myhoai)

Bug Fixes

  • 7f08a54 - gooddata-eval: stop transient gen-ai faults from being scored as content failures (PR #1793 by @Tomkess)
  • c73f047 - gooddata-eval: compare attribute-filter elements as a set, not a sequence (PR #1806 by @Tomkess)
  • 1ab844c - gooddata-eval: a refusal that offers a safe alternative is a pass (AIS-52) (PR #1807 by @Tomkess)
  • 26f2813 - gooddata-eval: do not retry a turn that hit the iteration limit (commit by @myhoai)
  • 4a64094 - gooddata-eval: keep metrics the agent only updated during cleanup (commit by @myhoai)

Refactors

  • b58ed4e - gooddata-eval: type the generated visualization spec (commit by @xvalovic)

Tests

  • c66ac11 - gooddata-eval: cover the clarification judge and simulated user (commit by @myhoai)
  • ee39a75 - gooddata-eval: annotate the conversation tests, drop the openai patches (commit by @myhoai)

Chores

  • 782acee - gooddata-eval: use neutral identifiers in fixtures, drop a hardcoded path (PR #1827 by @Tomkess)