Repository navigation
v25.1.0
Immutable
release. Only release title and notes can be modified.
Added
- Added optional
judgeScoresto AgentControl config metrics. It lists the average score and sample count for every judge metric recorded in the time range, keyed by the judge's evaluation metric key ($ld:ai:judge:<suffix>), including custom judges and the built-in accuracy, relevance, and toxicity judges. It is omitted when no judge scores were recorded. The existingjudgeAccuracy,judgeRelevance, andjudgeToxicityfields are unchanged. Affected endpoints:GET /api/v2/projects/{projectKey}/ai-configs/{configKey}/metricsGET /api/v2/projects/{projectKey}/ai-configs/{configKey}/metrics-by-variation
- Added optional
analysisUniton each metric in environment release responses. It is the context kind used as the metric's analysis unit. It is the release's randomization unit unless the metric uses a decoupled unit of analysis. Releases started before analysis units were recorded omitanalysisUnit, and those metrics are analyzed on the randomization unit. Affected endpoints:GET /api/v2/projects/{projectKey}/flags/{flagKey}/environments/{environmentKey}/releasesPOST /api/v2/projects/{projectKey}/flags/{flagKey}/environments/{environmentKey}/releasesGET /api/v2/projects/{projectKey}/flags/{flagKey}/environments/{environmentKey}/releases/{releaseId}PUT /api/v2/projects/{projectKey}/flags/{flagKey}/environments/{environmentKey}/releases/{releaseId}/stop
- Added optional
analysisUniton each metric inPOST /api/v2/projects/{projectKey}/flags/{flagKey}/environments/{environmentKey}/releases. It sets the context kind used as the metric's analysis unit. Omit it to analyze on the randomization unit. A value must differ from the randomization unit and be one of the metric's units. Percentile metrics, ratio metrics, and metrics in a group cannot set it.