Skip to content

fix: update METRIC_METADATA target display strings to match green zone threshold (>0.85) for context_precision and context_recall #352

@decko

Description

@decko

Summary

METRIC_METADATA in src/raki/report/html_report.py:180 still shows 'Target: >0.80' as the display string for context_precision and context_recall, while the color zone green threshold was updated to 0.85 in PR #350. This mismatch can confuse users who see a score of e.g. 0.82 rendered as yellow/amber in the report while the tooltip says the target is >0.80.

Details

  • File: src/raki/report/html_report.py:180
  • Affected metrics: context_precision, context_recall
  • Current display string: 'Target: >0.80'
  • Current green zone threshold: 0.85
  • A score of 0.82 satisfies the displayed target but is still rendered in yellow/amber, which is contradictory from a UX standpoint.

Suggested Fix

Either:

  1. Update the target display strings from '>0.80' to '>0.85' to match the color zone thresholds, or
  2. Add clarifying UI copy (e.g., tooltip or legend) that distinguishes between the minimum acceptable target and the green zone threshold, if they are intentionally different concepts.

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    triage-neededNeeds investigation or decision

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions