Summary
METRIC_METADATA in src/raki/report/html_report.py:180 still shows 'Target: >0.80' as the display string for context_precision and context_recall, while the color zone green threshold was updated to 0.85 in PR #350. This mismatch can confuse users who see a score of e.g. 0.82 rendered as yellow/amber in the report while the tooltip says the target is >0.80.
Details
- File:
src/raki/report/html_report.py:180
- Affected metrics:
context_precision, context_recall
- Current display string:
'Target: >0.80'
- Current green zone threshold:
0.85
- A score of 0.82 satisfies the displayed target but is still rendered in yellow/amber, which is contradictory from a UX standpoint.
Suggested Fix
Either:
- Update the target display strings from
'>0.80' to '>0.85' to match the color zone thresholds, or
- Add clarifying UI copy (e.g., tooltip or legend) that distinguishes between the minimum acceptable target and the green zone threshold, if they are intentionally different concepts.
References
Summary
METRIC_METADATAinsrc/raki/report/html_report.py:180still shows'Target: >0.80'as the display string forcontext_precisionandcontext_recall, while the color zone green threshold was updated to0.85in PR #350. This mismatch can confuse users who see a score of e.g. 0.82 rendered as yellow/amber in the report while the tooltip says the target is>0.80.Details
src/raki/report/html_report.py:180context_precision,context_recall'Target: >0.80'0.85Suggested Fix
Either:
'>0.80'to'>0.85'to match the color zone thresholds, orReferences