Skip to content

v0.3.0 - AI Feedback & Metrics Integration

Choose a tag to compare

@andrewm4894 andrewm4894 released this 20 Jan 11:40
· 28 commits to main since this release

What's New

AI Feedback Tools

  • capture_feedback_rating - Capture thumbs up/down ratings with optional comments
  • capture_feedback_text - Capture detailed text feedback

PostHog Integration

  • Hybrid approach: feedback creates both SDK custom_span (shows in trace view) AND PostHog $ai_metric/$ai_feedback events (for dashboards)
  • Events linked to trace via $ai_trace_id for full correlation

Agent Feedback Detection

The coordinator now detects feedback signals automatically:

  • Positive: "good job", "thanks", "perfect", "looks good"
  • Negative: "not great", "bad", "wrong", "missed something"
  • Detailed: any specific suggestions or comments

Bug Fixes

  • Fixed Slack tool to show actual days_back parameter passed (removed hidden extra days logic)
  • Slack context days now controlled by data gatherer instructions (+3 days for background)

Example Usage

User: "that looks great, thanks!"
Agent: [captures positive feedback]
Agent: "Thanks for the feedback!"

User: "not great, you missed the auth PR review"
Agent: [captures negative feedback with comment]
Agent: "Got it, let me update the standup..."