Skip to content

Add Expert session summary with conversation quality signals#4758

Open
dimitrieh wants to merge 1 commit intomainfrom
feature/expert-session-summary
Open

Add Expert session summary with conversation quality signals#4758
dimitrieh wants to merge 1 commit intomainfrom
feature/expert-session-summary

Conversation

@dimitrieh
Copy link
Copy Markdown
Contributor

@dimitrieh dimitrieh commented Mar 24, 2026

Description

Fires an expert-session-summary event once per Expert session, capturing the full conversation profile when the session ends.

Event properties:

Property Description
trigger What ended the session: close, transfer-to-app, page-leave, or clear
duration_seconds How long the modal was open
user_messages Total messages the user sent
ai_responses_rich Count of guide/resource responses (high-value structured content)
ai_responses_plain Count of plain chat responses
page Page where the conversation happened

All exit paths covered:

  • Modal close (X button or backdrop click)
  • Transfer to app ("Continue in FlowFuse" button)
  • Page leave (navigation or tab close)
  • Conversation clear (new session button)

Deduplicated — fires only once per session regardless of which exit path triggers first.

PostHog setup (Production):

Related Issue(s)

Findings from FlowFuse Expert tracking audit (internal research). Builds on #4755.

Checklist

  • I have read the contribution guidelines
  • I have considered the performance impact of these changes
  • Suitable unit/system level tests have been added and they pass
  • Documentation has been updated
  • For blog PRs, an Art Request has been created (instructions)

Fire expert-session-summary when a conversation ends, capturing:
- trigger: close, transfer-to-app, page-leave, or clear
- duration_seconds: time modal was open
- user_messages: total user messages in session
- ai_responses_rich: guide/resource responses (high-value)
- ai_responses_plain: chat responses (standard)

Fires once per session (deduplicated). Covers all exit paths:
modal close, transfer to app, page navigation, and conversation clear.
@netlify
Copy link
Copy Markdown

netlify bot commented Mar 24, 2026

Deploy Preview for flowforge-website ready!

Name Link
🔨 Latest commit 86d8403
🔍 Latest deploy log https://app.netlify.com/projects/flowforge-website/deploys/69c30c96df10b30008c0fbcc
😎 Deploy Preview https://deploy-preview-4758--flowforge-website.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
Lighthouse
Lighthouse
1 paths audited
Performance: 88 (🔴 down 3 from production)
Accessibility: 81 (no change from production)
Best Practices: 100 (no change from production)
SEO: 91 (no change from production)
PWA: -
View the detailed breakdown and full score reports

To edit notification comments on pull requests, go to your Netlify project configuration.

@dimitrieh
Copy link
Copy Markdown
Contributor Author

dimitrieh commented Mar 24, 2026

@cstns @Steve-Mcl this one might need more work or thinking of we want this to be done well across website and app etc. Thought welcome! :)

@dimitrieh dimitrieh requested review from Steve-Mcl and cstns March 24, 2026 22:20
@cstns
Copy link
Copy Markdown
Contributor

cstns commented Mar 25, 2026

lgtm at first glance. I'm don't understand the why or the how we're going track across website and app though

@Steve-Mcl
Copy link
Copy Markdown
Contributor

Agree with @cstns here. there is means of tracking the success since we wont know if this lead to a sign up or login!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants