chore(web): Add selectedReposCount property to wa_chat_message_sent posthog event

[brendan-kellam]

Add selectedReposCount to the wa_chat_message_sent event to track the number of selected repositories when users ask questions.

---

Linear Issue: SOU-575

  

Summary by CodeRabbit

• Chores
  • Enhanced analytics: chat events now include a count of repositories selected during a chat, improving insight into repository-focused queries.
  • Updated the changelog to reflect the new analytics entry and remove prior, now-obsolete entries.

[cursor]

Cursor Agent can help with this pull request. Just @cursor in comments and I'll start working on changes in this branch.
_{Learn more about Cursor Agents}

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between fcfcf81 and 8886c3c.

📒 Files selected for processing (1)

• CHANGELOG.md

---

Walkthrough

Adds a new numeric field selectedReposCount to the wa_chat_message_sent PostHog event and includes that field in both chat API endpoints' event payloads; updates changelog entry accordingly.

Changes

Cohort / File(s)	Summary
PostHog Event Type Definition packages/web/src/lib/posthogEvents.ts	Added required selectedReposCount: number to the wa_chat_message_sent event type.
Chat API Endpoints packages/web/src/app/api/(server)/chat/route.ts, packages/web/src/app/api/(server)/chat/blocking/route.ts	Include selectedReposCount in the wa_chat_message_sent event payload, derived from repository selection lengths.
Changelog CHANGELOG.md	Added entry noting selectedReposCount addition; removed two prior Added entries as deletions in this diff.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related PRs

• chore(web): Add selectedReposCount property to wa_chat_message_sent posthog event #941: Same change adding selectedReposCount to the wa_chat_message_sent event across types and endpoints.
• chore: Add additional PostHog events for chat repo tracking and UI interactions #922: Related modifications to wa_chat_message_sent payload (adds selectedRepos array) that complement this count field.
• fix(web): Fix issue with blocking chat api #907: Related updates to the same PostHog event, adding other event fields in the same area of the codebase.

Suggested reviewers

• msukkari

🚥 Pre-merge checks | ✅ 3

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Title check	✅ Passed	The title accurately describes the main change: adding a selectedReposCount property to the wa_chat_message_sent PostHog event, which is reflected across all modified files.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch cursor/SOU-575-ask-event-repos-count-f3f8

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[brendan-kellam]

@claude add a changelog

[claude]

Claude finished @brendan-kellam's task in 33s —— View job

---

Changelog Entry Added

• Read CHANGELOG.md
• Add entry under [Unreleased]
• Commit and push

Added the following entry to CHANGELOG.md under [Unreleased] > Added:

Added selectedReposCount to the wa_chat_message_sent PostHog event to track the number of selected repositories when users ask questions. #941

[coderabbitai]

Actionable comments posted: 1

Caution

Some comments are outside the diff and can’t be posted inline due to platform limitations.

⚠️ Outside diff range comments (1)

packages/web/src/app/api/(server)/chat/route.ts (1)

91-107: ⚠️ Potential issue | 🟡 Minor

selectedReposCount should use unique repos, not raw flattened length.

On Line 106, expandedRepos.length may overcount when scopes overlap (e.g., repo + reposet containing same repo). Use a deduped list for telemetry.

Proposed fix

             const expandedRepos = (await Promise.all(selectedSearchScopes.map(async (scope) => {
@@
             }))).flat();
+            const uniqueExpandedRepos = [...new Set(expandedRepos)];
 
             await captureEvent('wa_chat_message_sent', {
                 chatId: id,
                 messageCount: messages.length,
-                selectedReposCount: expandedRepos.length,
-                ...(env.EXPERIMENT_ASK_GH_ENABLED === 'true' ? { selectedRepos: expandedRepos } : {}),
+                selectedReposCount: uniqueExpandedRepos.length,
+                ...(env.EXPERIMENT_ASK_GH_ENABLED === 'true' ? { selectedRepos: uniqueExpandedRepos } : {}),
             } );
@@
-                selectedRepos: expandedRepos,
+                selectedRepos: uniqueExpandedRepos,

🤖 Prompt for AI Agents

Verify each finding against the current code and only fix it if needed.

In `@packages/web/src/app/api/`(server)/chat/route.ts around lines 91 - 107, The
telemetry currently uses expandedRepos.length which can double-count repos when
scopes overlap; dedupe expandedRepos before sending telemetry: create a unique
list from expandedRepos (e.g., via a Set) and use that deduped list for
selectedReposCount (and for the selectedRepos payload when
env.EXPERIMENT_ASK_GH_ENABLED is 'true'); update references in the captureEvent
call to use the deduped list instead of expandedRepos.

🤖 Prompt for all review comments with AI agents

Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@packages/web/src/app/api/`(server)/chat/blocking/route.ts:
- Around line 164-170: The telemetry currently uses selectedRepos.length which
may count duplicates; before calling captureEvent('wa_chat_message_sent')
compute the unique repository identifiers (e.g., derive uniqueRepoValues =
Array.from(new Set(selectedRepos.map(r => r.value)))) and use
uniqueRepoValues.length for selectedReposCount, and when
env.EXPERIMENT_ASK_GH_ENABLED === 'true' send selectedRepos: uniqueRepoValues
(not the raw selectedRepos) so the metric and payload reflect deduplicated repo
names.

---

Outside diff comments:
In `@packages/web/src/app/api/`(server)/chat/route.ts:
- Around line 91-107: The telemetry currently uses expandedRepos.length which
can double-count repos when scopes overlap; dedupe expandedRepos before sending
telemetry: create a unique list from expandedRepos (e.g., via a Set) and use
that deduped list for selectedReposCount (and for the selectedRepos payload when
env.EXPERIMENT_ASK_GH_ENABLED is 'true'); update references in the captureEvent
call to use the deduped list instead of expandedRepos.

---

ℹ️ Review info

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between f9421ed and fcfcf81.

📒 Files selected for processing (4)

• CHANGELOG.md
• packages/web/src/app/api/(server)/chat/blocking/route.ts
• packages/web/src/app/api/(server)/chat/route.ts
• packages/web/src/lib/posthogEvents.ts