Skip to content

Conversation

@JoshFerge
Copy link
Member

@JoshFerge JoshFerge commented Nov 10, 2025

Add analytics to capture whether a user provided instructions when clicking "Code it up".

Fixes AIML-1530

Add analytics to capture whether a user provided instructions when
clicking "Code it up". This tracks if the user either:
- Has instructions typed in the input field
- Has already added human instruction steps to the solution

Follows the same pattern as autofix.root_cause.find_solution event.

Fixes AIML-1530
@linear
Copy link

linear bot commented Nov 10, 2025

@github-actions github-actions bot added the Scope: Frontend Automatically applied to PRs that change frontend components label Nov 10, 2025
Only check if there are instructions in the input field at the time
of clicking, matching the pattern used in autofix.root_cause.find_solution
@JoshFerge JoshFerge marked this pull request as ready for review November 10, 2025 16:40
@JoshFerge JoshFerge requested a review from a team as a code owner November 10, 2025 16:40
@JoshFerge JoshFerge enabled auto-merge (squash) November 10, 2025 16:41
The hasInstructions check now properly accounts for instructions that
were previously added via the Add button. When users add instructions
to solutionItems and then click 'Code It Up', those instructions are
included in the submitted solution, so we should track instruction_provided
as true.

Checks both:
- Instructions currently typed in the input field
- Human instruction items already added to solutionItems
Filter out deactivated instructions when checking instruction_provided.
Users can toggle instructions off via the UI, and inactive instructions
are not included in the submitted solution, so they shouldn't be counted
as provided in analytics.
@JoshFerge JoshFerge merged commit 136a0b8 into master Nov 10, 2025
48 checks passed
@JoshFerge JoshFerge deleted the joshferge/aiml-1530-track-instructions-provided-on-code-it-up-clicks branch November 10, 2025 16:59
Jesse-Box pushed a commit that referenced this pull request Nov 12, 2025
)

Add analytics to capture whether a user provided instructions when
clicking "Code it up".

Fixes AIML-1530
andrewshie-sentry pushed a commit that referenced this pull request Nov 13, 2025
)

Add analytics to capture whether a user provided instructions when
clicking "Code it up".

Fixes AIML-1530
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Frontend Automatically applied to PRs that change frontend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants