Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Log info on code generated by Cody #672

Closed
Tracked by #582
abeatrix opened this issue Aug 14, 2023 · 0 comments · Fixed by #675
Closed
Tracked by #582

Log info on code generated by Cody #672

abeatrix opened this issue Aug 14, 2023 · 0 comments · Fixed by #675
Assignees
@abeatrix
Labels
clients/vscode

Comments

@abeatrix
Copy link
Contributor

abeatrix commented Aug 14, 2023 •
edited
Loading

RE: https://sourcegraph.slack.com/archives/C05AGQYD528/p1691625411742429

Included in patch release #698

Done in #675 & #696

Added the following events:

Description Type Example Log Entry
Chat submit from sidebar submit CodyVSCodeExtension:chat:submitted {"source":"chat"}
Chat submit from inline submit CodyVSCodeExtension:chat:submitted {"source":"inline"}
Chat submit from command menu submit CodyVSCodeExtension:chat:submitted {"source":"menu"}
Code generated for chat response CodyVSCodeExtension:chatResponse:noCode {}
Code generated for chat response CodyVSCodeExtension:chatResponse:hasCode {"lineCount":20,"charCount":575}
Fixup code lens button: apply click CodyVSCodeExtension:fixup:codeLens:clicked', { op: apply)
Fixup code lens button: show diff click CodyVSCodeExtension:fixup:codeLens:clicked', { op: diff)
Fixup code lens button: cancel click CodyVSCodeExtension:fixup:codeLens:clicked', { op: cancel)
Fixup token count for code applied applied CodyVSCodeExtension:fixup:applied {"lineCount":20,"charCount":575}
Chat title bar button: new convo click CodyVSCodeExtension:chatTitleButton:clicked {"name":"reset"}
Chat title bar button: history click CodyVSCodeExtension:chatTitleButton:clicked {"name":"history"}
Copy event on code generated for Inline Chat keydown CodyVSCodeExtension:inlineChat:event:detected {"op":"copy","lineCount":5,"charCount":76}
Paste event on code generated for Inline Chat keydown CodyVSCodeExtension:inlineChat:event:detected {"op":"paste","lineCount":5,"charCount":76}
Copy event on code generated for side bar chat triggered by copy button click: click CodyVSCodeExtension:copyButton:clicked {"lineCount":2,"charCount":27,"op":"copy"}
Paste event on code generated for side bar chat triggered by copy button click: keydown CodyVSCodeExtension:pasteButton:clicked {"lineCount":2,"charCount":27,"op":"paste"}
Copy event on code generated for side bar chat, but not triggered by buttons keydown CodyVSCodeExtension:copyKeydown:clicked {"lineCount":2,"charCount":27,"op":"copy"}
Paste event on code generated for side bar chat, but not triggered by buttons keydown CodyVSCodeExtension:pasteKeydown:clicked {"lineCount":2,"charCount":27,"op":"paste"}
Insert code block button click CodyVSCodeExtension:insertButton:clicked {“op”:“insert”,“charCount”:194,“lineCount”:11}
On “Stop Generating” button click in sidebar click CodyVSCodeExtension:abortButton:clicked' { source: 'sidebar' }
On “Stop Generating” button click in Inline Chat click CodyVSCodeExtension:abortButton:clicked' { source: inline }
Code generated for fixup task response CodyVSCodeExtension:fixupResponse:hasCode {"lineCount":12,"charCount":354}
@abeatrix abeatrix mentioned this issue Aug 14, 2023
Closed
@abeatrix abeatrix self-assigned this Aug 14, 2023
@philipp-spiess philipp-spiess mentioned this issue Aug 14, 2023
Merged
philipp-spiess added a commit that referenced this issue Aug 14, 2023
@philipp-spiess
Autocomplete: Log number of accepted chars per suggestion (#674)
52eb072 
Part of #672

Adds tracking for number of inserted characters per completion request.

## Test plan

<img width="1280" alt="Screenshot 2023-08-14 at 16 27 18"
src="https://github.com/sourcegraph/cody/assets/458591/146e7ee0-e221-4400-a757-2fdb078c48f5">


<!-- Required. See
https://docs.sourcegraph.com/dev/background-information/testing_principles.
-->
@abeatrix abeatrix mentioned this issue Aug 14, 2023
Merged
abeatrix added a commit that referenced this issue Aug 14, 2023
@abeatrix
update: log token count for code generated and button click events ac…
690c9c5 
…ross the extension (#675)

RE:
https://docs.google.com/document/d/1UcjUdon1XO5GoLDIJJCGBq1zyhR6VfL2FE_apSPeLQo/edit#heading=h.m8ojuhhojtjm
Close #672

Add loggings for following events

| Description | Type | Example Log Entry |

|----------------------------------------------------------------------------------|------------|-------------------------------------------------------------------------------------------|
| Chat submit from sidebar | submit | CodyVSCodeExtension:chat:submitted
{"source":"chat"} |
| Chat submit from inline | submit | CodyVSCodeExtension:chat:submitted
{"source":"inline"} |
| Chat submit from command menu | submit |
CodyVSCodeExtension:chat:submitted {"source":"menu"} |
| Code generated for chat | response |
CodyVSCodeExtension:chatResponse:noCode {} |
| Code generated for chat | response |
CodyVSCodeExtension:chatResponse:hasCode
{"lineCount":20,"charCount":575} |
| Fixup code lens button: apply | click |
CodyVSCodeExtension:fixup:codeLens:clicked', { op: apply) |
| Fixup code lens button: show diff | click |
CodyVSCodeExtension:fixup:codeLens:clicked', { op: diff) |
| Fixup code lens button: cancel | click |
CodyVSCodeExtension:fixup:codeLens:clicked', { op: cancel) |
| Fixup token count for code applied | applied |
CodyVSCodeExtension:fixup:applied {"lineCount":20,"charCount":575} |
| Chat title bar button: new convo | click |
CodyVSCodeExtension:chatTitleButton:clicked {"name":"reset"} |
| Chat title bar button: history | click |
CodyVSCodeExtension:chatTitleButton:clicked {"name":"history"} |
| Copy event on code generated for Inline Chat | keydown |
CodyVSCodeExtension:inlineChat:event:detected
{"op":"copy","lineCount":5,"charCount":76} |
| Paste event on code generated for Inline Chat | keydown |
CodyVSCodeExtension:inlineChat:event:detected
{"op":"paste","lineCount":5,"charCount":76} |
| Copy event on code generated for side bar chat triggered by copy
button click: | click | CodyVSCodeExtension:copyButton:clicked
{"lineCount":2,"charCount":27,"op":"copy"} |
| Paste event on code generated for side bar chat triggered by copy
button click: | keydown | CodyVSCodeExtension:pasteButton:clicked
{"lineCount":2,"charCount":27,"op":"paste"} |
| Copy event on code generated for side bar chat, but not triggered by
buttons | keydown | CodyVSCodeExtension:copyKeydown:clicked
{"lineCount":2,"charCount":27,"op":"copy"} |
| Paste event on code generated for side bar chat, but not triggered by
buttons | keydown | CodyVSCodeExtension:pasteKeydown:clicked
{"lineCount":2,"charCount":27,"op":"paste"} |
| Insert code block button | click |
CodyVSCodeExtension:insertButton:clicked
{“op”:“insert”,“charCount”:194,“lineCount”:11} |
| On “Stop Generating” button click in sidebar | click |
CodyVSCodeExtension:abortButton:clicked' { source: 'sidebar' } |
| On “Stop Generating” button click in Inline Chat | click |
CodyVSCodeExtension:abortButton:clicked' { source: inline } |
| Code generated for fixup task | response |
CodyVSCodeExtension:fixupResponse:hasCode
{"lineCount":12,"charCount":354} |


`CodyVSCodeExtension:completion:accepted` was added by @philipp-spiess
in #674

`CodyVSCodeExtension:completion:suggested` is not added. Will work on
this in a separated PR

## Test plan

<!-- Required. See
https://docs.sourcegraph.com/dev/background-information/testing_principles.
-->

Added test for token count methods.

To test the newly added token events

Start Cody from this branch in debug mode, and check the Output channel
for logged events after performing an action:


![image](https://github.com/sourcegraph/cody/assets/68532117/f71dc5e9-0217-43bf-be64-1a783dcae5cc)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@abeatrix abeatrix

Labels
clients/vscode
Projects
None yet
Milestone
No milestone
1 participant
@abeatrix