Clarification on GitHub Copilot Metrics Calculation

[mamse]

Select Topic Area

Question

Body

Hello GitHub Support,

I'm using the https://api.github.com/orgs/ORG/copilot/metrics endpoint for my company and would like more details on how specific metrics are calculated. The API documentation does not provide insights into the methodology behind these metrics. Could you clarify how GitHub determines values for the following?

total_engaged_users
total_code_suggestions
total_code_acceptances
total_code_lines_suggested
total_code_lines_accepted
Understanding the calculation methodology will help us better interpret the data and measure Copilot's impact within our organization. Is there official documentation or guidance available on this? If possible i would like to have information on all the fields from the response of this endpoint.

Thanks in advance for your support!

[ebndev]

Hi @mamse, thanks for being a part of the GitHub Community!

In the documentation under Get Copilot metrics for an organization, you can view the Response Schema for descriptions of all of the properties in the response. Is this helpful or were you looking for something more?

[migmartins16]

Thanks but that is still very vague for example this fields:

total_code_lines_accepted

The description states:
"The number of lines of code accepted from Copilot code suggestions for the given editor, for the given language."
How exactly are these lines counted?
If I use Cmd + C and Cmd + V to copy a Copilot suggestion, does that count?
Or does it only count when using the acceptance button (shown below)?

total_code_acceptances

The description states:
"The number of Copilot code suggestions accepted for the given editor, for the given language. Includes both full and partial acceptances."
What qualifies as a partial acceptance?
Some of these definitions feel a bit vague

[github-actions[bot]]

🕒 Discussion Activity Reminder 🕒

This Discussion has been labeled as dormant by an automated system for having no activity in the last 60 days. Please consider one the following actions:

1️⃣ Close as Out of Date: If the topic is no longer relevant, close the Discussion as out of date at the bottom of the page.

2️⃣ Provide More Information: Share additional details or context — or let the community know if you've found a solution on your own.

3️⃣ Mark a Reply as Answer: If your question has been answered by a reply, mark the most helpful reply as the solution.

Note: This dormant notification will only apply to Discussions with the Question label. To learn more, see our recent announcement.

Thank you for helping bring this Discussion to a resolution! 💬