Copilot Usage Statistics

[danielnhr28]

Select Topic Area

Question

Body

is there a way to get copilot usage statistics? like how many times copilot has suggested code, how much time user has been using copilot?

thanks.

[RyanLua]

Currently there are no known ways to get GitHub copilot usage statistics from my knowledge and copilot does not record any data of such except for telemetry.

[danielnhr28]

when you mention telemetry what do you mean?

[RyanLua]

GitHub collecting data for analytics and such. Very common practice with most software.

[Akash1134]

Hi @danielnhr28 and @RyanLua ,

Currently, GitHub Copilot for Business shows usage information to organization and enterprise administrators. We plan to provide certain insights as part of a dashboard available to admins soon. The availability of this feature will be rolled out gradually to our customers. Thanks!

[derhenH]

Thank you @Akash1134 for providing the API. However, as a company with dozens of developers, we require analytics to justify paying for this service. It is essential to add a minimum set of data to the API to track the number of code suggestions offered/accepted, interactions with the chat, and actions such as code refactor, explain code, generate tests, both on an individual developer basis and overall over a specified period.

[aghayants]

@Akash1134 do you have any updates on CoPilot Telemetry? How we can request this data, through email of admin tool?

[nick-mylo]

@Akash1134 echoing sentiments of @aghayants here, I'm keen to get some updates on the telemetry front for Copilot. Adding to the mix, I'm aligning with @askpatrickw's point: being an enterprise admin, it's part of my job to ensure that every dollar spent translates into tangible value for the team.

The heart of the matter is that without concrete metrics on usage (like how often copilot suggestions are being accepted or interacted with) broken down by user or even daily trends, it's challenging to paint a clear picture for stakeholders on the ROI of this tool.

Having this data at our disposal isn't just about oversight; it's about understanding how Copilot integrates into our development lifecycle and the efficiency gains we drive. These insights would be pivotal in making a case for the continued investment in the tool at $19 per dev.

appreciate all the efforts thus far and looking forward to those feature releases that can shed light on usage analytics!

[lrichter-ps]

@Akash1134 I'm giving a +1 on the last couple of comments. I'm planning to introduce Copilot to our engineering organization (around 70 developers), and of course, I need to make a good case for spending that money. A nice dashboard with the relevant statistics would be really helpful.

[ozagorodnii]

Yes, we definitely need the possibility to see stats by user for Business accounts. Maybe by a group if user-based stats are not available because of privacy or something.
Otherwise, we cannot gather proper metrics to justify further usage.

[XSchelin]

Posting an update here that I found:

https://docs.github.com/en/enterprise-cloud@latest/early-access/copilot/copilot-usage-api

[zetaab]

For me these stats feels strange. The user count is much lower than what I can see in "github seats" pages used yesterday

[rmilkowski]

The way active users are presented (per day and in breakdowns only) makes it impossible to get total active users for a given period (entire week or all returned data). Also there should be a way to identify the active users and attribute stats to them as well.

[Noor-Hashem77]

Hmm this does not seem to work for me, im getting:

[marcinkawcf]

@Noor-Hashem77 : probalby not enough permision or scope on the token. See here: https://docs.github.com/en/rest/copilot/copilot-usage?apiVersion=2022-11-28

[vagdwd]

https://github.com/github-copilot-resources/copilot-metrics-viewer

[freegor]

hi there,
We need the user's detailed statistic, to get company projects level adoption report, is it will be added?

[wangliguang111]

As a corporate account with many sub-accounts underneath, the company needs to know how everyone is using it and how much it is helping the company, without detailed statistics the company may not keep paying for it

[wangliguang111]

1, the stats for the chat function are not available
2, The statistics of detailed account is not available.
These statistics are really important for the company.
Because
1, it can evaluate whether people are using Copilot or not, and what kind of situation they are using.
2, what is the value to the company.

[wangliguang111]

Our company uses intellij idea. we bought a business account in november 2023, but so far there is no chat function, it's too much, it's not as good as some personal accounts that are suppose to be on the test list.

[riverjang-nsuslab]

Same. Still waiting for the update that would allow analysis of usage per user.

[ryan-vandusen]

In order to help with adoption, and sell the importance of AI tools to leadership, we 100% need some type of reporting to help show the value. The use cases have been mentioned in this thread, so won't go through them, but this seems like a very basic ask. We know it's increasing productivity, engineers say as much, but it would be great to see usability patterns.

[chrisRapsodo]

Second that. We have already started rolling out to a small group of volunteers within the organization and hope to roll it out more extensively. However, some quantitative data goes a long way to convincing leadership for this to happen. Thanks.

[vpareek12]

I am in total agreement with the past comments. In addition to organization wide usage report. I'd also request you to provide some way for the individual to check his own usage report for example, how many lines of code adopted which were suggested by CoPilot, how many suggestions given, codes generated by copilot etc.

[vagdwd]

https://github.com/github-copilot-resources/copilot-metrics-viewer