Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Notebook to compute stats about label bot #71
We need metrics about how many issues were labeled by the label bot and whether they are accurate or not.
The label bot adds a comment to each issue when it adds a label. It also leaves a comment if it can't predict labels with high enough accuracy.
If the label bot is wrong we can detect this by looking to see if someone removed the label applied by the label bot.
We should write some code to compute accuracy of the label bot.
The issue_triage project provides some code that could be a good starting point
We can then iterate over comments and events to look for label bot comments