Skip to content

Correlation Results

Kayla Nussbaum edited this page Apr 6, 2016 · 1 revision

This past week I have worked on modifying and updating the dev_analysis.rb file to reflect our new metric: vuln_misses. Vuln_misses also has a few other variables that are measured in time and whether they were fixed or owned. To do so, I added a few more Spearman correlations on our betweenness, degree, closeness, and sheriff hours metrics with the new vuln_misses metrics. After running the rake run:dev or analyzing the nightly build, here are the results:

Correlation Results

Correlations have been found to be strong with betweenness, degree, and closeness. This challenges what we have been researching where we have now found that being more central will yield a higher count of vulnerability misses. For Spearman Correlation Coefficients, the closer to 1/-1 means that they are strongly correlated whereas anything below 5 means there is little to no correlation at all. My next steps will be to address perc_vuln_misses (percentage of vulnerabilities missed) to actually see missed vulnerabilities per developer, per period --> vuln_misses/participation.

After this, we should include vuln_misses in our code reviews table by count and by boolean. Be careful not to double count the same vulnerability twice (use distinct). This allows us to look at other metrics in the given code review.