Skip to content

Various statistics projects exploring how FRC District Ranking Points can be used to measure team performance, and to predict future performance.

Notifications You must be signed in to change notification settings

arimb/DistrictRankings

Repository files navigation

District Points Statistics

Many unintended ways to use the FRC District Points system for statistical analyses and predictions.

ChampsAnalysis

ChampsAnalysis looks at the strengths of the different champs sub-divisions, as well as the best/worse performing regions (i.e. states, districts, and countries). Also looks at the predictive power of using DP to predict Champs performance compared to OPR, CCWM, and EPR. ChiefDelphi post on the topic here. This was one of the first experiments using District Points for more than in-district analysis, and much of what is done here has been re-done more efficiently, accurately, and generally in SingleYearDP, EventPredictor, and MatchPredictor.

EventPredictor

EventPredictor predicts the final qualification ranking of an event before the match schedule has been released. This simulator is less effective than the Ranking Points PreSchdulePredictor, which only takes into account teams' previous probability of earning ranking points. Since the simulator needs a majority of teams' Adjusted District Points, it only works for late/post-season competitions.

The simulator works thusly. Using the pre-constructed match schedules from CheesyArena, the simulator creates a sample match schedule for the event. Then for each match, it finds the difference between the alliances' average Adjusted District Points and calculates a match win probability based on scaling data taken from earlier matches. Once all of the matches have been simulated, the teams are ranked based on how many matches they won. The simulator scrambles the teams, re-assigns teams to the pre-constructed match schedules, repeats the event simulation a pre-defined number of times, and averages the resulting ranks.

MatchPredictor

MatchPredictor predicts the final qualification ranking of an event once the event's match schedule has been released. It works similarly to EventPredictor, but without needing the CheesyArena schedules. In its current form MatchPredictor also needs a majority of teams' Adjusted District Points, so it only works for late/post-season competitions.

OPR_Correlation

ORP_Correlation does exactly what it sounds like: it looks at the correlation between the district points model and the OPR and Qualification Rank models. It found DP/OPR correlations of 52%, 68%, 62%, 61%, 65%, 75%, 68%, 60%, and 66% for each year since 2010, respectively; the average of which is 64%.

PickemLeague

This script was used to evaluate the best choices for the IRI Pickem League competition. It evaluates every combination of teams satisfying the competition requirements to find which has the highest total Adj. District Points score. For the IRI competition with 70 teams, there are ~900 combinations of teams (compared to ~3x10^51 permutations of teams). The program worked decently, but in the future more care needs to be payed to the exact method of scoring, if that differs from the District Points model.

RegionalDistribution

This script evaluated the results of all Regional events, comparing the qualities of teams sent to Championships under the current winners, awards, and wildcard system against a pure district points ranking system. It also explored some unrelated statistics regarding Regionals and Regional-system teams.

SingleYearDP

SingleYearDP calculates the Adjusted District Points for every team in the world over the course of the entire season (excluding week 0 and post-season competitions). This is the source for the rankings that are used in most of the other sections, and for the season-end rankings. Also calculated here are the pre-Championships and pre-DCMP rankings, used for retroactively predicting outcomes for CMP and DCMP without having foreknowledge of the outcomes.

YearlyPredictor

YearlyPredictor takes the calculated Adjusted District Points for all teams in each season since 2011 and combines them into one ranking. This is very useful, as it allows for predictions to be made in early-season competitions where teams haven't yet competed in events this season. It uses an exponentially decreasing weighting system, where the previous year is 63% of the final score, 23% for two years previous, 9% for 3 years, and 5% for the rest of the years, continuing the exponential trend.

About

Various statistics projects exploring how FRC District Ranking Points can be used to measure team performance, and to predict future performance.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published