Various data retrieval scripts to import, clean, and save FRC data to csv files
All data is written to files in the data folder.
Use pip install -r requirements.txt to install all required packages for this
project.
In order to use the APIs these scripts access, you'll need to obtain
authorization keys. You can get a TBA key
here. Additionally, TeamInfo.py uses
google's geocoder API to get geographic coordinates for each team. Learn more
about the geocoding API and get a key
here.
Once you have authorization keys, add them to a keys.json file in the project
root as TBA_API_KEY and GOOGLE_API_KEY respectively.
Once the data is saved to csv files, it can be analyzed with a number of tools. It's simple to open in excel, but I've also used R, Tableau, TIBCO Spotfire, and python scripts to allow deeper insights into databases of this size. I encourage you to conduct your own exploratory data analysis and publish your findings!
I've worked pretty hard to ensure that these scripts are as general and future-proof as possible, but since I don't control the APIs or databases I'm using, there's always the possibility that a change in the future could break these. If you're encountering errors, please feel free to create an issue or PR. In particular, the MatchData script does a lot of preprocessing of the data from The Blue Alliance, and as a result it needs to be updated on a yearly basis. Unfortunately, FIRST releases its API spec as late as week 1 competitions sometimes, so I'm unable to update them until then.