Simple library for interactive autograding.
Previous names include gradememaybe and okgrade.
See the Gofer Grader documentation for more information.
This library can be used to autograde Jupyter Notebooks and Python files.
Instructors can write tests in a subset of the okpy test format (other formats coming soon), and students can dynamically check if their code is correct or not. These notebooks / .py files can later be collected and a grade assigned to them automatically.
As an effort to help autograding with Berkeley's offering of Data 8 online, Gofer also works with two other components that could be useful for other courses. courses. The primary one, Gofer service, is a tornado service that receives notebook submissions and runs/grades them in docker containers. The second piece, Gofer submit is a Jupyter notebook extension that submits the current notebook to the service. Though they could be modified to work on your own setup, these are meant to play particularly nicely with Jupyterhub.
okpy is used at Berkeley for a number of large classes (CS61A, data8, etc). It has a lot of features that are very useful for large and diverse classes. However, this comes with a complexity cost for instructors who only need a subset of these features and sysadmins operating an okpy server installation.
This project is tightly scoped to only do automatic grading, and nothing else.
Gofer executes arbitrary user code within the testing environment, rather than parsing standard out. While there are certain measures implemented to make it more difficult for users to maliciously modify the tests, it is not 100% possible to secure against these attacks since Python exposes all the objects.
Lots of credit to the amazing teams that have worked on okpy over the years.