Graderutils

Python library that handles grader test suite management, file validation and test feedback formatting. Originally developed to enable HTML feedback for programming exercise grading output for courses served on the A+ platform. The A+ platform is not required to run graderutils.

Features

• Running unittest.TestCase tests and producing generic JSON results that may be converted into HTML.
• Validation tasks before running tests.
• Restricting allowed Python syntax using black- and whitelists of AST node names.
• Formatting tracebacks and exception messages to include only essential information (by default the full, unformatted traceback is also available).

Results from examples/01_simple rendered with the default theme:

Quickstart

Install

git clone --depth 1 https://github.com/Aalto-LeTech/python-grader-utils.git
cd python-grader-utils
pip install .

Examples

• 01_simple, minimal exercise
• 02_property_based_testing, grader tests with random input data generation
• 03_template_extension, if you want to extend or replace the current feedback template
• 04_embedded_plot, embedding JavaScript into the feedback template
• 05_string_similarity_highlight, extending the feedback template by adding character similarity highlighting when comparing two strings

Using graderutils_format without graderutils

Any JSON strings that validate successfully against the "Grading feedback" JSON schema can be converted to human readable form using graderutils_format.

E.g.

cat results.json | python3 -m graderutils_format.html > results.html

Outline of the grading feedback JSON contents: