[ARCHIVED] edX ORA (Open Response Assessor) allows for the peer, instructor, and AI assessment of problems on the edX platform.
Clone or download
Christina Roberts
Christina Roberts Merge pull request #190 from edx/christina/archived
Add archive warning.
Latest commit 9cdf89a Jan 20, 2017
Failed to load latest commit information.
basic_check Adding a unicode test and updating parens Dec 20, 2013
controller Fixed img tags are allowed without filtering of their attributes. Jan 30, 2014
data Generate course data and set intervals, and upload it to S3 for later… Nov 15, 2013
django_cache Add in cache folder May 23, 2013
docs Merge pull request #129 from edx/dev Aug 16, 2013
edx_ora reading course_data_path from env.json Jan 7, 2014
grader_settings Add in additional model exists check before starting ml grading Dec 14, 2012
logs/supervisor Automated starting/stopping of processes using Supervisor Aug 2, 2013
metrics Generate course data and set intervals, and upload it to S3 for later… Nov 15, 2013
ml_grading Merge pull request #144 from edx/fix/vik/pg-limit Dec 23, 2013
ml_models Fix staff notification for grading Aug 29, 2013
nltk_data Check in nltk data May 25, 2013
peer_grading merge release back into master Feb 21, 2014
staff_grading Merge pull request #144 from edx/fix/vik/pg-limit Dec 23, 2013
static Correct rendering of bars, with new highlighting to show correct values Jan 28, 2013
templates Add in error templates Sep 13, 2013
tests fix typo: refelecting your vies - reflecting your views Aug 9, 2013
.coveragerc Add in preferred grading type May 15, 2013
.gitignore Generate course data and set intervals, and upload it to S3 for later… Nov 15, 2013
.travis.yml Rename cache keys Sep 6, 2013
AUTHORS Adding authors based on latest set of pull requests. Feb 3, 2014
LICENSE.txt clarify LICENSE Jul 10, 2013
README.rst Add archive warning. Jan 19, 2017
apt-packages.txt Start to move manage.py commands over to celery tasks May 22, 2013
base_requirements.txt Increment MySQL python library to fix Travis build Feb 20, 2014
edx-ora-celery.conf Change grading-controller to edx-ora May 23, 2013
edx-ora.conf Add in conf file for deployment May 23, 2013
install_system_req.sh Fix some cleaner stuff Jan 30, 2013
manage.py Change grading-controller to edx-ora May 23, 2013
openedx.yaml Change "obsolete" to "archived". Jan 18, 2017
pre-requirements.txt Version numbers for requirements Mar 12, 2013
project_urls.py Strip out notificationsseen Aug 6, 2013
requirements.txt matplotlib 1.2.1 can no longer be downloaded from PyPI. Mar 24, 2014
requirements_osx_10_8.txt update to newer version of scipy and matplotlib that don't break on M… Aug 9, 2013
run_tests.sh Change grading-controller to edx-ora May 23, 2013
setup_controller.sh Add in license, and update readme May 24, 2013
supervisor.conf simplify even more! Aug 2, 2013
test_util.py Make minimum to use AI and minimum to use peer user-configurable Nov 15, 2013


[ARCHIVED] edx ORA (Open Response Assessor)

The ORA will take a submission from an xqueue installation, pass it through machine learning grading, peer grading, and staff grading as appropriate, and return a result to LMS. This is to be used with the edx-platform and xqueue. It allows for the assessment of open response problems on the edx platform.


This repository has been archived and is no longer supported—use it at your own risk. This repository may depend on out-of-date libraries with security issues, and security updates will not be provided. Pull requests against this repository will also not be merged.

The edX team has officially transitioned all support for the Open Response Assessor (ORA) project to its second iteration (ORA2).

To get started using ORA2, update to the latest version of the edX platform. To learn how to author new ORA2 problems, see the latest course authoring documentation.



Each type of grader is a separate django application, with the controller having common logic, such as submission and returning the result to the LMS.

After installation, tests can be run by running sh run_tests.sh .


You can find full documentation in the docs directory, and build it using make html, or see here for built documentation.


The code in this repository is licensed under version 3 of the AGPL unless otherwise noted.

Please see LICENSE.txt for details.

How to Contribute

Contributions are very welcome. The easiest way is to fork this repo, and then make a pull request from your fork. The first time you make a pull request, you may be asked to sign a Contributor Agreement.

Reporting Security Issues

Please do not report security issues in public. Please email security@edx.org

Mailing List and IRC Channel

You can discuss this code on the edx-code Google Group or in the edx-code IRC channel on Freenode.