Skip to content


Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time

Classifying MOOC Discussion Forums

The edxclassify package contains a classification suite built to detect learner affect and behavior in the discussion forums of Massive Open Online Courses (MOOCs). It is the result of a year's worth of research at Stanford and was designed to enable the discovery of insights into forums attached to Stanford's online course offerings.

Research and Motivation

Our motivation to discover insights into the dynamics of these courses is three-fold. In particular, we wish to:

  1. better understand the educational and learning process,
  2. improve the educational environment for MOOC learners, and
  3. empower instructors by equipping them with a suite of tools designed to ease the burden of teaching large-scale classes.

For example, we could use a classifier that detects confusion in forum posts to help us target automated learning interventions in courses. We have built such a prototype; to learn more, please refer to our paper, published in the eighth conference on Educational Data Mining.

Included Classifiers

The abstractions in edxclassify are general enough to be applicable to most classification tasks. The repository does come packaged with a set of classifiers that were trained to detect affect in Stanford's MOOC discussion forums. Since Stanford's courses are powered by edX, these classifiers should be compatible with any edX MOOC; they should also be compatible with other flavors of MOOCs, as their feature space is not tightly coupled with the particulars of edX.

These classifiers were trained on subsets of the Stanford MOOC-Posts Dataset, a collection of 30,000 human-tagged forum posts, originating from a variety of courses. Classifiers to detect all six of the core variables in the MOOC-Posts Dataset -- confusion, urgency, sentiment, question, answer, and opinion -- are included in this repository. The class edxclassify.live_clf.LiveCLF provides an interface to them; see the module edxclassify.live_clf for further documentation.

Running Experiments

edxclassify.harness is a driver that facilitates the training and testing of and experimentation with classifiers. After installation, it can be invoked with the command clfharness.


The MOOC-Posts Dataset is available to researchers, upon request.

Much of the included code in edxclassify was designed for data formatted as per edxclassify.feature_spec; in particular, the harness takes data files each containing a pickled list of examples, each example a list with features in the positions specified in edxclassify.feature_spec. If you would like access to these data files, first request access to the MOOC-Posts Dataset. When your request is approved, send an email to akshayka ~at~ with subject line "edxclassify: request for data files".


Installation can proceed in two ways: from source or from pip. Note that when installing from pip, only a subset of the pre-trained classifiers found in this repository will be included, due to size constraints imposed by pypi. In particular, the pypi version only includes classifiers for confusion trained on technical and non-technical courses, whereas the source version includes classifiers for all six MOOC-Posts variables.

Regardless of whether you install from source or from pip, begin by installing scikit-learn and its dependencies; make sure to install version 0.15.2 to ensure compatibility with skll.

If installing from source, clone this repository and simply run python install. Otherwise, run pip install edxclassify.


A machine learning pipeline for classifying MOOC discussion forums.







No releases published


No packages published