Skip to content
Online Max-Margin Topic Models for Accurate and Fast Text Classification [release v0.1]
Jupyter Notebook C++ Python C Makefile MATLAB CMake
Branch: master
Clone or download

Latest commit

Fetching latest commit…
Cannot retrieve the latest commit at this time.


Type Name Latest commit message Commit time
Failed to load latest commit information.


This repository contains code for the following paper:

Specifically, the code is a streaming implementation of MedLDA

What is MedLDA ?

Maximum Entropy Discriminant LDA (MedLDA) is a max-margin supervised topic model. It jointly trains Latent Dirichlet Allocation (LDA) with SVM, and obtains a topic representation more suitable for discriminative tasks such as classification.

What is BayesPA ?

Online Bayesian PA (BayesPA) is a generalization of classic Passive-Aggressive learning to the Bayesian and latent-variable setting. For every incoming mini-batch of documents, BayesPA first applies Bayes' rule to update the LDA topic model, then projects the posterior distribution to a region where the hinge-loss on the mini-batch data is minimized.

How to Use

The python interface of Online MedLDA is simple.

To use, simply

import medlda

To create a classifer with 2 labels and 61188 words,

pamedlda = medlda.OnlineGibbsMedLDA(num_topic = 5, labels = 2, words = 61188)

The training and inference are also straightfoward,

pamedlda.train_with_gml('../data/binary_train.gml', batchsize=64)
(pred, ind, acc) = pamedlda.infer_with_gml('../data/binary_test.gml', num_sample=100)

Please refer to docs for more detals.

Installing Online MedLDA

This release is for early adopters of this premature software. Please let us know if you have comments or suggestions. Contact: tianlinshi [AT]

Online MedLDA is written in C++ 11, with a friendly python interface. It depends on gcc >= 4.8, python (numpy >= 1.7.0, distutils) and boost::python. To install, follow the instructions below.

Dependencies (Ubuntu)

# system dependency
sudo apt-get install libboost-all-dev gcc-4.8
sudo apt-get install python-numpy

Dependencies (OS X, Homebrew)

brew install gcc
brew install boost --cc=gcc-4.9
brew install boost-python --cc=gcc-4.9
pip install numpy scipy


sudo python install


If you use online MedLDA in your work, please cite

Shi, T., & Zhu, J. (2014). Online Bayesian Passive-Aggressive Learning. In Proceedings of The 31st International Conference on Machine Learning (pp. 378-386).

License (GPL V3)

Copyright (C) 2014 Tianlin Shi

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributeCd in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see

You can’t perform that action at this time.