LM, ULMFit et al.
Switch branches/tags
Nothing to show
Clone or download
Latest commit 75fe79e Sep 28, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
fastai fixed link Sep 28, 2018
images fixe link Sep 28, 2018
README.md fixe link Sep 28, 2018
ULMfit.py fixe link Sep 28, 2018
char-RNN.py fixe link Sep 28, 2018
charSeqRNN (Pytorch).py fixe link Sep 28, 2018
ulmfit.ipynb fixe link Sep 28, 2018

README.md

Language Modelling

Transfer Learning in Langage Modelling (Classification)

Implementation of Universal Language Model Fine-tuning for Text Classification (Fast.ai)

I've written a detailed blog on how ULMFit works and what problems are being solved on Intel IDZ, link here

Dataset

  • Imdb
$ python UMLift.py

There are some other dependencies and downloads of files which are to be taken care of while running this, see the file for more info

Requirements:

  • Pytorch
  • Numpy
  • Python 3.x
  • Fast.ai lib

Acquire the Repo

$ git clone https://github.com/prajjwal1/language-modelling

Architecture of ULMFit (builds on AWD-LSTM)

Regularizing and optimizing LSTM Language Models (https://arxiv.org/abs/1708.02182)

arch

Results

res

Validation error rate (from the paper) ver

Contributions

Contributions are always welcome in the form of pull requests with explanatory comments.