GitHub - annieyan/language_model: n-gram language models, add-k smoothing, linear interpolation, perplexities

annieyan / language_model Public

Notifications You must be signed in to change notification settings
Fork 1
Star 5

n-gram language models, add-k smoothing, linear interpolation, perplexities

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
README.txt		README.txt
brown.dev.txt		brown.dev.txt
brown.test.txt		brown.test.txt
brown.train.txt		brown.train.txt
yanan_lm.py		yanan_lm.py

Repository files navigation

************************************************
languange models: n-gram with smoothing methods
author : An Yan
date: Jan, 2017
Python version: 2.7
*************************************************

HOW TO RUN:

example:

python yanan_lm.py -t 1 brown.train.txt brown.dev.txt

****************************
parameters: 

-t: unk threshold, default = 1. 
test data set 
dev data set or test data set.

*****************************
Help message, please type


python yanan_lm.py -h

************************************************