GitHub - fannix/Bayeseg: Doing segmentation with Bayesian methods.

fannix / Bayeseg Public

Notifications You must be signed in to change notification settings
Fork 0
Star 6

Doing segmentation with Bayesian methods.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
README		README
crp.py		crp.py
setup.py		setup.py
unigram.py		unigram.py
unigram.pyx		unigram.pyx
unigram_main.py		unigram_main.py
unseg_chinese		unseg_chinese

Repository files navigation

Bayesian unsupervised segmentation.

BUilding Command:
python2 setup.py build_ext --inplace

Running Command:
./unigram_main.py infile


Performance when given a Chinese text:
Python version: 348s
Cython version: 107s

References:

Bayesian with tears, Kevin Knight.