Skip to content

guesslin/mits

Repository files navigation

Build Status Coverage Status GoDoc

MITS

aka Mutual Information Term Segmentation

Formula

MI(x[i], x[i+1]) = p(x[i], x[i+1]) * log(p(x[i], x[i+1]) / (p(x[i]) * p(x[i+1])))

p(x[i]): the probability of x[i] show up in all sentences p(x[i], x[i+1]) : the probability of x[i] and x[i+1] continue show up in all sentences

Author

About

Mutual Information Term Segmentation

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages