The segmentation of articles based on three ways:
-
Word segmentation method based on dictionary
-
Word segmentation method based on statistics (N-gram model)
-
Word segmentation method based on Hidden Markov model
The above three methods all have disadvantages and advantages, This project intends to complement the advantages and disadvantages of these three methods, so as to achieve an effective segmentation method.