Word Probability Prediction

Models

• Statistical models: N-Gram Language model w/o Kneser–Ney smoothing
• Sequential models: RNN, LSTM and GRU
• Self-attention models: GPT

Datasets:

• Chinese Wikipedia
• Chinese subtitles
• Sina Weibo (A Chinese social media platform)

Evaluation:

• Perform word probability prediction on 100 test sentences