Skip to content

0oTedo0/NLP-Beginner

Repository files navigation

NLP-Beginner

Exercises of Natural Language Process.

Acknowledgements

神经网络与深度学习

Task 1: Text categorization based on Softmax Regression

Language: Python

Tool: numpy

Feature extraction: Bag-of-word, N-gram

Data: Classify the sentiment of sentences from the Rotten Tomatoes dataset

Goal: Implement Softmax Regression to categorize different text into different sentiment.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 2: Text categorization based on RNN & CNN

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding, GloVe word embedding

Data: Classify the sentiment of sentences from the Rotten Tomatoes dataset

Goal: Implement Recursive Neural Network (RNN) and Convolution Neural Network (CNN) to categorize different text into different sentiment.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 3: Text matching based on attention

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding, GloVe word embedding

Data: The Stanford Natural Language Inference (SNLI)

Reference:Enhanced LSTM for Natural Language Inference

Goal: Implement ESIM mentioned in the reference above.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 4: Sequence Labeling based on LSTM+CRF

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding, GloVe word embedding

Data: CONLL 2003

Data Introduction: CONLL 2003

Reference:Neural Architectures for Named Entity Recognition

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

Goal: Sequence Labeling of CONLL 2003.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 5: Language Model based on Neural Network

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding

Data: poetryFromTang.txt

Reference:《神经网络与深度学习 chapter 6, 15

Goal: Generating poems.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

About

Exercises of Natural Language Process.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages