Text Analysis

The repository contains Text analysis machine learning compition.

Use Case

1. Next word Prediction
2. Sentiment Analysis - Analying social media influencer
3. Classification
4. Topic Modeling - Identify topic category of the text
5. Langunage Translation
6. Visualization

Pre-Processing

1. Case standardization
2. Tokenization - character, word, n-gram, sentences
3. Removing Stopwords
4. Stemming & Lemming
5. Word Embeding 5.1) Skip gram 5.2) CBOW 5.3) GloVE 5.4) FastText
6. Postional Encoding

Traditional Methods

1. Bag of Words
2. TF IDF
3. Machine learning based - Naive Bayes, Logistic Regression

Deep learning models

1. RNN
2. GRU
3. LSTM
4. Bi-Directional LSTM
5. Attention
6. Transformer 5.1) Bert 5.2) GPT

Dictonary based sentiments

AFIN, BING

Topic Discovery

Latent Drichlet Analysis - Discovering Topics Latent Sementic Analysis - Discovering Document

Source

Tidy Text Hands on ML Github Mam