8. Resources

Packages

Simple transformers

https://github.com/ThilinaRajapakse/simpletransformers

Articles

Transformers by HuggingFace

https://github.com/huggingface/transformers

Tokenizers by HuggingFace

https://github.com/huggingface/tokenizers

All Models and Checkpoints by HuggingFace

https://huggingface.co/models

List of Common Misspellings for Machines

https://en.wikipedia.org/wiki/Wikipedia:Lists_of_common_misspellings/For_machines

Transformer: A Novel Neural Network Architecture for Language Understanding

https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html

A Commit History of Bert

https://amitness.com/2020/05/git-log-of-bert/

BERT Classifier: Just Another Pytorch Model

https://towardsdatascience.com/bert-classifier-just-another-pytorch-model-881b3cf05784

What Is XLNet And How Does It Work?

https://blog.essen.ai/what-is-xlnet-and-how-does-it-work/

Question Answering with BERT, XLNET, XLM, and DistilBERT using Simple Transformers

https://towardsdatascience.com/question-answering-with-bert-xlnet-xlm-and-distilbert-using-simple-transformers-4d8785ee762a

Videos

Text Extraction From a Corpus Using BERT (AKA Question Answering)

https://www.youtube.com/watch?v=XaQ0CBlQ4cY

NLP for Developers: Transformers | Rasa

https://www.youtube.com/watch?v=KN3ZL65Dze0

Applying BERT to Question Answering (SQuAD v1.1)

https://www.youtube.com/watch?v=l8ZYCvgGu0o&t=4s

Related Notebooks

Twitter sentiment Extaction-Analysis,EDA and Model

https://www.kaggle.com/tanulsingh077/twitter-sentiment-extaction-analysis-eda-and-model

Twitter sentiment Extraction: EDA,and modeling

https://www.kaggle.com/sofieneressifi/twitter-sentiment-extraction-eda-and-modeling

Pretrain with another twitter dataset

https://www.kaggle.com/jihunlorenzopark/pretrain-with-another-twitter-dataset

Twitter Challenge: roBERTa sentiment predictor

https://www.kaggle.com/tarunpaparaju/twitter-challenge-roberta-sentiment-predictor

Twitter Sentiment Analysis

https://www.kaggle.com/paoloripamonti/twitter-sentiment-analysis

Twitter categorization

https://www.kaggle.com/alosat/twitter-categorization/comments#734695

XLNet Sentiment Analysis for Amazon Reviews

https://github.com/kcmankar/pytorch-sentiment-analysis-using-XLNet/blob/master/xlnet_sentiment_analysis.ipynb

ALBERT😛 [Train + Infer]

https://www.kaggle.com/vaishvik25/albert-train-infer

TensorFlow roBERTa Starter

https://www.kaggle.com/cdeotte/tensorflow-roberta-0-705

Bonus

A great search engine for not finding information

http://www.yahoo.com