Deep Learning in Natural Language Processing

This repo collects the material of Coursat.ai Deep Learning in Natural Language Processing Class.

Rounds:

Round 1:

• June 2020
• 15 Attendees

Capstone Project:

• Medical Report generation of Chest X ray images using MultiCheXNet, article, code

Lectures:

• Lecture 1: Coursat.ai DL NLP Lec 1: Introduction to Deep Learning in NLP

  • Video
  • Basic BoW model for IMDB

• Lecture 2: Text preprocessing pipeline

  • Video
  • Text preprocessing pipeline
  • Text features for BoW model, Count, Freq and TF-IDF

• Lecture 3: Word Embeddings

  • Video
  • Keras Embeddings
  • BoW vectors with Word embeddings
  • Pre-trained word vectors

• Lecture 4: Recommender Systems with DL

  • Video
  • Full Code
  • Simple Recommender System for MovieLens/IMDB
  • How to deal with tabular data using deep learning?
  • Collaborative Filtering for MovieLens
  • Improving the recommendation engine and analysis

• Lecture 5: Sequence models in NLP

  • Video
  • Basics of LSTM with Keras
  • N-gram Statistical Language Models
  • Char level LSTM text generation
  • Word level NLM
  • Char level NLM
  • LSTM-IMDB Keras dataset
  • LSTM-IMDB Raw dataset
  • Conv1D-IMDB Keras dataset
  • Conv1D-IMDB Raw dataset
  • CNN-LSTM-IMDB Keras dataset
  • CNN-LSTM-IMDB Raw dataset

• Lecture 6: Sequence-to-Sequence models in NLP

  • Video
  • Vanilla seq2seq with LSTM in Keras on Neural Machine Translations (NMT)
  • NMT seq2seq + Bahdanau Attention in TensorFlow2
  • NMT seq2seq + Luong Attention in TensorFlow2

• Lecture 7: Transformers in NLP

  • Video
  • NMT with Transformer in TensorFlow 2

• Lecture 8: Transfer Learning in NLP (ULMFiT, GPT-1, GPT-2, GPT-3, BERT, RoBERTa, ALBERT, XLNet)

  • Video part-1
  • Video part-2
  • Fine tuning BERT
  • Interview with GPT-2