Pytorch implementation of DeepLearning models

This repository features various deep learning models implemented in PyTorch, both from scratch and with built-in modules. Each model is in a separate file for easy understanding and modification. It serves as a learning resource and reference for developing deep learning models with PyTorch.

Models

• Basics of tensors
  • Tensors Initialization
  • Tensors Operations
  • Tensors Indexing
  • Tensors Broadcasting
• Simple DNN model
  • Linear Regression
  • Logistic Regression
  • Multi Layer Perceptron
• Convolutional Neural Network - Image Classification
  • LeNet
  • AlexNet
  • VGG
  • NiN
  • GoogLeNet
  • ResNet
  • EefficientNet
  • Transfer Learning and Fine-tuning
• Recurrent Neural Network - Sentiment Analysis
  • RNN from scratch
  • RNN using Pytorch
  • Deep RNN
  • Optimized Training RNN
  • Optimized Training LSTM
  • GRU
• Sequence to Sequence - Machine Translation
  • Simple Seq2Seq
  • Learning Phrase Representations
  • NMT Jointly Learning to Align and Translate
• Transformer - Using pre-trained models
  • Introduction to HuggingFace Transformers
  • Inside of the HuggingFace pipeline API
  • Tokenizers in HuggingFace Transformers
  • Embeddings in Transformers
  • Fine-tuning HuggingFace Transformers
  • Fine-tuning HuggingFace Transformers using Trainer API
  • Exploring Datasets API
• Dataset Creation
  • Custom Image Dataset in pytorch
  • Custom text Dataset in pytorch
  • Transformers datasets in pytorch
• Techniques
  • Learning Rate finder
  • Early Stopping
  • Model Checkpointing
  • Gradient Clipping
  • Weight Initialization
  • Dropout Regularization
  • Batch Normalization
  • Data Augmentation
  • Transfer Learning
  • Fine-tuning
• Others
  • Saving and Loading saved models
  • Visualizing the model using tensorboard

Installation

pip install -r requirements.txt

Usage

python <model_name>.py

References

• Dive into Deep Learning
• Pytorch Documentation
• Coursera Deep Learning Specialization
• Deep Learning Book
• Stanford CS231n