Skip to content

catalyst-team/dl-course

Repository files navigation

Deep Learning with Catalyst Stepik Slack

dls-catalyst-course

This is an open deep learning course made by Deep Learning School, Tinkoff, and Catalyst team. Lectures and practice notebooks located in ./week* folders. Homeworks are in ./homework* folders.

Note: the course is under update: weeks with colab barge are ready to go, weeks with [WIP] label are still in progress. You could use the v20.12 branch for the earlier version of the full course.

Syllabus

  • Open In Colab week 1: Deep learning intro
    • Deep learning – introduction, backpropagation algorithm. Optimization methods.
    • Neural Network in numpy.
  • Open In Colab week 2: Deep learning frameworks
    • Regularization methods and deep learning frameworks.
    • Pytorch basics & extras.
  • Open In Colab week 3: Convolutional Neural Network
    • CNN. Model Zoo.
    • Convolutional kernels. ResNet. Simple Noise Attack.
  • Open In Colab week 4: Object Detection, Image Segmentation
    • Object Detection. (One, Two)-Stage methods. Anchors.
    • Image Segmentation. Up-scaling. FCN, U-net, FPN. DeepMask.
  • Open In Colab week 5: Metric Learning
    • Metric Learning. Contrastive and Triplet Loss. Samplers.
    • Cross Entropy Loss modifications. SphereFace, CosFace, ArcFace.
  • Open In Colab week 6: Autoencoders
    • AutoEncoders. Denoise, Sparse, Variational.
    • Generative Models. Autoregressive models.
  • Open In Colab week 7: Generative Adversarial Models
    • Generative Adversarial Networks. VAE-GAN. AAE.
    • Energy based model.
  • Open In Colab week 8: Natural Language Processing
    • Embeddings.
    • RNN. LSTM, GRU.
  • Open In Colab week 9: Attention and transformer model
    • Attention Mechanism.
    • Transformer Model.
  • Open In Colab week 10: Transfer Learning in NLP
    • Pretrained Transformers. BERT. GPT.
    • Data Augmentation in Texts. Domain Adaptation.
  • Open In Colab week 11: Recommender Systems
    • Collaborative Filtering. FunkSVD.
    • Neural Collaborative Filtering.
  • week 12: Reinforcement Learning for RecSys
    • Open In Colab DQN Algorithm.
    • Open In Colab DDPG Algorithm.
    • Open In Colab RecSim with Wolpertinger.
  • [WIP] week 13: Extras
    • Research & Deploy.
    • Config API. Reaction.

Environment

Anaconda setup

# setup - env
conda create -n catalyst-dl python=3.7 anaconda
source activate catalyst-dl
conda remove nb_conda_kernels -y
conda install -c conda-forge nb_conda_kernels -y
conda install notebook jupyter nb_conda -y
conda remove nbpresent -y

# setup - jupyter
jupyter notebook password

# jupyter run
jupyter notebook --no-browser --ip 0.0.0.0 --port 8888

Requirements

pip install -U catalyst==21.04.2 torch==1.8.0 albumentations==0.5.0

Course staff & contributors

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •