Skip to content

Commit

Permalink
Adding UvA-DL notebook "Meta Learning" (#70)
Browse files Browse the repository at this point in the history
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
  • Loading branch information
3 people committed Aug 31, 2021
1 parent 9ed2093 commit 9a8b120
Show file tree
Hide file tree
Showing 8 changed files with 8,219 additions and 0 deletions.
28 changes: 28 additions & 0 deletions course_UvA-DL/meta-learning/.meta.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
title: Meta-Learning - Learning to Learn
author: Phillip Lippe
created: 2021-08-21
updated: 2021-08-21
license: CC BY-SA
tags:
- Few-shot learning
- MAML
- ProtoNet
description: |
In this tutorial, we will discuss algorithms that learn models which can quickly adapt to new classes and/or tasks with few samples.
This area of machine learning is called _Meta-Learning_ aiming at "learning to learn".
Learning from very few examples is a natural task for humans. In contrast to current deep learning models, we need to see only a few examples of a police car or firetruck to recognize them in daily traffic.
This is crucial ability since in real-world application, it is rarely the case that the data stays static and does not change over time.
For example, an object detection system for mobile phones trained on data from 2000 will have troubles detecting today's common mobile phones, and thus, needs to adapt to new data without excessive label effort.
The optimization techniques we have discussed so far struggle with this because they only aim at obtaining a good performance on a test set that had similar data.
However, what if the test set has classes that we do not have in the training set?
Or what if we want to test the model on a completely different task?
We will discuss and implement three common Meta-Learning algorithms for such situations.
This notebook is part of a lecture series on Deep Learning at the University of Amsterdam.
The full list of tutorials can be found at https://uvadlc-notebooks.rtfd.io.
requirements:
- torchvision
- matplotlib
- seaborn
accelerator:
- CPU
- GPU
5,318 changes: 5,318 additions & 0 deletions course_UvA-DL/meta-learning/MAML_algorithm.svg
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
935 changes: 935 additions & 0 deletions course_UvA-DL/meta-learning/MAML_figure.svg
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1,326 changes: 1,326 additions & 0 deletions course_UvA-DL/meta-learning/Meta_Learning.py

Large diffs are not rendered by default.

Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
612 changes: 612 additions & 0 deletions course_UvA-DL/meta-learning/protonet_classification.svg
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 9a8b120

Please sign in to comment.