-
Notifications
You must be signed in to change notification settings - Fork 74
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Adding UvA-DL notebook "Meta Learning" (#70)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
- Loading branch information
1 parent
9ed2093
commit 9a8b120
Showing
8 changed files
with
8,219 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
title: Meta-Learning - Learning to Learn | ||
author: Phillip Lippe | ||
created: 2021-08-21 | ||
updated: 2021-08-21 | ||
license: CC BY-SA | ||
tags: | ||
- Few-shot learning | ||
- MAML | ||
- ProtoNet | ||
description: | | ||
In this tutorial, we will discuss algorithms that learn models which can quickly adapt to new classes and/or tasks with few samples. | ||
This area of machine learning is called _Meta-Learning_ aiming at "learning to learn". | ||
Learning from very few examples is a natural task for humans. In contrast to current deep learning models, we need to see only a few examples of a police car or firetruck to recognize them in daily traffic. | ||
This is crucial ability since in real-world application, it is rarely the case that the data stays static and does not change over time. | ||
For example, an object detection system for mobile phones trained on data from 2000 will have troubles detecting today's common mobile phones, and thus, needs to adapt to new data without excessive label effort. | ||
The optimization techniques we have discussed so far struggle with this because they only aim at obtaining a good performance on a test set that had similar data. | ||
However, what if the test set has classes that we do not have in the training set? | ||
Or what if we want to test the model on a completely different task? | ||
We will discuss and implement three common Meta-Learning algorithms for such situations. | ||
This notebook is part of a lecture series on Deep Learning at the University of Amsterdam. | ||
The full list of tutorials can be found at https://uvadlc-notebooks.rtfd.io. | ||
requirements: | ||
- torchvision | ||
- matplotlib | ||
- seaborn | ||
accelerator: | ||
- CPU | ||
- GPU |
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Large diffs are not rendered by default.
Oops, something went wrong.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
612 changes: 612 additions & 0 deletions
612
course_UvA-DL/meta-learning/protonet_classification.svg
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.