Skip to content

Commit

Permalink
differences for PR #444
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Feb 18, 2024
1 parent 2750fa5 commit 46b17ad
Show file tree
Hide file tree
Showing 8 changed files with 91 additions and 91 deletions.
50 changes: 25 additions & 25 deletions 1-introduction.md
Original file line number Diff line number Diff line change
@@ -1,30 +1,30 @@
---
title: 'Introduction'
teaching: 40
exercises: 15
teaching: 50
exercises: 30
---

:::::::::::::::::::::::::::::::::::::: questions

- "What is Deep Learning?"
- "When does it make sense to use and not use Deep Learning?"
- "When is it successful?"
- "What are the tools involved?"
- "What is the workflow for Deep Learning?"
- "Why did we choose to use Keras in this lesson?"
- "How do neural networks learn?"
- What is Deep Learning?
- When does it make sense to use and not use Deep Learning?
- When is it successful?
- What are the tools involved?
- What is the workflow for Deep Learning?
- Why did we choose to use Keras in this lesson?
- How do neural networks learn?

::::::::::::::::::::::::::::::::::::::::::::::::

:::::::::::::::::::::::::::::::::::::: objectives

- "Recall the sort of problems for which Deep Learning is a useful tool"
- "List some of the available tools for Deep Learning"
- "Recall the steps of a Deep Learning workflow"
- "Identify the inputs and outputs of a deep neural network."
- "Explain the operations performed in a single neuron"
- "Test that you have correctly installed the Keras, Seaborn and Sklearn libraries"
- "Describe what a loss function is"
- Recall the sort of problems for which Deep Learning is a useful tool
- List some of the available tools for Deep Learning
- Recall the steps of a Deep Learning workflow
- Identify the inputs and outputs of a deep neural network.
- Explain the operations performed in a single neuron
- Test that you have correctly installed the Keras, Seaborn and Sklearn libraries
- Describe what a loss function is

::::::::::::::::::::::::::::::::::::::::::::::::

Expand Down Expand Up @@ -217,7 +217,7 @@ A more complicated and less used loss function for regression is the [Huber loss
Below you see the Huber loss (green, delta = 1) and Squared error loss (blue)
as a function of `y_true - y_pred`.

![](fig/01_huber_loss.png){alt='Line plot comparing squared error loss function with the Huber loss function where delta = 1, showing the cost of prediction error of both functions equal where y_true - y_pred is between -1 and 1, then rising linearly with the Huber loss function as y_true diverges further from y_pred, as opposed to expontentially for the squared error function.',' width='400px'}
![](fig/01_huber_loss.png){alt='Line plot comparing squared error loss function with the Huber loss function where delta = 1, showing the cost of prediction error of both functions equal where y_true - y_pred is between -1 and 1, then rising linearly with the Huber loss function as y_true diverges further from y_pred, as opposed to expontentially for the squared error function.' width='400px'}

Which loss function is more sensitive to outliers?

Expand Down Expand Up @@ -461,13 +461,13 @@ You should get a version number reported. At the time of writing 1.2.2 is the la

:::::::::::::::::::::::::::::::::::::: keypoints

- "Machine learning is the process where computers learn to recognise patterns of data."
- "Artificial neural networks are a machine learning technique based on a model inspired by groups of neurons in the brain."
- "Artificial neural networks can be trained on example data."
- "Deep Learning is a machine learning technique based on using many artificial neurons arranged in layers."
- "Neural networks learn by minimizing a loss function."
- "Deep Learning is well suited to classification and prediction problems such as image recognition."
- "To use Deep Learning effectively we need to go through a workflow of: defining the problem, identifying inputs and outputs, preparing data, choosing the type of network, choosing a loss function, training the model, refine the model, measuring performance before we can classify data."
- "Keras is a Deep Learning library that is easier to use than many of the alternatives such as TensorFlow and PyTorch."
- Machine learning is the process where computers learn to recognise patterns of data.
- Artificial neural networks are a machine learning technique based on a model inspired by groups of neurons in the brain.
- Artificial neural networks can be trained on example data.
- Deep Learning is a machine learning technique based on using many artificial neurons arranged in layers.
- Neural networks learn by minimizing a loss function.
- Deep Learning is well suited to classification and prediction problems such as image recognition.
- To use Deep Learning effectively we need to go through a workflow of: defining the problem, identifying inputs and outputs, preparing data, choosing the type of network, choosing a loss function, training the model, refine the model, measuring performance before we can classify data.
- Keras is a Deep Learning library that is easier to use than many of the alternatives such as TensorFlow and PyTorch.

::::::::::::::::::::::::::::::::::::::::::::::::
26 changes: 13 additions & 13 deletions 2-keras.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,22 +5,22 @@ exercises: 50
---

::: questions
- "What is a neural network?"
- "How do I compose a Neural Network using Keras?"
- "How do I train this network on a dataset?"
- "How do I get insight into learning process?"
- "How do I measure the performance of the network?"
- What is a neural network?
- How do I compose a Neural Network using Keras?
- How do I train this network on a dataset?
- How do I get insight into learning process?
- How do I measure the performance of the network?
:::

::: objectives
- "Use the deep learning workflow to structure the notebook"
- "Explore the dataset using pandas and seaborn"
- "Use one-hot encoding to prepare data for classification in Keras"
- "Describe a fully connected layer"
- "Implement a fully connected layer with Keras"
- "Use Keras to train a small fully connected network on prepared data"
- "Interpret the loss curve of the training process"
- "Use a confusion matrix to measure the trained networks' performance on a test set"
- Use the deep learning workflow to structure the notebook
- Explore the dataset using pandas and seaborn
- Use one-hot encoding to prepare data for classification in Keras
- Describe a fully connected layer
- Implement a fully connected layer with Keras
- Use Keras to train a small fully connected network on prepared data
- Interpret the loss curve of the training process
- Use a confusion matrix to measure the trained networks' performance on a test set
:::


Expand Down
30 changes: 15 additions & 15 deletions 3-monitor-the-model.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,22 +5,22 @@ exercises: 80
---

::: questions
- "How do I create a neural network for a regression task?"
- "How does optimization work?"
- "How do I monitor the training process?"
- "How do I detect (and avoid) overfitting?"
- "What are common options to improve the model performance?"
- How do I create a neural network for a regression task?
- How does optimization work?
- How do I monitor the training process?
- How do I detect (and avoid) overfitting?
- What are common options to improve the model performance?
:::

::: objectives
- "Explain the importance of keeping your test set clean, by validating on the validation set instead of the test set"
- "Use the data splits to plot the training process"
- "Explain how optimization works"
- "Design a neural network for a regression task"
- "Measure the performance of your deep neural network"
- "Interpret the training plots to recognize overfitting"
- "Use normalization as preparation step for Deep Learning"
- "Implement basic strategies to prevent overfitting"
- Explain the importance of keeping your test set clean, by validating on the validation set instead of the test set
- Use the data splits to plot the training process
- Explain how optimization works
- Design a neural network for a regression task
- Measure the performance of your deep neural network
- Interpret the training plots to recognize overfitting
- Use normalization as preparation step for Deep Learning
- Implement basic strategies to prevent overfitting
:::

::: instructor
Expand Down Expand Up @@ -990,6 +990,6 @@ This will turn the data into time series data which in turn might also make it w


::: keypoints
- "Separate training, validation, and test sets allows monitoring and evaluating your model."
- "Batchnormalization scales the data as part of the model."
- Separate training, validation, and test sets allows monitoring and evaluating your model.
- Batchnormalization scales the data as part of the model.
:::
20 changes: 10 additions & 10 deletions 4-advanced-layer-types.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,16 +5,16 @@ exercises: 70
---

::: questions
- "Why do we need different types of layers?"
- "What are good network designs for image data?"
- "What is a convolutional layer?"
- "How can we use different types of layers to prevent overfitting?"
- Why do we need different types of layers?
- What are good network designs for image data?
- What is a convolutional layer?
- How can we use different types of layers to prevent overfitting?
:::

::: objectives
- "Understand why convolutional and pooling layers are useful for image data"
- "Implement a convolutional neural network on an image dataset"
- "Use a drop-out layer to prevent overfitting"
- Understand why convolutional and pooling layers are useful for image data
- Implement a convolutional neural network on an image dataset
- Use a drop-out layer to prevent overfitting
:::


Expand Down Expand Up @@ -793,7 +793,7 @@ model.save('cnn_model')
```

::: keypoints
- "Convolutional layers make efficient reuse of model parameters."
- "Pooling layers decrease the resolution of your input"
- "Dropout is a way to prevent overfitting"
- Convolutional layers make efficient reuse of model parameters.
- Pooling layers decrease the resolution of your input
- Dropout is a way to prevent overfitting
:::
18 changes: 9 additions & 9 deletions 5-outlook.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,15 +5,15 @@ exercises: 15
---

::: questions
- "How does what I learned in this course translate to real-world problems?"
- "How do I organise a deep learning project?"
- "What are next steps to take after this course?"
- How does what I learned in this course translate to real-world problems?
- How do I organise a deep learning project?
- What are next steps to take after this course?
:::

::: objectives
- "Understand that what we learned in this course can be applied to real-world problems"
- "Use best practices for organising a deep learning project"
- "Identify next steps to take after this course"
- Understand that what we learned in this course can be applied to real-world problems
- Use best practices for organising a deep learning project
- Identify next steps to take after this course
:::

You have come to the end of this course.
Expand Down Expand Up @@ -155,7 +155,7 @@ Tensorflow/Keras will automatically detect and use a GPU if it is available on y
A simple and quick way to get access to a GPU is to use [Google Colab](https://colab.google/)

::: keypoints
- "Although the data preparation and model architectures are somewhat more complex,
what we have learned in this course can directly be applied to real-world problems"
- "Use what you have learned in this course as a basis for your own learning trajectory in the world of deep learning"
- Although the data preparation and model architectures are somewhat more complex,
what we have learned in this course can directly be applied to real-world problems
- Use what you have learned in this course as a basis for your own learning trajectory in the world of deep learning
:::
Empty file modified fig/03_tensorboard.png
100755 → 100644
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Empty file modified fig/04_conv_image.png
100755 → 100644
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
38 changes: 19 additions & 19 deletions md5sum.txt
Original file line number Diff line number Diff line change
@@ -1,20 +1,20 @@
"file" "checksum" "built" "date"
"CODE_OF_CONDUCT.md" "c93c83c630db2fe2462240bf72552548" "site/built/CODE_OF_CONDUCT.md" "2024-02-13"
"LICENSE.md" "b24ebbb41b14ca25cf6b8216dda83e5f" "site/built/LICENSE.md" "2024-02-13"
"config.yaml" "e6eff4d2bc0f8b84f5735d6e6f3dfd38" "site/built/config.yaml" "2024-02-13"
"index.md" "e1dd31f342a7fa31de1064b484cd343a" "site/built/index.md" "2024-02-13"
"links.md" "8184cf4149eafbf03ce8da8ff0778c14" "site/built/links.md" "2024-02-13"
"paper.md" "bb2f0edaf5f729d9801fc2398650571b" "site/built/paper.md" "2024-02-13"
"episodes/1-introduction.Rmd" "56433d68520936be1e54c90085ce34db" "site/built/1-introduction.md" "2024-02-13"
"episodes/2-keras.Rmd" "9e35ec651717f7323c01c1f4625bace1" "site/built/2-keras.md" "2024-02-13"
"episodes/3-monitor-the-model.Rmd" "65a1408b6774e38b951aaa50630ba08a" "site/built/3-monitor-the-model.md" "2024-02-13"
"episodes/4-advanced-layer-types.Rmd" "e53a712790d6f1f90b190bda6646270b" "site/built/4-advanced-layer-types.md" "2024-02-13"
"episodes/5-outlook.Rmd" "1f0e86b2cd274c5bbe7f4982e03c5733" "site/built/5-outlook.md" "2024-02-13"
"instructors/bonus-material.md" "d5b6aaee56986ab74e33bb95894cdc0e" "site/built/bonus-material.md" "2024-02-13"
"instructors/design.md" "6c13db77f9d69a294398a77da7e9883f" "site/built/design.md" "2024-02-13"
"instructors/instructor-notes.md" "b516f8e213b07224e85073bfe47ed3aa" "site/built/instructor-notes.md" "2024-02-13"
"instructors/survey-templates.md" "ea5d46e7b54d335f79e57a7bc31d1c5c" "site/built/survey-templates.md" "2024-02-13"
"learners/reference.md" "ae95aeca6d28f5f0f994d053dc10d67c" "site/built/reference.md" "2024-02-13"
"learners/setup.md" "9ba74851d85f30f0cb7e23cf5b9acff4" "site/built/setup.md" "2024-02-13"
"profiles/learner-profiles.md" "698c27136a1a320b0c04303403859bdc" "site/built/learner-profiles.md" "2024-02-13"
"renv/profiles/lesson-requirements/renv.lock" "959071dab18d625ec4718e817583a102" "site/built/renv.lock" "2024-02-13"
"CODE_OF_CONDUCT.md" "c93c83c630db2fe2462240bf72552548" "site/built/CODE_OF_CONDUCT.md" "2024-02-18"
"LICENSE.md" "b24ebbb41b14ca25cf6b8216dda83e5f" "site/built/LICENSE.md" "2024-02-18"
"config.yaml" "e6eff4d2bc0f8b84f5735d6e6f3dfd38" "site/built/config.yaml" "2024-02-18"
"index.md" "e1dd31f342a7fa31de1064b484cd343a" "site/built/index.md" "2024-02-18"
"links.md" "8184cf4149eafbf03ce8da8ff0778c14" "site/built/links.md" "2024-02-18"
"paper.md" "bb2f0edaf5f729d9801fc2398650571b" "site/built/paper.md" "2024-02-18"
"episodes/1-introduction.Rmd" "0287194410f6d1878c1773a19ec995f2" "site/built/1-introduction.md" "2024-02-18"
"episodes/2-keras.Rmd" "acfa1eeee7f5cb60ab415d459ca87b13" "site/built/2-keras.md" "2024-02-18"
"episodes/3-monitor-the-model.Rmd" "da2a9d5559eff971197214df2428817c" "site/built/3-monitor-the-model.md" "2024-02-18"
"episodes/4-advanced-layer-types.Rmd" "859b8ba83eb3a0eb8270234452b9f75c" "site/built/4-advanced-layer-types.md" "2024-02-18"
"episodes/5-outlook.Rmd" "f4590cc35688aa115b3e64e0d14bbc28" "site/built/5-outlook.md" "2024-02-18"
"instructors/bonus-material.md" "d5b6aaee56986ab74e33bb95894cdc0e" "site/built/bonus-material.md" "2024-02-18"
"instructors/design.md" "6c13db77f9d69a294398a77da7e9883f" "site/built/design.md" "2024-02-18"
"instructors/instructor-notes.md" "b516f8e213b07224e85073bfe47ed3aa" "site/built/instructor-notes.md" "2024-02-18"
"instructors/survey-templates.md" "ea5d46e7b54d335f79e57a7bc31d1c5c" "site/built/survey-templates.md" "2024-02-18"
"learners/reference.md" "ae95aeca6d28f5f0f994d053dc10d67c" "site/built/reference.md" "2024-02-18"
"learners/setup.md" "9ba74851d85f30f0cb7e23cf5b9acff4" "site/built/setup.md" "2024-02-18"
"profiles/learner-profiles.md" "698c27136a1a320b0c04303403859bdc" "site/built/learner-profiles.md" "2024-02-18"
"renv/profiles/lesson-requirements/renv.lock" "959071dab18d625ec4718e817583a102" "site/built/renv.lock" "2024-02-18"

0 comments on commit 46b17ad

Please sign in to comment.