Skip to content
This repository has been archived by the owner on Nov 1, 2022. It is now read-only.

Latest commit

 

History

History
36 lines (14 loc) · 1.46 KB

S6_Summary.md

File metadata and controls

36 lines (14 loc) · 1.46 KB

Batch Normalization & Regularization

S5 was more of Coding drill. So I will add few theory concepts learned from S5 in S6.

Let's start with

  • Receptive Field Calculation

Receptive Field usually determines the frequency of the information. RF of a layer depends upon the Stride used in previous layers and the Kernel Size.

Main Concept of Receptive Field

  1. The receptive field of a neuron in one of the lower layers will represent only a small portion of the image, while the receptive field of a neuron in subsequent higher layers involves a combination of receptive fields from several neurons.

  1. So in general a neuron in a higher layer has a wider perspective and will have look at a larger portion of the image, while a lower layer neuron will have a small perspective and will represent a small part of the original image.

  2. In this way, each successive layer is capable of learning increasingly abstract features of the original image. The use of receptive fields in this fashion is thought to give CNNs an advantage in recognizing visual patterns when compared to other types of neural networks.

  • Formula to calculate Receptive Field