how to use dropout layer?

[lixin7895123]

to my understanding, dropout is applied to full-connected layer,
how can i use dropout layer in caffe? is there any demo about this?
shall i use it on top of a ip layer?or anything else?

[netheril96]

You can simple read the definition files included in examples/imagenet. There are two dropout layers in them.

[shelhamer]

Right. Examples are your friends. Please ask on caffe-users. Issues are for development discussion. Thanks!

[yolanda93]

The dropout layer reduces overfitting preventing complex co-adaptations on the training data. Here I provided an example that takes the output of an InnerProduct layer (ip11), after an ReLU layer as an activation function.

layer {
name: "drop1"
type: "Dropout"
bottom: "ip11"
top: "ip11"
dropout_param {
dropout_ratio: 0.5
}
}

In this layer each hidden unit is randomly omitted from the network with a probability of 0.5 (the dropout ratio)