Skip to content
This repository has been archived by the owner on Aug 5, 2022. It is now read-only.

parameter #120

Closed
fastalgo opened this issue Sep 20, 2017 · 4 comments
Closed

parameter #120

fastalgo opened this issue Sep 20, 2017 · 4 comments

Comments

@fastalgo
Copy link

Do you know what scale_bias: true matches in Intel Caffe? Intel Caffe does not have this parameter while Nvidia Caffe does.

batch_norm_param {
moving_average_fraction: 0.9
eps: 0.0001
scale_bias: true
}

@jgong5
Copy link
Contributor

jgong5 commented Sep 20, 2017

Are you looking for the following configuration?
optional bool use_weight_bias = 5 [default = true];
optional bool bias_term = 6 [default = true]; // whether to have bias terms

@fastalgo
Copy link
Author

Can you tell what moving_average_fraction, eps, scale_bias corresponds to? respectively

moving_average_fraction = ?
eps = ?
scale_bias = ?

@jgong5
Copy link
Contributor

jgong5 commented Sep 20, 2017

Would you please check the BatchNormParameter in src/caffe/proto/caffe.proto? IntelCaffe just added some parameters not change the original ones. The "moving_average_fraction" and "eps" are still there, same as BVLC Caffe. For "scale_bias", as I listed, IntelCaffe has two params controlling it. By default, they are both turned on.

@fastalgo
Copy link
Author

Thanks so much!

@jgong5 jgong5 closed this as completed Sep 26, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants