Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using learned weights for network initilization #2

Closed
ssakhavi opened this issue Nov 2, 2014 · 2 comments
Closed

Using learned weights for network initilization #2

ssakhavi opened this issue Nov 2, 2014 · 2 comments

Comments

@ssakhavi
Copy link

ssakhavi commented Nov 2, 2014

Hi,

I wanted to ask how I can use the output rbm object for initializing a network in nn

@skaae
Copy link
Owner

skaae commented Nov 2, 2014

I think you manually have to move the weights from the RBM object to the NN object.
The RBM notation is:

% NOTATION:
% data : all data given as [n_samples x #vis]
% W : vis - hid weights [ #hid x #vis ]
% U : label - hid weights [ #hid x #n_classes ]
% b : bias of visible layer [ #vis x 1]
% c : bias of hidden layer [ #hid x 1]
% d : bias of label layer [ #n_classes x 1]

On 02 Nov 2014, at 08:25, Siavash Sakhavi notifications@github.com wrote:

Hi,

I wanted to ask how I can use the output rbm object for initializing a network in nn


Reply to this email directly or view it on GitHub.

@ssakhavi
Copy link
Author

ssakhavi commented Nov 2, 2014

Thanks

On Sun, Nov 2, 2014 at 4:30 PM, Søren Kaae Sønderby <
notifications@github.com> wrote:

I think you manually have to move the weights from the RBM object to the
NN object.
The RBM notation is:

% NOTATION:
% data : all data given as [n_samples x #vis]
% W : vis - hid weights [ #hid x #vis ]
% U : label - hid weights [ #hid x #n_classes ]
% b : bias of visible layer [ #vis x 1]
% c : bias of hidden layer [ #hid x 1]
% d : bias of label layer [ #n_classes x 1]

On 02 Nov 2014, at 08:25, Siavash Sakhavi notifications@github.com
wrote:

Hi,

I wanted to ask how I can use the output rbm object for initializing a
network in nn

Reply to this email directly or view it on GitHub.

Reply to this email directly or view it on GitHub
#2 (comment).

@skaae skaae closed this as completed Nov 6, 2015
skaae pushed a commit that referenced this issue Nov 17, 2015
Merge pull request #5 from elezar/master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants