Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Gaussian Noise layer #335

Merged
merged 2 commits into from
Jul 6, 2015
Merged

Create Gaussian Noise layer #335

merged 2 commits into from
Jul 6, 2015

Conversation

Reddine
Copy link
Contributor

@Reddine Reddine commented Jul 5, 2015

Reference : Vincent, Pascal, et al. "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion." The Journal of Machine Learning Research 11 (2010): 3371-3408.

@fchollet
Copy link
Member

fchollet commented Jul 5, 2015

Cool! I'm wondering if this belongs among the core layers, though. I remember that at some point we discussed the possibility of introducing a "noise" module. If there was such a module, what other layers would be in it? (I like having Dropout in core, though).

@Reddine
Copy link
Contributor Author

Reddine commented Jul 5, 2015

may be as mentioned in the Reference article: Masking Noise (same principle of Dropout) and Salt-and-pepper Noise.

@pranv
Copy link
Contributor

pranv commented Jul 5, 2015

Neat!
I think that Noise can have its own module. The paper - Deep Learning with Noise has many versions of noise - not just Gaussian. Having the entire family might be useful.

@fchollet fchollet merged commit c315b0d into keras-team:master Jul 6, 2015
@fchollet
Copy link
Member

fchollet commented Jul 6, 2015

I put it in a noise module.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants