Skip to content

Added echo state network (ESN) recurrent cell #1811

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
May 18, 2020

Conversation

pedrolarben
Copy link
Contributor

@pedrolarben pedrolarben commented May 10, 2020

Part of #1809

I have been working with recurrent neural networks. I needed an implementation of Echo State Networks (ESN) for tensorflow. I found some implementations, but none of them was compatible with tensorflow2, so I implemented it. I think it would be great to add ESN to tensorflow_addons so everybody can use it.

This pull request add the recurrent ESNCell.

"Echo state networks (ESN) provide an architecture and supervised learning principle for recurrent neural networks (RNNs). The main idea is (i) to drive a random, large, fixed recurrent neural network with the input signal, thereby inducing in each neuron within this "reservoir" network a nonlinear response signal, and (ii) combine a desired output signal by a trainable linear combination of all of these response signals".
Herbert Jaeger, Jacobs University Bremen, Bremen, Germany

Echo state network scheme by Peter Birkholz

References

Copy link
Member

@qlzh727 qlzh727 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the change.

@pedrolarben pedrolarben requested a review from qlzh727 May 12, 2020 10:39
qlzh727
qlzh727 previously approved these changes May 12, 2020
Copy link
Member

@qlzh727 qlzh727 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the change. Please address the remaining comments.

@pedrolarben
Copy link
Contributor Author

pedrolarben commented May 13, 2020

Thanks for your comments, I have done the changes.
Please, let me know if there is something missing.

@pedrolarben pedrolarben requested a review from qlzh727 May 13, 2020 08:38
@pedrolarben
Copy link
Contributor Author

@qlzh727 Thank you very much for your help.
Once it is merged I will proceed with the remaining code from #1809 (the layer class).

Copy link
Member

@seanpmorgan seanpmorgan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@seanpmorgan seanpmorgan merged commit acb50b9 into tensorflow:master May 18, 2020
ashutosh1919 pushed a commit to ashutosh1919/addons that referenced this pull request Jul 12, 2020
* Added echo state network (ESN) recurrent cell
jrruijli pushed a commit to jrruijli/addons that referenced this pull request Dec 23, 2020
* Added echo state network (ESN) recurrent cell
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants