Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compatible with Keras? #6

Closed
andreaskeviin opened this issue Apr 5, 2021 · 1 comment
Closed

Compatible with Keras? #6

andreaskeviin opened this issue Apr 5, 2021 · 1 comment

Comments

@andreaskeviin
Copy link

andreaskeviin commented Apr 5, 2021

I'm wondering if this is compatible with Keras

Also, I'm a bit confused on using this optimizer, is it just a drop in replacement for adam?
for example,

import madgrad

opt = Madgrad(lr=0.001)
@adefazio
Copy link
Contributor

adefazio commented Apr 6, 2021

Currently there is no Tensorflow/Keras implementation, but pull requests are welcome. Yes it is a drop-in replacement for Adam, although the learning rate and weight decay will need to be changed, it won't work well at Adam defaults.

@adefazio adefazio closed this as completed Apr 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants