New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ND4J Activation functions: enforce same shape in backprop method #5357

Closed
AlexDBlack opened this Issue May 28, 2018 · 1 comment

Comments

Projects
None yet
1 participant
@AlexDBlack
Copy link
Member

AlexDBlack commented May 28, 2018

so our activation functions (a=f(z)) return dL/dz given dL/da and z
in all cases (though, in principle it could differ), dL/dz and dL/da and z must all have exactly the same shape

Yet: we don't actually enforce this properly at the ActivationFunction level. Some of the internal ops may throw an exception, however (but this is not guaranteed for all cases it seems).

@AlexDBlack AlexDBlack added this to the DL4J/Arbiter/DataVec Planning Sprint (01 June) milestone May 28, 2018

@AlexDBlack AlexDBlack self-assigned this Jun 12, 2018

@lock

This comment has been minimized.

Copy link

lock bot commented Sep 21, 2018

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Sep 21, 2018

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.