Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Elementwise op with arbitrary arity #6

Open
hojonathanho opened this issue Aug 28, 2015 · 1 comment
Open

Elementwise op with arbitrary arity #6

hojonathanho opened this issue Aug 28, 2015 · 1 comment
Labels
enhancement

Comments

@hojonathanho
Copy link
Contributor

It could be useful to unify and generalize the elementwise unary and binary ops to support arbitrary numbers of arguments. This would allow for some nice graph simplifications, and in particular, compositions of elementwise operations (for example, for common implementations of ReLU) would be performed with a single CUDA kernel launch. A general elementwise arithmetic op could store a symbolic expression that could even be simplified with a library like SymPy.
@joschu
Copy link
Owner

joschu commented Aug 28, 2015

Agreed. As in theano, we could have an elementwise composite operation and an optimization that fuses elementwise operations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@joschu @hojonathanho