Basic tensor operations like in theano / tensorflow

[lukemetz]

Hello all,
What are your thoughts around low level theano / tensorflow style operations? (theano tensor, tensorflow math, tensorflow nn). While slow without kernel fusion, they are incredibly nice to quickly develop more complicated algorithms and something I keep wishing mxnet has.

I already added in pow, #584 and would like to add more to make the library a little more compatible with those already familiar with the other graph based libraries. Is this something that would be OK for the main library?

[tqchen]

Yes, this is a great idea!

[yajiedesign]

Arithmetic Operators

• add
• sub
• mul
• div
• mod

Basic Math Functions

• abs Add ABS OP #634
• neg
• sign add sign op #702
• inv
• square
• round add round ceil floor #717
• sqrt
• rsqrt add rsqrt cos sin #755
• pow
• exp
• log
• ceil add round ceil floor #717
• floor add round ceil floor #717
• maximum add maximum minimum ops #838
• minimum add maximum minimum ops #838
• cos add rsqrt cos sin #755
• sin add rsqrt cos sin #755

Matrix Math Functions

• diag
• transpose
• matmul
• batch_matmul
• matrix_determinant
• batch_matrix_determinant
• matrix_inverse
• batch_matrix_inverse
• cholesky
• batch_cholesky

Complex Number Functions

• complex
• complex_abs
• conj
• imag
• real

[liubenyuan]

I do not know whether cross product of two vectors falls into this category ?

[tqchen]

Yes, I think that is also counts as matmul

[tqchen]

closing this issue for now, as many of them are now supported thanks to our amazing contributors. Let us open it as more requests come in, or start another issue