Adds conv3d_transpose operation (3D "deconvolution")

[daeyun]

This pull request contains the following changes:

• Define gradients for Conv3DBackpropInputV2 and Conv3DBackpropFilterV2.
• Add a new conv3d_transpose operation which uses Conv3DBackpropInputV2.
• Test conv3d_transpose and Conv3DBackpropFilterV2.

Fixes #3012 #150

[tensorflow-jenkins]

Can one of the admins verify this patch?

[googlebot]

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

📝 Please visit https://cla.developers.google.com/ to sign.

Once you've signed, please reply here (e.g. I signed it!) and we'll verify. Thanks.

---

• If you've already signed a CLA, it's possible we don't have your GitHub username or you're using a different email address. Check your existing CLA data and verify that your email is set on your git commits.
• If you signed the CLA as a corporation, please let us know the company's name.

[daeyun]

I signed the CLA.

[googlebot]

CLAs look good, thanks!

[vrv]

weird indentation here, should be aligned with [

[aioie]

Hi,

I've been looking for some useful stuff and found an interesting site with useful advices, please take a look http://agree.pumpjuice.com/e4ann

ziney2y

[vrv]

very nice! just a few minor comments and then we can test.

[daeyun]

Thanks, done.

[vrv]

Thanks!
@tensorflow-jenkins test this please

[KendallWeihe]

has this been tested and verified?

[vrv]

There's a test to validate correctness, yes. If you think there's a bug in the implementation, please feel free to file an issue. Thanks!

[KendallWeihe]

I'm having a difficult time updating Tensorflow to include this code. I noticed that the function is in source code in the nn_ops.py file, but when I run the pip --upgrade it isn't included. Could I simply copy the function into my existing code, or does it include other dependencies?

[vrv]

You could try one of the nightlies that might have this change in it: https://github.com/tensorflow/tensorflow#installation

Alternatively, you could build from sources at HEAD as well.

You could copy the contents of the files too, though it might be easy to get wrong.

[KendallWeihe]

that had it, thanks!

[KendallWeihe]

Can we fix the issue where after a transpose, the dimensions are always <?,?, ?, ?, n_classes> -- can we get rid of the question marks and make them show the actual dimension value?

[KendallWeihe]

@vrv it isn't included in the Mac OSX nightly build or the build currently posted to the main install page. Is there any other way I can get it installed on my mac? I ask because of this issue on both of my linux machines *** Error in 'python': free(): invalid pointer outlined in this SO post: http://stackoverflow.com/questions/38129441/tensorflow-conv3d-transpose-error-in-python-free-invalid-pointer

[vrv]

http://ci.tensorflow.org/view/Nightly/job/nightly-matrix-cpu/TF_BUILD_CONTAINER_TYPE=CPU,TF_BUILD_IS_OPT=OPT,TF_BUILD_IS_PIP=PIP,TF_BUILD_PYTHON_VERSION=PYTHON2,label=mac-slave/

looks like no mac builds have been created for a while -- pinging @caisq who might know more.

[KendallWeihe]

@vrv Do you think this a bug with the latest build, or with the development of conv3d_transpose ? If it is with the development, then I need to open another issue.

[vrv]

I have no idea -- conv3d_transpose is just a wrapper calling an existing function that already likely worked. I think filing a bug with a reproducible small example would help (small being the clear word here -- it should be a single call to conv3d_transpose that triggers the bug, ideally).

[KendallWeihe]

I opened a new issue: #3128

I wrote a small network to reproduce the issue -- I hope it was concise enough

[KendallWeihe]

@vrv Mac OS nightly build still hasn't been updated -- over a month old

[vrv]

I guess there's a stale link somewhere. Try these?

http://ci.tensorflow.org/view/Nightly/job/nightly-matrix-cpu/156/

E.g., http://ci.tensorflow.org/view/Nightly/job/nightly-matrix-cpu/156/TF_BUILD_CONTAINER_TYPE=CPU,TF_BUILD_IS_OPT=OPT,TF_BUILD_IS_PIP=PIP,TF_BUILD_PYTHON_VERSION=PYTHON2,label=mac1-slave/

[juanprietob]

Is this feature implemented for GPU?
I am getting the following error when tensorflow is compiled with GPU support

AttributeError: 'module' object has no attribute 'conv3d_transpose'

[KendallWeihe]

@juanprietob I'm not sure this is in production at the moment. I installed from a nightly build. See the links for nightly builds in an above comment.