cuDNN R2 #2038

Merged
merged 4 commits into from Mar 24, 2015

Conversation

Projects
None yet
4 participants
Owner

shelhamer commented Mar 5, 2015

This is the master edition of #1731. See #1854 for the initial cuDNN R2 compatible branch by @slayton58.

Although cuDNN R2 is still experimental it is in the release candidate stage of development, so this PR will ready Caffe for R2. This should not be made the default until R2 is done or we add version switching for compatibility.

Note that R2 brings OS X support.

Compatibility

  • create general tensor, but set 4D tensor
  • set conv 2D descriptors
  • set pooling 2D descriptors
  • replace accumulation flags with alpha, beta scaling
  • let pooling have padding
  • pick fastest by default (according to cuDNN heuristics)

Next Up

  • keep R1 compatibility #if CUDNN_VERSION < 20 since the library isn't itself backward-compatible we're not going to take this on ourselves.
  • pick algorithm in Reshape() instead of Forward()
  • expose choice of the forward convolutional algorithm / preference
  • switch to the N-D interface now that #1486 is done
  • 3D convolution

@myfavouritekk myfavouritekk added a commit to myfavouritekk/caffe that referenced this pull request Mar 16, 2015

@myfavouritekk myfavouritekk Merge pull request #2038 from shelhamer/cudnn-r2
cuDNN R2

* shelhamer/cudnn-r2:
  cuDNN pooling can pad now
  replace cuDNN alphas and betas with coefficient values
  switch to cuDNN R2
c4837dd

NV-slayton and others added some commits Feb 10, 2015

@NV-slayton @shelhamer NV-slayton switch to cuDNN R2 600c81d
@shelhamer shelhamer replace cuDNN alphas and betas with coefficient values
Give cuDNN {0, 1} constants for controlling accumulation through the
alpha and beta coefficients.
17c3bb7
@shelhamer shelhamer cuDNN pooling can pad now 6d1444f
@shelhamer shelhamer note cuDNN v2 convolutional TODOs
3cc9b73

@shelhamer shelhamer added a commit that referenced this pull request Mar 24, 2015

@shelhamer shelhamer Merge pull request #2038 from shelhamer/cudnn-r2
cuDNN v2
de957e2

@shelhamer shelhamer merged commit de957e2 into BVLC:master Mar 24, 2015

1 of 2 checks passed

continuous-integration/travis-ci/push The Travis CI build could not complete due to an error
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details

shelhamer deleted the shelhamer:cudnn-r2 branch Mar 24, 2015

lxycnu commented on 3cc9b73 Mar 25, 2015

I just downdload the latest caffe-master and cudnn v2,but this occour:
cudnn_conv_layer.cu:65] Check failed: status == CUDNN_STATUS_SUCCESS (8 vs. 0) CUDNN_STATUS_EXECUTION_FAILED

How can i fix this problem

I too get the same error...

Owner

shelhamer replied Mar 25, 2015

Sorry about that -- there should be a fix shortly for the automatic selection. This is happening because cuDNN is selecting the fastest but memory consuming algorithm so that the GPU runs out of memory.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment