leverage cudnn?

[byzhang]

Is there anything from cudnn can be leveraged? It shows ~24% speedup in Titan Black.

[tqchen]

I didn't carefully study cudnn yet, i suppose it should be possible to leverage the covolution kernel. @antinucleon

[antinucleon]

I will try it after trip. It is not hard indeed. But according to others' test: https://github.com/soumith/convnet-benchmarks, cuDNN is not faster than blas conv.

[byzhang]

Agree that it's not high pri.
Re: speed, for caffe referenced imagenet network, it speedup 24% in my settings. So the benefits of cuDnn may be outside of the conv layer.

[antinucleon]

Thanks. I will test it.

Sent from Bing's Nexus 5
On Sep 18, 2014 10:47 AM, "byzhang" notifications@github.com wrote:

Agree that it's not high pri.
Re: speed, for caffe referenced imagenet network, it speedup 24% in my
settings. So the benefits of cuDnn may be outside of the conv layer.

—
Reply to this email directly or view it on GitHub
https://github.com/tqchen/mshadow/issues/15#issuecomment-56076143.

[tqchen]

CUDNN will be leveraged in newest version of cxxnet.