Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some work with CUDNN #2797

Open
wants to merge 27 commits into
base: master
Choose a base branch
from
Open

Some work with CUDNN #2797

wants to merge 27 commits into from

Commits on Sep 15, 2018

  1. WIP: Add CUDNN as an optional dependency to cu-device.{cc,h}

    Currently, this assumes that cudnn is installed in
    /usr/local/cuda/lib64 and /usr/local/cuda/include, because that's what
    my current machine has it installed. This can be cleaned up later.
    galv committed Sep 15, 2018
    Configuration menu
    Copy the full SHA
    2d76ce9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0a00e73 View commit details
    Browse the repository at this point in the history
  3. Initial draft of CUDNN 2d convolution implementation.

    Double check that we correctly transpose height and width everywhere!
    galv committed Sep 15, 2018
    Configuration menu
    Copy the full SHA
    224d4da View commit details
    Browse the repository at this point in the history
  4. Minor

    galv committed Sep 15, 2018
    Configuration menu
    Copy the full SHA
    c9806e0 View commit details
    Browse the repository at this point in the history
  5. [egs] mini librispeech fix for CLSP.

    b17 disk is no longer writable.
    galv committed Sep 15, 2018
    Configuration menu
    Copy the full SHA
    5b1855a View commit details
    Browse the repository at this point in the history
  6. [src] Fix Singleton implementation of CuDevice.

    No longer publicly expose the default constructor.
    
    That could allow someone to do something like this:
    
    CuDevice device1;
    CuDevice device2;
    
    We're not sure what this would cause, but it probably wouldn't be good.
    galv committed Sep 15, 2018
    Configuration menu
    Copy the full SHA
    8e00e4f View commit details
    Browse the repository at this point in the history
  7. Small CUDNN fixes

    galv committed Sep 15, 2018
    Configuration menu
    Copy the full SHA
    5e4d270 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2018

  1. Fix implementation's height-width switching.

    Document data formats expected of each member function.
    galv committed Sep 30, 2018
    Configuration menu
    Copy the full SHA
    0387a0c View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2018

  1. Make CUDNN mandatory if building with CUDA.

    There may be edge cases in the configure script with this remaining.
    
    We still don't look up the version of CUDNN to download for your CUDA
    version.
    
    Also make sure that non-CUDA builds still compile. This is achieved by
    the cu-cudnn-helper.h file, which forward declares cudnn types, which
    fortunately are all pointer types (except for enums, which don't matter
    in this case).
    galv committed Oct 8, 2018
    Configuration menu
    Copy the full SHA
    be6fc2a View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2018

  1. Configuration menu
    Copy the full SHA
    e729495 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5bb72e5 View commit details
    Browse the repository at this point in the history
  3. Automatically download CUDNN as part of configure.

    Remove support for CUDA versions that don't support CUDNN v7.
    
    Remove 32-bit CUDA mode, since no recent version of CUDA supports it. I
    may not have removed all instances of it.
    galv committed Oct 13, 2018
    Configuration menu
    Copy the full SHA
    9647494 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2018

  1. Merge pull request #52 from galv/cudnn

    Automatically download CUDNN as part of configure.
    danpovey committed Oct 15, 2018
    Configuration menu
    Copy the full SHA
    6427e79 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    53d62af View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2018

  1. Configuration menu
    Copy the full SHA
    7000850 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2018

  1. Configuration menu
    Copy the full SHA
    b5d2022 View commit details
    Browse the repository at this point in the history
  2. Change filter type back to NCHW, since it supports more algos.

    Convert assertion to warning, although I am not sure this works, since
    if an algorithm fails to be found because of an out-of-memory error, it
    is likely to fail at training time for the same reason.
    galv committed Oct 23, 2018
    Configuration menu
    Copy the full SHA
    22669f6 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2018

  1. Workaround cudnnSetTensor4dDescriptor's striding bug.

    Use cudnnSetTensor4dDescriptor with strides we calculate ourselves
    instead.
    galv committed Oct 24, 2018
    Configuration menu
    Copy the full SHA
    c958143 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #53 from galv/cudnn-povey

    Change filter type back to NCHW, since it supports more algos.
    danpovey committed Oct 24, 2018
    Configuration menu
    Copy the full SHA
    e4d3383 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2018

  1. [src] Fix various bugs.

    danpovey committed Oct 25, 2018
    Configuration menu
    Copy the full SHA
    74114d0 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2018

  1. Don't use cudnnConvolutionBiasActivationForward.

    It supports only the precomputed implicit GEMM implementation of
    convolution.
    galv committed Oct 26, 2018
    Configuration menu
    Copy the full SHA
    0bed8aa View commit details
    Browse the repository at this point in the history
  2. Explain bias dimensions.

    galv committed Oct 26, 2018
    Configuration menu
    Copy the full SHA
    c546716 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2018

  1. Make bias optional.

    The ConvolutionComputation class does not know whether or not the bias
    is optional at initialization time. It will simply avoid using the bias
    if it is a nullptr.
    galv committed Oct 27, 2018
    Configuration menu
    Copy the full SHA
    450f491 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #54 from galv/cudnn-povey-2

    Don't use cudnnConvolutionBiasActivationForward.
    danpovey committed Oct 27, 2018
    Configuration menu
    Copy the full SHA
    464db5c View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2018

  1. [egs] Remove unnecessary alignment from mini_librispeech run.sh, than…

    …ks: johnjosephmorgan@gmail.com
    danpovey committed Oct 28, 2018
    Configuration menu
    Copy the full SHA
    bfea6c8 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2018

  1. [src] Small cosmetic changes

    danpovey committed Oct 31, 2018
    Configuration menu
    Copy the full SHA
    a2de7b9 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2018

  1. Configuration menu
    Copy the full SHA
    0457a61 View commit details
    Browse the repository at this point in the history