Add CuDNN LSTM Projection (LSTMP)

tensorflow/core/api_def/base_api/api_def_CudnnRNNCanonicalToParamsV2.pbtxt

@@ -0,0 +1,36 @@
+op {
+  graph_op_name: "CudnnRNNCanonicalToParamsV2"
+  summary: "Converts CudnnRNN params from canonical form to usable form. It supports the projection in LSTM."
+  description: <<END
+Writes a set of weights into the opaque params buffer so they can be used in
+upcoming training or inferences.
+
+Note that the params buffer may not be compatible across different GPUs. So any
+save and restoration should be converted to and from the canonical weights and
+biases.
+
+num_layers: Specifies the number of layers in the RNN model.
+num_units: Specifies the size of the hidden state.
+input_size: Specifies the size of the input state.
+weights: the canonical form of weights that can be used for saving
+    and restoration. They are more likely to be compatible across different
+    generations.
+biases: the canonical form of biases that can be used for saving
+    and restoration. They are more likely to be compatible across different
+    generations.
+num_params_weigths: number of weight parameter matrix for all layers.
+num_params_biases: number of bias parameter vector for all layers.
+rnn_mode: Indicates the type of the RNN model.
+input_mode: Indicate whether there is a linear projection between the input and
+    The actual computation before the first layer. 'skip_input' is only allowed
+    when input_size == num_units; 'auto_select' implies 'skip_input' when
+    input_size == num_units; otherwise, it implies 'linear_input'.
+direction: Indicates whether a bidirectional model will be used.
+    dir = (direction == bidirectional) ? 2 : 1
+dropout: dropout probability. When set to 0., dropout is disabled.
+seed: the 1st part of a seed to initialize dropout.
+seed2: the 2nd part of a seed to initialize dropout.
+num_proj: The output dimensionality for the projection matrices. If None or 0,
+    no projection is performed.
+END
+}

tensorflow/core/api_def/base_api/api_def_CudnnRNNParamsToCanonicalV2.pbtxt

@@ -0,0 +1,36 @@
+op {
+  graph_op_name: "CudnnRNNParamsToCanonicalV2"
+  summary: "Retrieves CudnnRNN params in canonical form. It supports the projection in LSTM."
+  description: <<END
+Retrieves a set of weights from the opaque params buffer that can be saved and
+restored in a way compatible with future runs.
+
+Note that the params buffer may not be compatible across different GPUs. So any
+save and restoration should be converted to and from the canonical weights and
+biases.
+
+num_layers: Specifies the number of layers in the RNN model.
+num_units: Specifies the size of the hidden state.
+input_size: Specifies the size of the input state.
+num_params_weigths: number of weight parameter matrix for all layers.
+num_params_biases: number of bias parameter vector for all layers.
+weights: the canonical form of weights that can be used for saving
+    and restoration. They are more likely to be compatible across different
+    generations.
+biases: the canonical form of biases that can be used for saving
+    and restoration. They are more likely to be compatible across different
+    generations.
+rnn_mode: Indicates the type of the RNN model.
+input_mode: Indicate whether there is a linear projection between the input and
+    The actual computation before the first layer. 'skip_input' is only allowed
+    when input_size == num_units; 'auto_select' implies 'skip_input' when
+    input_size == num_units; otherwise, it implies 'linear_input'.
+direction: Indicates whether a bidirectional model will be used.
+    dir = (direction == bidirectional) ? 2 : 1
+dropout: dropout probability. When set to 0., dropout is disabled.
+seed: the 1st part of a seed to initialize dropout.
+seed2: the 2nd part of a seed to initialize dropout.
+num_proj: The output dimensionality for the projection matrices. If None or 0,
+    no projection is performed.
+END
+}

tensorflow/core/api_def/python_api/api_def_CudnnRNNCanonicalToParamsV2.pbtxt

@@ -0,0 +1,4 @@
+op {
+  graph_op_name: "CudnnRNNCanonicalToParamsV2"
+  visibility: HIDDEN
+}

tensorflow/core/api_def/python_api/api_def_CudnnRNNParamsToCanonicalV2.pbtxt

@@ -0,0 +1,4 @@
+op {
+  graph_op_name: "CudnnRNNParamsToCanonicalV2"
+  visibility: HIDDEN
+}