cudaErrorInvalidConfiguration with debug build

[stanmoore1]

With either KOKKOS_DEBUG=yes or running my executable in cuda-gdb, I'm seeing an invalid configuration error. It appears to be related to the ViewCopy-2D algorithm, which may not be choosing the correct block size:

KokkosP: Allocate<Cuda> name: atom:improper_type pointer: 0x10017000c80 size: 0
KokkosP: Executing parallel-for kernel on device 0 with unique execution identifier 856
KokkosP: Kokkos::ViewCopy-2D
terminate called after throwing an instance of 'std::runtime_error'
  what():  cudaGetLastError() error( cudaErrorInvalidConfiguration): invalid configuration argument ../../lib/kokkos/core/src/Cuda/Kokkos_CudaExec.hpp:401
Traceback functionality not available

[ndellingwood]

@crtrott possibly related to the Panzer example errors in trilinos/Trilinos#2827

[crtrott]

Possibly fixed with the changes to the recommended team_size stuff.

[mhoemmen]

@kddevin reported something funny about ViewCopy performance (on host?) for 2-D Views in Tpetra::MultiVector. I forget the issue number at the moment. Could that possibly be related?

[ibaned]

@ndellingwood assigned to use @crtrott 's new more accurate block size predictor to determine tile sizes at the right place in the code.

[crtrott]

@stanmoore1 can you check whether this was fixed now?

[stanmoore1]

I can't reproduce this, even with an older version of Kokkos. The compiler and CUDA version on the testbed could have changed since then, and I also can't remember exactly what input I was using. So this ticket can be closed. If I see it again I'll let you know.