Crash with latest kokkos and CUDA

[wrwilliams]

Hi all,

I'm trying to test our Score-P Kokkos prototype against a variety of mini-apps, including MiniMD, and my first step was to try to get an uninstrumented build of MiniMD running with Kokkos using the CUDA back end. With the change from #10 applied, and with the nvcc-wrapper from Kokkos applied throughout, I'm able to build MiniMD; I selected the latest architecture (Turing) that Kokkos supports to run on our Tesla nodes. When I run, however, MiniMD crashes (and apparently pretty early):

wwilliam@tauruslogin3:/scratch/ws/wwilliam-kokkos_tealeaf/miniMD/kokkos> srun -n1 --gres=gpu:1 miniMD 
srun: job 19197979 queued and waiting for resources
srun: job 19197979 has been allocated resources
Kokkos::Cuda::initialize WARNING: running kernels compiled for compute capability 0.0 on device with compute capability 3.5 , this will likely reduce potential performance.
terminate called after throwing an instance of 'std::runtime_error'
  what():  cudaMemcpyToSymbol(Kokkos::Impl::g_device_cuda_lock_arrays, &Kokkos::Impl::g_host_cuda_lock_arrays, sizeof(Kokkos::Impl::CudaLockArrays)) error( cudaErrorInvalidSymbol): invalid device symbol /scratch/ws/wwilliam-kokkos_tealeaf/kokkos/core/src/Cuda/Kokkos_Cuda_Locks.cpp:94
Traceback functionality not available

I'm also somewhat suspicious of the "kernels compiled for compute capability 0.0" warning...

(If this is properly a Kokkos issue, let me know and I'll move it to the appropriate repository.)