use Sacado_No_Kokkos.hpp if deal.II is built with CUDA

[davydden]

fixes #6423

@aprokop could you please try installing from this branch with Trilinos+tpetra? You would need to hack-in my fork/branch as a source:

diff --git a/var/spack/repos/builtin/packages/dealii/package.py b/var/spack/repos/builtin/packages/dealii/package.py
index f3b4f6bbe..4593b8b21 100644
--- a/var/spack/repos/builtin/packages/dealii/package.py
+++ b/var/spack/repos/builtin/packages/dealii/package.py
@@ -45,7 +45,7 @@ class Dealii(CMakePackage, CudaPackage):
     version('8.3.0', 'fc6cdcb16309ef4bea338a4f014de6fa')
     version('8.2.1', '71c728dbec14f371297cd405776ccf08')
     version('8.1.0', 'aa8fadc2ce5eb674f44f997461bf668d')
-    version('develop', git='https://github.com/dealii/dealii.git', branch='master')
+    version('develop', git='https://github.com/davydden/dealii.git', branch='bugfix/sacado_kokkos_cuda')
 
     variant('mpi',      default=True,  description='Compile with MPI')
     variant('assimp',   default=False,

[davydden]

/run-tests

[aprokop]

@davydden Unfortunately, the Kokkos headers still appear. Sacado_No_Kokkos may not be doing what we expect it to. The rabbit hole: Sacado_No_Kokkos.hpp -> Sacado_DisableKokkosCuda.hpp -> Sacado_ConfigDefs.hpp which has this gem:

#ifdef HAVE_SACADO_KOKKOSCORE
#include "Kokkos_Macros.hpp"
#endif

So I don't even know how it works.

[davydden]

Damn... Thanks for checking!