Disable multiple kernel instantiations when using HIP

[Rombur]

Related to #4546

[dalg24]

Did you consider other names for the option?
Should we spell out "kernel instantiation"?

Also please comment why you think the default should be OFF

[Rombur]

Did you consider other names for the option?

I couldn't think of a good name. If you have a better one, I am ready to change.

Also please comment why you think the default should be OFF

Because that's why @crtrott told me to do.

[dalg24]

OpenMPTarget failure is clearly unrelated

4: /var/jenkins/workspace/Kokkos/core/unit_test/TestUniqueToken.hpp:151: Failure
4: Expected equality of these values:
4:   sum
4:     Which is: 9999990
4:   int64_t(N) * R
4:     Which is: 10000000
4: [  FAILED  ] openmptarget.unique_token_instance (261 ms)

@crtrott @rgayatri23 is that something worth investigating?

[rgayatri23]

OpenMPTarget failure is clearly unrelated

4: /var/jenkins/workspace/Kokkos/core/unit_test/TestUniqueToken.hpp:151: Failure
4: Expected equality of these values:
4:   sum
4:     Which is: 9999990
4:   int64_t(N) * R
4:     Which is: 10000000
4: [  FAILED  ] openmptarget.unique_token_instance (261 ms)

@crtrott @rgayatri23 is that something worth investigating?

There is no implementation for the instance scope of UniqueToken yet. Only the global scope is implemented.
I thought that this test case was blocked for OpenMPTarget backend.

[masterleinad]

Suggested change

	KOKKOS_ENABLE_OPTION(HIP_MULTIPLE_KERNEL_INSTANTIATIONS OFF "Whether multiple kernels are instantiated at compile time - improve performance but increase compile time")
	KOKKOS_ENABLE_OPTION(HIP_MULTIPLE_KERNEL_INSTANTIATIONS OFF "Whether multiple versions for each kernel are instantiated at compile time - improve performance but increase compile time")

[dalg24]

Both HIP builds are passing. Failures are unrelated (issues with one of the testing machine)