On FreeBSD with external Kokkos with openmp enabled: quicktest failures.

[yurivict]

Test project /usr/ports/math/deal.ii/work/.build
      Start 10: quick_tests/step-petsc.release
      Start 11: quick_tests/step-slepc.release
      Start 12: quick_tests/step.release
      Start 13: quick_tests/sundials-ida.release
      Start  6: test_dependency/quick_tests.mpi.release.executable
      Start  4: quick_tests/kokkos.release
      Start  2: quick_tests/boost_zlib.release
      Start  1: quick_tests/affinity.release
 1/14 Test  #4: quick_tests/kokkos.release ..................................   Passed    0.17 sec
      Start  5: quick_tests/lapack.release
 2/14 Test  #2: quick_tests/boost_zlib.release ..............................   Passed    0.19 sec
      Start  3: quick_tests/gsl.release
 3/14 Test  #6: test_dependency/quick_tests.mpi.release.executable ..........   Passed    0.20 sec
      Start 14: quick_tests/tbb.release
 4/14 Test  #1: quick_tests/affinity.release ................................   Passed    0.22 sec
      Start  8: test_dependency/quick_tests.step-metis.release.executable
 5/14 Test  #3: quick_tests/gsl.release .....................................   Passed    0.16 sec
 6/14 Test #14: quick_tests/tbb.release .....................................   Passed    0.16 sec
      Start  7: quick_tests/mpi.mpirun=2.release
 7/14 Test  #5: quick_tests/lapack.release ..................................   Passed    0.20 sec
 8/14 Test  #8: test_dependency/quick_tests.step-metis.release.executable ...   Passed    0.19 sec
      Start  9: quick_tests/step-metis.mpirun=2.release
 9/14 Test  #7: quick_tests/mpi.mpirun=2.release ............................   Passed    0.16 sec
10/14 Test #12: quick_tests/step.release ....................................***Failed    3.70 sec
11/14 Test #13: quick_tests/sundials-ida.release ............................***Failed    3.75 sec
12/14 Test #11: quick_tests/step-slepc.release ..............................***Failed    3.76 sec
13/14 Test #10: quick_tests/step-petsc.release ..............................***Failed    3.92 sec
14/14 Test  #9: quick_tests/step-metis.mpirun=2.release .....................***Failed    3.61 sec

64% tests passed, 5 tests failed out of 14

Total Test time (real) =   4.03 sec

The following tests FAILED:
	  9 - quick_tests/step-metis.mpirun=2.release (Failed)
	 10 - quick_tests/step-petsc.release (Failed)
	 11 - quick_tests/step-slepc.release (Failed)
	 12 - quick_tests/step.release (Failed)
	 13 - quick_tests/sundials-ida.release (Failed)
Errors while running CTest
Output from these tests are in: /usr/ports/math/deal.ii/work/.build/Testing/Temporary/LastTest.log
Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely.


**************************************************************************
**                                                                      **
**                Error: Some of the quick tests failed.                **
**                                                                      **
**************************************************************************

Check the files quick_tests.log and Testing/Temporary/LastTest.log located
in your build directory for error messages. Alternatively, you can run all
failing quick tests again via

        $ ctest --rerun-failed --output-on-failure -R quick_tests/

If you are unable to fix this problem, write to the mailing list linked at
https://www.dealii.org

CMake Error at /usr/ports/math/deal.ii/work/dealii-9.5.0/tests/run_quick_tests.cmake:100 (message):
  quick tests failed

LastTest.log has lines like these:

quick_tests/sundials-ida.release: BUILD successful.
quick_tests/sundials-ida.release: RUN failed. ------ Return code 134
quick_tests/sundials-ida.release: RUN failed. ------ Result: /usr/ports/math/deal.ii/work/.build/tests/quick_tests/sundials-ida.release/failing_output
quick_tests/sundials-ida.release: RUN failed. ------ Partial output:
OMP: Warning #96: Cannot form a team with 8 threads, using 2 instead.
OMP: Hint Consider unsetting KMP_DEVICE_THREAD_LIMIT (KMP_ALL_THREADS), KMP_TEAMS_THREAD_LIMIT, and OMP_THREAD_LIMIT (if any are set).


quick_tests/step.release: RUN failed. ------ Return code 255
quick_tests/step.release: RUN failed. ------ Result: /usr/ports/math/deal.ii/work/.build/tests/quick_tests/step.release/failing_output
quick_tests/step.release: RUN failed. ------ Partial output:
OMP: Warning #96: Cannot form a team with 8 threads, using 2 instead.
OMP: Hint Consider unsetting KMP_DEVICE_THREAD_LIMIT (KMP_ALL_THREADS), KMP_TEAMS_THREAD_LIMIT, and OMP_THREAD_LIMIT (if any are set).

Is there a way to disable OpenMP?

Version: 9.5.0
clang-15
FreeBSD 13.2

[tamiko]

@yurivict Can you test something for me please? Recompiling with -DFORCE_BUNDLED_KOKKOS=ON? (the bundled kokkos version builds without support for openmp.)

[yurivict]

@tamiko
With bundles kokkos all tests pass.

[tamiko]

@yurivict So what about setting FORCE_BUNDLED_KOKKOS for the time being?

The issue above is a bit tricky to resolve (because it mainly involves external dependencies with openmp support interacting with kokkos with openmp support, and what we set as environment in our test environment. deal.II itself does not use openmp for threading). It's unlikely that we will backport something to the 9.5.0 release and point releases.

[yurivict]

@tamiko

So what about setting FORCE_BUNDLED_KOKKOS for the time being?

That's exactly what I did.

[tamiko]

@yurivict Roger. I will close for the time being - we are tracking progress in this direction already in #14641