Skip to content

Conversation

@chapman39
Copy link
Collaborator

@chapman39 chapman39 commented Dec 16, 2025

this pr

status as of 2025-12-30

  • on toss4_cray, solid test is failing (output below)
  • on cuda docker container, hypre doesn't want to build with openblas, so i need to force it by setting virtuals manually(?)

related PRs

equation solver test failure output when hypre@3, petsc@3.21.6 on rzwhippet

solution for now: reverted to hypre@2.33.0

Newton iteration   4 : ||r|| =   1.57009e-16
[       OK ] AllEquationSolverTests/EquationSolverSuite.All/Newton_SuperLU_Petsc (0 ms)
[ RUN      ] AllEquationSolverTests/EquationSolverSuite.All/Newton_PetscCG_HypreJacobi
Newton iteration   0 : ||r|| =       1.17711
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Error in external library
[0]PETSC ERROR: Error in HYPRE_IJMatrixAssemble(): error code 1
[0]PETSC ERROR: WARNING! There are unused option(s) set! Could be the program crashed before usage or a spelling mistake, etc!
[0]PETSC ERROR:   Option left: name:-options_left value: no source: code
[0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
[0]PETSC ERROR: Petsc Release Version 3.21.6, Sep 28, 2024 
[0]PETSC ERROR: ./tests/equationsolver on a  named rzwhippet59 by meemee Fri Jan  2 13:44:03 2026
[0]PETSC ERROR: Configure options --prefix=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/petsc-3.21.6-tlx2pzidodi3u2lrbjaqd2dcwpwxj5tv --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=/usr/bin/make FFLAGS=-fPIC FOPTFLAGS= --with-cc=/usr/tce/packages/mvapich2/mvapich2-2.3.7-clang-19.1.3-magic/bin/mpicc --with-cxx=/usr/tce/packages/mvapich2/mvapich2-2.3.7-clang-19.1.3-magic/bin/mpicxx --with-fc=/usr/tce/packages/mvapich2/mvapich2-2.3.7-clang-19.1.3-magic/bin/mpif90 --with-fortran-bindings=1 --with-precision=double --with-scalar-type=real --with-shared-libraries=0 --with-debugging=0 --with-openmp=1 --with-64-bit-indices=0 --with-blaslapack-lib="/usr/lib64/liblapack.so /usr/lib64/libblas.so" --with-x=0 --with-sycl=0 --with-clanguage=C --with-cuda=0 --with-hip=0 --with-metis=1 --with-metis-include=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/metis-5.1.0-hdiwbpm3m76gvfzrr2x7ksv7tomrbh2p/include --with-metis-lib=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/metis-5.1.0-hdiwbpm3m76gvfzrr2x7ksv7tomrbh2p/lib/libmetis.a --with-hypre=1 --with-hypre-include=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/hypre-3.0.0-kqjln4f3xjqrr4conrjmqmp7lmdxm7mo/include --with-hypre-lib=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/hypre-3.0.0-kqjln4f3xjqrr4conrjmqmp7lmdxm7mo/lib64/libHYPRE.a --with-parmetis=1 --with-parmetis-include=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/parmetis-4.0.3-huj53popagizpjj5i2gxugq736eckv2u/include --with-parmetis-lib=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/parmetis-4.0.3-huj53popagizpjj5i2gxugq736eckv2u/lib/libparmetis.a --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=0 --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=0 --with-zlib=0 --with-mumps=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=1 --with-scalapack-lib=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/netlib-scalapack-2.2.2-bybea665m5fy73fp5tr5ijpugkuwlvjq/lib/libscalapack.so --with-strumpack=1 --with-strumpack-include=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/strumpack-8.0.0-2brrloawpzt5crcdsjnle4vdwrsb3p45/include --with-strumpack-lib=/usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/llvm-19.1.3/strumpack-8.0.0-2brrloawpzt5crcdsjnle4vdwrsb3p45/lib64/libstrumpack.a --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-trilinos=0 --with-trilinos=0 --with-trilinos=0 --with-cudac=0 --with-hipc=0
[0]PETSC ERROR: #1 MatAssemblyEnd_HYPRE() at /usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/build_stage/spack-stage-petsc-3.21.6-tlx2pzidodi3u2lrbjaqd2dcwpwxj5tv/spack-src/src/mat/impls/hypre/mhypre.c:1440
[0]PETSC ERROR: #2 MatAssemblyEnd() at /usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/build_stage/spack-stage-petsc-3.21.6-tlx2pzidodi3u2lrbjaqd2dcwpwxj5tv/spack-src/src/mat/interface/matrix.c:5820
[0]PETSC ERROR: #3 MatCreateFromParCSR() at /usr/WS2/meemee/smith/smith_tpls/toss_4_x86_64_ib/2025_12_19_13_28_00/build_stage/spack-stage-petsc-3.21.6-tlx2pzidodi3u2lrbjaqd2dcwpwxj5tv/spack-src/src/mat/impls/hypre/mhypre.c:1818
[0]PETSC ERROR: #4 void mfem::PetscParMatrix::ConvertOperator(MPI_Comm, const Operator &, Mat *, Operator::Type)() at /usr/WS2/meemee/smith/repo/mfem/linalg/petsc.cpp:1577


MFEM abort: Error in PETSc. See stacktrace above.
 ... in function: void mfem::PetscParMatrix::ConvertOperator(MPI_Comm, const Operator &, Mat *, Operator::Type)
 ... in file: /usr/WS2/meemee/smith/repo/mfem/linalg/petsc.cpp:1577

application called MPI_Abort(MPI_COMM_WORLD, 1) - process 0
[unset]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 1) - process 0
[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=1
:
system msg for write_line failure : Bad file descriptor
[rzwhippet59:mpi_rank_0][MPIDI_CH3_Abort] application called MPI_Abort(MPI_COMM_WORLD, 1) - process 0: Bad file descriptor (9)

rzwhippet solid test fail output

fails on release only

=============================================
Solve phase times:
=============================================
GMRES Solve:
  wall clock time = 0.000306 seconds
  wall MFLOPS     = 0.000000
  cpu clock time  = 0.000296 seconds
  cpu MFLOPS      = 0.000000

GMRES Iterations = 15
Final GMRES Relative Residual Norm = 6.15425e-07
Newton iteration  0 : ||r|| = 4.54391e-10
MPICH ERROR [Rank 0] [job id ] [Fri Jan  2 16:49:33 2026] [rzadams1001] - Abort(-1) (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, -1) - process 0

@chapman39 chapman39 self-assigned this Dec 16, 2025
@chapman39 chapman39 added the TPL Third-party libraries label Dec 16, 2025
@chapman39 chapman39 force-pushed the feature/chapman39/tpl-2025-12-15 branch from a44e1d3 to 09bb31f Compare December 18, 2025 17:23
@chapman39 chapman39 force-pushed the feature/chapman39/tpl-2025-12-15 branch from 09bb31f to 18cf423 Compare December 18, 2025 17:25
@white238
Copy link
Member

Heads up for you @chapman39 , Axom changed their default type for index:

https://github.com/llnl/axom/blob/623a1d9d139176737e2ce60c17c06cc2d2d40e89/RELEASE-NOTES.md?plain=1#L169

You will get a lot of warnings as errors.

@chapman39 chapman39 mentioned this pull request Dec 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

TPL Third-party libraries

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants