Installing MOOSE with GCC 7 and OpenMPI 4.0.1 #16546

jinca · 2020-12-18T21:23:30Z

jinca
Dec 18, 2020

Hello, I have used the following modules to compile MOOSE:
Currently Loaded Modulefiles:

slurm 3) turbovnc/2.0.1 5) singularity/current 7) cmake-3.9.4-gcc-5.4.0-fldgles 9) openmpi-4.0.1-gcc-7.2.0-myumaue
dot 4) vgl/2.5.1/64 6) rhel7/global 8) python/3.6 10) gcc/7

I was able to compiled PETSC and LibMesh, but I got the following errors when I run the tests:

geomsearch/2d_moving_penetration.pl_test4ns ............................................................... OK
samplers/base.global_vs_local/base_2rank ..................................................... [min_cpus=2] OK
time_integrators/convergence.implicit_astabledirk4_bootstrap/level1 ....................................... OK
materials/derivative_material_interface.ad_ordering/execution ............................................. OK
geomsearch/2d_moving_penetration.pl_test4qns .............................................................. OK
time_integrators/convergence.implicit_astabledirk4_bootstrap/level2 ....................................... OK
materials/derivative_material_interface.ad_new_getproperty_semantics ...................................... OK
materials/derivative_material_interface.ad_mutliblock ..................................................... OK
samplers/base.global_vs_local/base_3rank ..................................................... [min_cpus=3] OK
geomsearch/2d_moving_penetration.pl_test4nns .............................................................. OK
samplers/base.global_vs_local/rand_1rank .................................................................. OK
materials/material.exception/rank0 ................................................. [skipped dependency] SKIP
userobjects/threaded_general_user_object.thread_copies_guo/th3 ............................ [min_threads=3] OK
vectorpostprocessors/line_value_sampler.scaling ........................................................... OK
vectorpostprocessors/csv_reader.tester_fail ..................... [min_cpus=2] FAILED (EXPECTED ERROR MISSING)
preconditioners/hmg.hmg ........................................ [min_cpus=2] FAILED (EXPECTED OUTPUT MISSING)
outputs/json/distributed.info/default .................................... [min_cpus=2] FAILED (MISSING FILES)
preconditioners/hmg.hmg_3D ..................................... [min_cpus=2] FAILED (EXPECTED OUTPUT MISSING)
dgkernels/2d_diffusion_dg.proper_ghosting_with_action_parallel . [min_cpus=2] FAILED (EXPECTED OUTPUT MISSING)
misc/exception.parallel_error_residual_transient_non_zero_rank .. [min_cpus=2] FAILED (EXPECTED ERROR MISSING)
preconditioners/hmg.hmg_strumpack .............................. [min_cpus=2] FAILED (EXPECTED OUTPUT MISSING)
misc/exception.parallel_error_jacobian_transient_non_zero_rank .. [min_cpus=2] FAILED (EXPECTED ERROR MISSING)
reporters/mesh_info.info/files ........................................... [min_cpus=2] FAILED (MISSING FILES)
mesh/mesh_only.mesh_only_checkpoint ...................................... [min_cpus=3] FAILED (MISSING FILES)
mesh/splitting.check/pre_split ................................. [min_cpus=3] FAILED (EXPECTED OUTPUT MISSING)
mesh/splitting.check/forced_pre_split .......................... [min_cpus=3] FAILED (EXPECTED OUTPUT MISSING)
mesh/custom_partitioner.group/custom_linear_partitioner ........................ [min_cpus=2] FAILED (EXODIFF)
ics/depend_on_uo.ic_depend_on_uo ............................................... [min_cpus=2] FAILED (EXODIFF)
vectorpostprocessors/work_balance.work_balance/replicated ...................... [min_cpus=2] FAILED (CSVDIFF)
postprocessors/num_residual_eval.test .......................................... [min_cpus=2] FAILED (CSVDIFF)
restart/kernel_restartable.parallel_error/error1 ............................... [min_cpus=2] FAILED (EXODIFF)
ics/depend_on_uo.scalar_ic_from_uo ............................................. [min_cpus=2] FAILED (CSVDIFF)
userobjects/setup_interface_count.setup_interface_count/GeneralUserObject ...... [min_cpus=2] FAILED (CSVDIFF)
outputs/variables.nemesis_hide ................................................. [min_cpus=2] FAILED (EXODIFF)
misc/exception.parallel_exception_residual_transient_non_zero_rank ............. [min_cpus=2] FAILED (EXODIFF)
vectorpostprocessors/parallel_consistency.test ................................. [min_cpus=2] FAILED (EXODIFF)
transfers/multiapp_nearest_node_transfer.parallel .............................. [min_cpus=2] FAILED (EXODIFF)
misc/exception.parallel_exception_jacobian_transient_non_zero_rank ............. [min_cpus=2] FAILED (EXODIFF)
bcs/dmg_periodic.2d ............................................................ [min_cpus=2] FAILED (EXODIFF)
transfers/multiapp_vector_pp_transfer.vector_pp_transfer ....................... [min_cpus=2] FAILED (CSVDIFF)
bcs/periodic.testperiodic_dp ................................................... [min_cpus=2] FAILED (EXODIFF)
mesh/custom_partitioner.group/custom_linear_partitioner_displacement ........... [min_cpus=2] FAILED (EXODIFF)
interfaces/random.parallel_verification ........................................ [min_cpus=2] FAILED (EXODIFF)
vectorpostprocessors/parallel_consistency.broadcast ............................ [min_cpus=2] FAILED (EXODIFF)
bcs/dmg_periodic.3d ............................................................ [min_cpus=2] FAILED (EXODIFF)
interfacekernels/2d_interface.parallel_fdp_test ................................ [min_cpus=2] FAILED (EXODIFF)
mesh/checkpoint.test_2 ......................................................... [min_cpus=2] FAILED (EXODIFF)
meshgenerators/meta_data_store.test_meta_data_with_use_split ................... [min_cpus=2] FAILED (CSVDIFF)
bcs/dmg_periodic.1d ............................................................ [min_cpus=2] FAILED (EXODIFF)
mesh/checkpoint.test_2a ........................................................ [min_cpus=2] FAILED (EXODIFF)
interfaces/random.parallel_verification_uo ..................................... [min_cpus=2] FAILED (EXODIFF)
mesh/custom_partitioner.group/custom_linear_partitioner_restart ................ [min_cpus=2] FAILED (EXODIFF)
mesh/splitting.use_split ....................................................... [min_cpus=3] FAILED (EXODIFF)
geomsearch/penetration_locator.parallel_test ................................... [min_cpus=3] FAILED (EXODIFF)
auxkernels/vector_postprocessor_visualization.test ............................. [min_cpus=3] FAILED (EXODIFF)
interfaces/random.material_parallel ............................................ [min_cpus=2] FAILED (EXODIFF)
multiapps/max_procs_per_app.test ............................................... [min_cpus=3] FAILED (EXODIFF)
vectorpostprocessors/distributed.parallel_type/replicated ...................... [min_cpus=3] FAILED (CSVDIFF)
relationship_managers/evaluable.evaluable_neighbors_replicated ................. [min_cpus=3] FAILED (EXODIFF)
relationship_managers/evaluable.edge_neighbor .................................. [min_cpus=3] FAILED (EXODIFF)
relationship_managers/geometric_neighbors.geometric_edge_neighbor .............. [min_cpus=3] FAILED (EXODIFF)
outputs/reporters.csv/distributed .............................................. [min_cpus=3] FAILED (CSVDIFF)
vectorpostprocessors/line_value_sampler.parallel ............................... [min_cpus=3] FAILED (CSVDIFF)
materials/material.exception/rank1 ............................................. [min_cpus=4] FAILED (EXODIFF)

Ran 2410 tests in 861.8 seconds.
2360 passed, 97 skipped, 0 pending, 50 FAILED
MAX FAILURES REACHED

Answered by srinath-chakravarthy

Dec 18, 2020

./run_tests -j 4 should get rid of the failed tests

View full answer

srinath-chakravarthy · 2020-12-18T21:43:19Z

srinath-chakravarthy
Dec 18, 2020

./run_tests -j 4 should get rid of the failed tests

4 replies

jinca Dec 18, 2020
Author

Hi, thanks I did that after the installations, it is starting again:

./run_tests -j 4
reporters/mesh_info.info/default ..................................................... [PLATFORM!=DARWIN] SKIP
fvkernels/block-restriction.overlapping-mats ....................................... [METHOD!=DEVEL, DBG] SKIP
fvkernels/fv_simple_diffusion.unstructured-rz ................................ [AD_INDEXING_TYPE!=GLOBAL] SKIP
fvkernels/fv_adapt.steady-mms ................................................ [no pandas, no matplotlib] SKIP
fvkernels/fv_adapt.adapt ..................................................... [AD_INDEXING_TYPE!=GLOBAL] SKIP
fvkernels/fv-to-fe-coupling.deps-not-satisfied ..................................... [METHOD!=DEVEL, DBG] SKIP
fvkernels/mms/grad-reconstruction.extended-cartesian ......................... [AD_INDEXING_TYPE!=GLOBAL] SKIP
fvkernels/mms/grad-reconstruction.rz ......................................... [AD_INDEXING_TYPE!=GLOBAL] SKIP
fvkernels/mms/grad-reconstruction.cartesian .................................. [AD_INDEXING_TYPE!=GLOBAL] SKIP
fvkernels/mms/non-orthogonal.extended .............. [AD_INDEXING_TYPE!=GLOBAL, no pandas, no matplotlib] SKIP
fvkernels/mms/non-orthogonal.compact ............... [AD_INDEXING_TYPE!=GLOBAL, no pandas, no matplotlib] SKIP
outputs/nemesis.nemesis_elemental_distributed .................................. [MESH_MODE!=DISTRIBUTED] SKIP
outputs/nemesis.nemesis_scalar_distributed ..................................... [MESH_MODE!=DISTRIBUTED] SKIP
outputs/png.image_tests/wedge ............................................................ [LIBPNG!=TRUE] SKIP
outputs/png.image_tests/square_domain .................................................... [LIBPNG!=TRUE] SKIP
outputs/png.image_tests/adv_diff_reaction ................................................ [LIBPNG!=TRUE] SKIP
outputs/iterative.vtk ....................................................................... [VTK!=TRUE] SKIP
outputs/format.tecplot_bin_test_override ............................................... [TECPLOT!=FALSE] SKIP
outputs/vtk.solution/diff_serial_mesh_parallel .............................................. [VTK!=TRUE] SKIP
outputs/vtk.files/parallel .................................................................. [VTK!=TRUE] SKIP
outputs/vtk.solution/diff_serial_mesh ....................................................... [VTK!=TRUE] SKIP
outputs/vtk.solution/diff_parallel_mesh ...................... [#6149, MESH_MODE!=DISTRIBUTED, VTK!=TRUE] SKIP
outputs/vtk.files/serial .................................................................... [VTK!=TRUE] SKIP
auxkernels/solution_aux.aux_nonlinear_solution/from_xdr ........................ [--with-dof-id-bytes!=4] SKIP
transfers/multiapp_interpolation_transfer.fromsub_restricted ......................... [PLATFORM!=DARWIN] SKIP
reporters/constant_reporter.constant_reporter ............................................................. OK
reporters/iteration_info.info/default ..................................................................... OK
...

aeslaughter Dec 21, 2020

The skips listed here are normal, the failures you are seeing indicate that your MPI is not setup correctly. You should be able to get a more detailed error messages from one the failing tests, you can scroll up for the details or just run a single test, for example:

./run_tests --re=materials/material.exception/rank1

The -j will help the tests run through faster, but will not change the result. the [min_cpus=4] is just indicating that test requires 4 processors. It will run with 4 automatically.

GiudGiud Dec 21, 2020
Collaborator

Is this on INL HPC ?
What does 'which gcc; which mpicc' report ?
You want to make sure to compile with the compiler associated with your MPI distribution

jinca Dec 23, 2020
Author

I rerun again and I got this time 8 FAILS. This test is meant to have 0 FAILS?

outputs/xml.parallel/distributed ............................................................. [min_cpus=3] OK
outputs/xml.iterations .................................................................................... OK
meshgenerators/dmg_displaced_mesh.pbc/adaptivity_autoscaling .............................................. OK
meshgenerators/distributed_rectilinear_mesh_generator.mesh_adaptivity ..................................... OK
outputs/nemesis.nemesis_elemental_replicated ................................................. [min_cpus=4] OK
restart/kernel_restartable.thread_error/with_threads ...................................... [min_threads=4] OK
outputs/nemesis.nemesis_scalar_replicated .................................................... [min_cpus=4] OK
partitioners/petsc_partitioner.ptscotch ...................................................... [min_cpus=4] OK
mesh/nemesis.nemesis_repartitioning_test ..................................................... [min_cpus=4] OK
restart/kernel_restartable.thread_error/threads_error ..................................... [min_threads=2] OK
userobjects/threaded_general_user_object.thread_copies_guo/th4 ............................ [min_threads=4] OK
userobjects/threaded_general_user_object.thread_copies_guo/th5 ....... [min_threads=5,insufficient slots] SKIP
userobjects/threaded_general_user_object.thread_copies_guo/th6 ....... [insufficient slots,min_threads=6] SKIP
userobjects/threaded_general_user_object.thread_copies_guo/th7 ....... [min_threads=7,insufficient slots] SKIP
userobjects/threaded_general_user_object.thread_copies_guo/th8 ....... [insufficient slots,min_threads=8] SKIP
partitioners/petsc_partitioner.ptscotch_weight_elment ........................................ [min_cpus=4] OK
auxkernels/ghosting_aux.ghosting/show_with_local ............................................. [min_cpus=4] OK
auxkernels/ghosting_aux.no_algebraic_ghosting ................................................ [min_cpus=4] OK
partitioners/petsc_partitioner.ptscotch_weight_side .......................................... [min_cpus=4] OK
partitioners/petsc_partitioner.ptscotch_weight_both .......................................... [min_cpus=4] OK
partitioners/petsc_partitioner.parmetis ...................................................... [min_cpus=4] OK
partitioners/petsc_partitioner.parmetis_weight_element ....................................... [min_cpus=4] OK
partitioners/petsc_partitioner.parmetis_weight_side .......................................... [min_cpus=4] OK
partitioners/petsc_partitioner.parmetis_weight_both .......................................... [min_cpus=4] OK
partitioners/petsc_partitioner.parmetis_presplit_mesh ........................................ [min_cpus=2] OK
vectorpostprocessors/csv_reader.tester_fail ..................... [min_cpus=2] FAILED (EXPECTED ERROR MISSING)
bcs/dmg_periodic.1d ............................................................. [min_cpus=2] FAILED (ERRMSG)
misc/exception.parallel_error_residual_transient_non_zero_rank .. [min_cpus=2] FAILED (EXPECTED ERROR MISSING)
misc/exception.parallel_error_jacobian_transient_non_zero_rank ................ [min_cpus=2] FAILED (NO CRASH)
vectorpostprocessors/work_balance.work_balance/replicated ...................... [min_cpus=2] FAILED (CSVDIFF)
outputs/variables.nemesis_hide ................................................. [min_cpus=2] FAILED (EXODIFF)
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch .............. [min_cpus=4] FAILED (EXODIFF)
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out ............. [min_cpus=3] FAILED (EXODIFF)

Ran 2479 tests in 565.8 seconds.
2471 passed, 93 skipped, 0 pending, 8 FAILED

GiudGiud · 2020-12-23T02:44:29Z

GiudGiud
Dec 23, 2020
Collaborator

You should indeed have 0 fails in the test suite.
Could you please paste the error messages for each failed test?

1 reply

jinca Dec 25, 2020
Author

vectorpostprocessors/work_balance.work_balance/replicated ...................... [min_cpus=2] FAILED (CSVDIFF)

vectorpostprocessors/work_balance.work_balance/replicated: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/vectorpostprocessors/work_balance
vectorpostprocessors/work_balance.work_balance/replicated: Running command: mpiexec -n 2 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i work_balance.i --error --error-unused --error-override --no-gdb-backtrace
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Framework Information:
vectorpostprocessors/work_balance.work_balance/replicated: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
vectorpostprocessors/work_balance.work_balance/replicated: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
vectorpostprocessors/work_balance.work_balance/replicated: PETSc Version:           3.14.2
vectorpostprocessors/work_balance.work_balance/replicated: SLEPc Version:           3.14.0
vectorpostprocessors/work_balance.work_balance/replicated: Current Time:            Fri Dec 25 22:20:17 2020
vectorpostprocessors/work_balance.work_balance/replicated: Executable Timestamp:    Fri Dec 25 21:18:15 2020
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Parallelism:
vectorpostprocessors/work_balance.work_balance/replicated:   Num Processors:          2
vectorpostprocessors/work_balance.work_balance/replicated:   Num Threads:             1
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Mesh:
vectorpostprocessors/work_balance.work_balance/replicated:   Parallel Type:           replicated
vectorpostprocessors/work_balance.work_balance/replicated:   Mesh Dimension:          2
vectorpostprocessors/work_balance.work_balance/replicated:   Spatial Dimension:       2
vectorpostprocessors/work_balance.work_balance/replicated:   Nodes:
vectorpostprocessors/work_balance.work_balance/replicated:     Total:                 121
vectorpostprocessors/work_balance.work_balance/replicated:     Local:                 66
vectorpostprocessors/work_balance.work_balance/replicated:   Elems:
vectorpostprocessors/work_balance.work_balance/replicated:     Total:                 100
vectorpostprocessors/work_balance.work_balance/replicated:     Local:                 50
vectorpostprocessors/work_balance.work_balance/replicated:   Num Subdomains:          1
vectorpostprocessors/work_balance.work_balance/replicated:   Num Partitions:          2
vectorpostprocessors/work_balance.work_balance/replicated:   Partitioner:             linear
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Nonlinear System:
vectorpostprocessors/work_balance.work_balance/replicated:   Num DOFs:                121
vectorpostprocessors/work_balance.work_balance/replicated:   Num Local DOFs:          66
vectorpostprocessors/work_balance.work_balance/replicated:   Variables:               "u"
vectorpostprocessors/work_balance.work_balance/replicated:   Finite Element Types:    "LAGRANGE"
vectorpostprocessors/work_balance.work_balance/replicated:   Approximation Orders:    "FIRST"
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Auxiliary System:
vectorpostprocessors/work_balance.work_balance/replicated:   Num DOFs:                221
vectorpostprocessors/work_balance.work_balance/replicated:   Num Local DOFs:          116
vectorpostprocessors/work_balance.work_balance/replicated:   Variables:               "someaux" "otheraux"
vectorpostprocessors/work_balance.work_balance/replicated:   Finite Element Types:    "LAGRANGE" "MONOMIAL"
vectorpostprocessors/work_balance.work_balance/replicated:   Approximation Orders:    "FIRST" "CONSTANT"
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Execution Information:
vectorpostprocessors/work_balance.work_balance/replicated:   Executioner:             Steady
vectorpostprocessors/work_balance.work_balance/replicated:   Solver Mode:             Preconditioned JFNK
vectorpostprocessors/work_balance.work_balance/replicated:   PETSc Preconditioner:    hypre boomeramg
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated:  0 Nonlinear |R| = 3.082207e+00
vectorpostprocessors/work_balance.work_balance/replicated:       0 Linear |R| = 3.082207e+00
vectorpostprocessors/work_balance.work_balance/replicated:       1 Linear |R| = 1.109669e-01
vectorpostprocessors/work_balance.work_balance/replicated:       2 Linear |R| = 4.138566e-03
vectorpostprocessors/work_balance.work_balance/replicated:       3 Linear |R| = 1.332120e-04
vectorpostprocessors/work_balance.work_balance/replicated:       4 Linear |R| = 3.761998e-06
vectorpostprocessors/work_balance.work_balance/replicated:   Linear solve converged due to CONVERGED_RTOL iterations 4
vectorpostprocessors/work_balance.work_balance/replicated:  1 Nonlinear |R| = 3.747395e-06
vectorpostprocessors/work_balance.work_balance/replicated:       0 Linear |R| = 3.747395e-06
vectorpostprocessors/work_balance.work_balance/replicated:       1 Linear |R| = 1.565163e-07
vectorpostprocessors/work_balance.work_balance/replicated:       2 Linear |R| = 3.823892e-09
vectorpostprocessors/work_balance.work_balance/replicated:       3 Linear |R| = 1.288260e-10
vectorpostprocessors/work_balance.work_balance/replicated:       4 Linear |R| = 2.866952e-12
vectorpostprocessors/work_balance.work_balance/replicated:   Linear solve converged due to CONVERGED_RTOL iterations 4
vectorpostprocessors/work_balance.work_balance/replicated:  2 Nonlinear |R| = 2.864804e-12
vectorpostprocessors/work_balance.work_balance/replicated: Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 2
vectorpostprocessors/work_balance.work_balance/replicated:  Solve Converged!
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Framework Information:
vectorpostprocessors/work_balance.work_balance/replicated: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
vectorpostprocessors/work_balance.work_balance/replicated: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
vectorpostprocessors/work_balance.work_balance/replicated: PETSc Version:           3.14.2
vectorpostprocessors/work_balance.work_balance/replicated: SLEPc Version:           3.14.0
vectorpostprocessors/work_balance.work_balance/replicated: Current Time:            Fri Dec 25 22:20:17 2020
vectorpostprocessors/work_balance.work_balance/replicated: Executable Timestamp:    Fri Dec 25 21:18:15 2020
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Parallelism:
vectorpostprocessors/work_balance.work_balance/replicated:   Num Processors:          2
vectorpostprocessors/work_balance.work_balance/replicated:   Num Threads:             1
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Mesh:
vectorpostprocessors/work_balance.work_balance/replicated:   Parallel Type:           replicated
vectorpostprocessors/work_balance.work_balance/replicated:   Mesh Dimension:          2
vectorpostprocessors/work_balance.work_balance/replicated:   Spatial Dimension:       2
vectorpostprocessors/work_balance.work_balance/replicated:   Nodes:
vectorpostprocessors/work_balance.work_balance/replicated:     Total:                 121
vectorpostprocessors/work_balance.work_balance/replicated:     Local:                 66
vectorpostprocessors/work_balance.work_balance/replicated:   Elems:
vectorpostprocessors/work_balance.work_balance/replicated:     Total:                 100
vectorpostprocessors/work_balance.work_balance/replicated:     Local:                 50
vectorpostprocessors/work_balance.work_balance/replicated:   Num Subdomains:          1
vectorpostprocessors/work_balance.work_balance/replicated:   Num Partitions:          2
vectorpostprocessors/work_balance.work_balance/replicated:   Partitioner:             linear
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Nonlinear System:
vectorpostprocessors/work_balance.work_balance/replicated:   Num DOFs:                121
vectorpostprocessors/work_balance.work_balance/replicated:   Num Local DOFs:          66
vectorpostprocessors/work_balance.work_balance/replicated:   Variables:               "u"
vectorpostprocessors/work_balance.work_balance/replicated:   Finite Element Types:    "LAGRANGE"
vectorpostprocessors/work_balance.work_balance/replicated:   Approximation Orders:    "FIRST"
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Auxiliary System:
vectorpostprocessors/work_balance.work_balance/replicated:   Num DOFs:                221
vectorpostprocessors/work_balance.work_balance/replicated:   Num Local DOFs:          116
vectorpostprocessors/work_balance.work_balance/replicated:   Variables:               "someaux" "otheraux"
vectorpostprocessors/work_balance.work_balance/replicated:   Finite Element Types:    "LAGRANGE" "MONOMIAL"
vectorpostprocessors/work_balance.work_balance/replicated:   Approximation Orders:    "FIRST" "CONSTANT"
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: Execution Information:
vectorpostprocessors/work_balance.work_balance/replicated:   Executioner:             Steady
vectorpostprocessors/work_balance.work_balance/replicated:   Solver Mode:             Preconditioned JFNK
vectorpostprocessors/work_balance.work_balance/replicated:   PETSc Preconditioner:    hypre boomeramg
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated:  0 Nonlinear |R| = 3.082207e+00
vectorpostprocessors/work_balance.work_balance/replicated:       0 Linear |R| = 3.082207e+00
vectorpostprocessors/work_balance.work_balance/replicated:       1 Linear |R| = 1.109669e-01
vectorpostprocessors/work_balance.work_balance/replicated:       2 Linear |R| = 4.138566e-03
vectorpostprocessors/work_balance.work_balance/replicated:       3 Linear |R| = 1.332120e-04
vectorpostprocessors/work_balance.work_balance/replicated:       4 Linear |R| = 3.761998e-06
vectorpostprocessors/work_balance.work_balance/replicated:   Linear solve converged due to CONVERGED_RTOL iterations 4
vectorpostprocessors/work_balance.work_balance/replicated:  1 Nonlinear |R| = 3.747395e-06
vectorpostprocessors/work_balance.work_balance/replicated:       0 Linear |R| = 3.747395e-06
vectorpostprocessors/work_balance.work_balance/replicated:       1 Linear |R| = 1.565163e-07
vectorpostprocessors/work_balance.work_balance/replicated:       2 Linear |R| = 3.823892e-09
vectorpostprocessors/work_balance.work_balance/replicated:       3 Linear |R| = 1.288260e-10
vectorpostprocessors/work_balance.work_balance/replicated:       4 Linear |R| = 2.866952e-12
vectorpostprocessors/work_balance.work_balance/replicated:   Linear solve converged due to CONVERGED_RTOL iterations 4
vectorpostprocessors/work_balance.work_balance/replicated:  2 Nonlinear |R| = 2.864804e-12
vectorpostprocessors/work_balance.work_balance/replicated: Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 2
vectorpostprocessors/work_balance.work_balance/replicated:  Solve Converged!
vectorpostprocessors/work_balance.work_balance/replicated: Running csvdiff: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/python/mooseutils/csvdiff.py /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/vectorpostprocessors/work_balance/gold/work_balance_out_all_wb_0000.csv /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/vectorpostprocessors/work_balance/work_balance_out_all_wb_0000.csv --relative-tolerance 5.5e-06 --abs-zero 1e-10
vectorpostprocessors/work_balance.work_balance/replicated: ERROR: In file work_balance_out_all_wb_0000.csv: The values in column "num_partition_hardware_id_sides" don't match @ t0
vectorpostprocessors/work_balance.work_balance/replicated: 	relative diff:   0.000e+00 ~ 1.000e+01 = 1.000e+00 (1.000e+00)
vectorpostprocessors/work_balance.work_balance/replicated: In file work_balance_out_all_wb_0000.csv: The values in column "partition_hardware_id_surface_area" don't match @ t0
vectorpostprocessors/work_balance.work_balance/replicated: 	relative diff:   0.000e+00 ~ 1.000e+00 = 1.000e+00 (1.000e+00)
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated: ################################################################################
vectorpostprocessors/work_balance.work_balance/replicated: Tester failed, reason: CSVDIFF
vectorpostprocessors/work_balance.work_balance/replicated:
vectorpostprocessors/work_balance.work_balance/replicated ...................... [min_cpus=2] FAILED (CSVDIFF)

misc/exception.parallel_error_residual_transient_non_zero_rank ................ [min_cpus=2] FAILED (NO CRASH)

misc/exception.parallel_error_residual_transient_non_zero_rank: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/misc/exception
misc/exception.parallel_error_residual_transient_non_zero_rank: Running command: mpiexec -n 2 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i parallel_exception_residual_transient.i Kernels/exception/rank=1 Kernels/exception/should_throw=false Outputs/exodus=false --error --error-unused --error-override --no-gdb-backtrace --keep-cout --redirect-output parallel_error_residual_transient_non_zero_rank
misc/exception.parallel_error_residual_transient_non_zero_rank:   Linear solve converged due to CONVERGED_RTOL iterations 2
misc/exception.parallel_error_residual_transient_non_zero_rank: --------------------------------------------------------------------------
misc/exception.parallel_error_residual_transient_non_zero_rank: MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
misc/exception.parallel_error_residual_transient_non_zero_rank: with errorcode 1.
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
misc/exception.parallel_error_residual_transient_non_zero_rank: You may or may not see output from other processes, depending on
misc/exception.parallel_error_residual_transient_non_zero_rank: exactly when Open MPI kills them.
misc/exception.parallel_error_residual_transient_non_zero_rank: --------------------------------------------------------------------------
misc/exception.parallel_error_residual_transient_non_zero_rank: srun: Job step aborted: Waiting up to 122 seconds for job step to finish.
misc/exception.parallel_error_residual_transient_non_zero_rank: slurmstepd: error: *** STEP 32642259.136 ON cpu-p-628 CANCELLED AT 2020-12-25T22:22:09 ***
misc/exception.parallel_error_residual_transient_non_zero_rank: srun: error: cpu-p-629: task 1: Segmentation fault
misc/exception.parallel_error_residual_transient_non_zero_rank: srun: error: cpu-p-628: task 0: Killed
misc/exception.parallel_error_residual_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_residual_transient_non_zero_rank: Output from /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/misc/exception/parallel_error_residual_transient_non_zero_rank.processor.0
misc/exception.parallel_error_residual_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Framework Information:
misc/exception.parallel_error_residual_transient_non_zero_rank: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
misc/exception.parallel_error_residual_transient_non_zero_rank: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
misc/exception.parallel_error_residual_transient_non_zero_rank: PETSc Version:           3.14.2
misc/exception.parallel_error_residual_transient_non_zero_rank: SLEPc Version:           3.14.0
misc/exception.parallel_error_residual_transient_non_zero_rank: Current Time:            Fri Dec 25 22:22:09 2020
misc/exception.parallel_error_residual_transient_non_zero_rank: Executable Timestamp:    Fri Dec 25 21:18:15 2020
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Parallelism:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Processors:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Threads:             1
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Mesh:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Parallel Type:           replicated
misc/exception.parallel_error_residual_transient_non_zero_rank:   Mesh Dimension:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Spatial Dimension:       2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Nodes:
misc/exception.parallel_error_residual_transient_non_zero_rank:     Total:                 72
misc/exception.parallel_error_residual_transient_non_zero_rank:     Local:                 36
misc/exception.parallel_error_residual_transient_non_zero_rank:   Elems:
misc/exception.parallel_error_residual_transient_non_zero_rank:     Total:                 50
misc/exception.parallel_error_residual_transient_non_zero_rank:     Local:                 25
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Subdomains:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Partitions:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Partitioner:             metis
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Nonlinear System:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num DOFs:                72
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Local DOFs:          36
misc/exception.parallel_error_residual_transient_non_zero_rank:   Variables:               "u"
misc/exception.parallel_error_residual_transient_non_zero_rank:   Finite Element Types:    "LAGRANGE"
misc/exception.parallel_error_residual_transient_non_zero_rank:   Approximation Orders:    "FIRST"
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Execution Information:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Executioner:             Transient
misc/exception.parallel_error_residual_transient_non_zero_rank:   TimeStepper:             ConstantDT
misc/exception.parallel_error_residual_transient_non_zero_rank:   Solver Mode:             Preconditioned JFNK
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Time Step 0, time = 0
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Time Step 1, time = 0.01, dt = 0.01
misc/exception.parallel_error_residual_transient_non_zero_rank:  0 Nonlinear |R| = 7.071068e-01
misc/exception.parallel_error_residual_transient_non_zero_rank:       0 Linear |R| = 7.071068e-01
misc/exception.parallel_error_residual_transient_non_zero_rank:       1 Linear |R| = 1.290385e-03
misc/exception.parallel_error_residual_transient_non_zero_rank:       2 Linear |R| = 4.866985e-06
misc/exception.parallel_error_residual_transient_non_zero_rank:  1 Nonlinear |R| = 4.866755e-06
misc/exception.parallel_error_residual_transient_non_zero_rank:       0 Linear |R| = 4.866755e-06
misc/exception.parallel_error_residual_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_residual_transient_non_zero_rank: Output from /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/misc/exception/parallel_error_residual_transient_non_zero_rank.processor.1
misc/exception.parallel_error_residual_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Framework Information:
misc/exception.parallel_error_residual_transient_non_zero_rank: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
misc/exception.parallel_error_residual_transient_non_zero_rank: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
misc/exception.parallel_error_residual_transient_non_zero_rank: PETSc Version:           3.14.2
misc/exception.parallel_error_residual_transient_non_zero_rank: SLEPc Version:           3.14.0
misc/exception.parallel_error_residual_transient_non_zero_rank: Current Time:            Fri Dec 25 22:22:03 2020
misc/exception.parallel_error_residual_transient_non_zero_rank: Executable Timestamp:    Fri Dec 25 21:18:15 2020
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Parallelism:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Processors:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Threads:             1
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Mesh:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Parallel Type:           replicated
misc/exception.parallel_error_residual_transient_non_zero_rank:   Mesh Dimension:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Spatial Dimension:       2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Nodes:
misc/exception.parallel_error_residual_transient_non_zero_rank:     Total:                 72
misc/exception.parallel_error_residual_transient_non_zero_rank:     Local:                 36
misc/exception.parallel_error_residual_transient_non_zero_rank:   Elems:
misc/exception.parallel_error_residual_transient_non_zero_rank:     Total:                 50
misc/exception.parallel_error_residual_transient_non_zero_rank:     Local:                 25
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Subdomains:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Partitions:          2
misc/exception.parallel_error_residual_transient_non_zero_rank:   Partitioner:             metis
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Nonlinear System:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num DOFs:                72
misc/exception.parallel_error_residual_transient_non_zero_rank:   Num Local DOFs:          36
misc/exception.parallel_error_residual_transient_non_zero_rank:   Variables:               "u"
misc/exception.parallel_error_residual_transient_non_zero_rank:   Finite Element Types:    "LAGRANGE"
misc/exception.parallel_error_residual_transient_non_zero_rank:   Approximation Orders:    "FIRST"
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Execution Information:
misc/exception.parallel_error_residual_transient_non_zero_rank:   Executioner:             Transient
misc/exception.parallel_error_residual_transient_non_zero_rank:   TimeStepper:             ConstantDT
misc/exception.parallel_error_residual_transient_non_zero_rank:   Solver Mode:             Preconditioned JFNK
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Time Step 0, time = 0
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: Time Step 1, time = 0.01, dt = 0.01
misc/exception.parallel_error_residual_transient_non_zero_rank:  0 Nonlinear |R| = 7.071068e-01
misc/exception.parallel_error_residual_transient_non_zero_rank:       0 Linear |R| = 7.071068e-01
misc/exception.parallel_error_residual_transient_non_zero_rank:       1 Linear |R| = 1.290385e-03
misc/exception.parallel_error_residual_transient_non_zero_rank:       2 Linear |R| = 4.866985e-06
misc/exception.parallel_error_residual_transient_non_zero_rank:  1 Nonlinear |R| = 4.866755e-06
misc/exception.parallel_error_residual_transient_non_zero_rank:       0 Linear |R| = 4.866755e-06
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: *** ERROR ***
misc/exception.parallel_error_residual_transient_non_zero_rank: Intentional error triggered during residual calculation
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_residual_transient_non_zero_rank: Tester failed, reason: NO CRASH
misc/exception.parallel_error_residual_transient_non_zero_rank:
misc/exception.parallel_error_residual_transient_non_zero_rank ................ [min_cpus=2] FAILED (NO CRASH)

bcs/dmg_periodic.1d ............................................................. [min_cpus=2] FAILED (ERRMSG)

bcs/dmg_periodic.1d: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/bcs/dmg_periodic
bcs/dmg_periodic.1d: Running command: mpiexec -n 2 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i dmg_periodic_bc.i Outputs/hide="pid" Outputs/file_base=dmg_periodic_bc_out_1d Mesh/dmg/dim=1 Mesh/dmg/nx=100 Mesh/dmg/ny=0 Mesh/dmg/ymax=0 BCs/Periodic/all/auto_direction="x" AuxKernels/periodic_dist/point="1 0 0" Kernels/forcing/y_center=0 Kernels/forcing/amplitude=0.1 Kernels/forcing/x_center=0 --error --error-unused --error-override --no-gdb-backtrace
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: *** ERROR ***
bcs/dmg_periodic.1d: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/bcs/dmg_periodic/dmg_periodic_bc.i:62: wrong number of values in scalar component parameter AuxKernels/periodic_dist/point: size 1 is not a multiple of 3
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d: MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
bcs/dmg_periodic.1d: with errorcode 1.
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
bcs/dmg_periodic.1d: You may or may not see output from other processes, depending on
bcs/dmg_periodic.1d: exactly when Open MPI kills them.
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: *** ERROR ***
bcs/dmg_periodic.1d: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/bcs/dmg_periodic/dmg_periodic_bc.i:62: wrong number of values in scalar component parameter AuxKernels/periodic_dist/point: size 1 is not a multiple of 3
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d: MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
bcs/dmg_periodic.1d: with errorcode 1.
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
bcs/dmg_periodic.1d: You may or may not see output from other processes, depending on
bcs/dmg_periodic.1d: exactly when Open MPI kills them.
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d: srun: Job step aborted: Waiting up to 122 seconds for job step to finish.
bcs/dmg_periodic.1d: slurmstepd: error: *** STEP 32642259.156 ON cpu-p-628 CANCELLED AT 2020-12-25T22:22:20 ***
bcs/dmg_periodic.1d: srun: error: cpu-p-629: task 1: Exited with exit code 1
bcs/dmg_periodic.1d: srun: error: cpu-p-628: task 0: Exited with exit code 1
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: *** ERROR ***
bcs/dmg_periodic.1d: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/bcs/dmg_periodic/dmg_periodic_bc.i:62: wrong number of values in scalar component parameter AuxKernels/periodic_dist/point: size 1 is not a multiple of 3
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d: MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
bcs/dmg_periodic.1d: with errorcode 1.
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
bcs/dmg_periodic.1d: You may or may not see output from other processes, depending on
bcs/dmg_periodic.1d: exactly when Open MPI kills them.
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: *** ERROR ***
bcs/dmg_periodic.1d: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/bcs/dmg_periodic/dmg_periodic_bc.i:62: wrong number of values in scalar component parameter AuxKernels/periodic_dist/point: size 1 is not a multiple of 3
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d: MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
bcs/dmg_periodic.1d: with errorcode 1.
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
bcs/dmg_periodic.1d: You may or may not see output from other processes, depending on
bcs/dmg_periodic.1d: exactly when Open MPI kills them.
bcs/dmg_periodic.1d: --------------------------------------------------------------------------
bcs/dmg_periodic.1d: srun: Job step aborted: Waiting up to 122 seconds for job step to finish.
bcs/dmg_periodic.1d: slurmstepd: error: *** STEP 32642259.156 ON cpu-p-628 CANCELLED AT 2020-12-25T22:22:20 ***
bcs/dmg_periodic.1d: srun: error: cpu-p-629: task 1: Exited with exit code 1
bcs/dmg_periodic.1d: srun: error: cpu-p-628: task 0: Exited with exit code 1
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d: Exit Code: 0
bcs/dmg_periodic.1d: ################################################################################
bcs/dmg_periodic.1d: Tester failed, reason: ERRMSG
bcs/dmg_periodic.1d:
bcs/dmg_periodic.1d ............................................................. [min_cpus=2] FAILED (ERRMSG)

misc/exception.parallel_error_jacobian_transient_non_zero_rank ................ [min_cpus=2] FAILED (NO CRASH)

misc/exception.parallel_error_jacobian_transient_non_zero_rank: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/misc/exception
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Running command: mpiexec -n 2 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i parallel_exception_residual_transient.i Kernels/exception/rank=1 Kernels/exception/should_throw=false Outputs/exodus=false --error --error-unused --error-override --no-gdb-backtrace --keep-cout --redirect-output parallel_error_jacobian_transient_non_zero_rank
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Linear solve converged due to CONVERGED_RTOL iterations 2
misc/exception.parallel_error_jacobian_transient_non_zero_rank: --------------------------------------------------------------------------
misc/exception.parallel_error_jacobian_transient_non_zero_rank: MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
misc/exception.parallel_error_jacobian_transient_non_zero_rank: with errorcode 1.
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
misc/exception.parallel_error_jacobian_transient_non_zero_rank: You may or may not see output from other processes, depending on
misc/exception.parallel_error_jacobian_transient_non_zero_rank: exactly when Open MPI kills them.
misc/exception.parallel_error_jacobian_transient_non_zero_rank: --------------------------------------------------------------------------
misc/exception.parallel_error_jacobian_transient_non_zero_rank: srun: Job step aborted: Waiting up to 122 seconds for job step to finish.
misc/exception.parallel_error_jacobian_transient_non_zero_rank: slurmstepd: error: *** STEP 32642259.158 ON cpu-p-628 CANCELLED AT 2020-12-25T22:22:21 ***
misc/exception.parallel_error_jacobian_transient_non_zero_rank: srun: error: cpu-p-629: task 1: Segmentation fault
misc/exception.parallel_error_jacobian_transient_non_zero_rank: srun: error: cpu-p-628: task 0: Killed
misc/exception.parallel_error_jacobian_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Output from /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/misc/exception/parallel_error_jacobian_transient_non_zero_rank.processor.0
misc/exception.parallel_error_jacobian_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Framework Information:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
misc/exception.parallel_error_jacobian_transient_non_zero_rank: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
misc/exception.parallel_error_jacobian_transient_non_zero_rank: PETSc Version:           3.14.2
misc/exception.parallel_error_jacobian_transient_non_zero_rank: SLEPc Version:           3.14.0
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Current Time:            Fri Dec 25 22:22:21 2020
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Executable Timestamp:    Fri Dec 25 21:18:15 2020
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Parallelism:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Processors:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Threads:             1
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Mesh:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Parallel Type:           replicated
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Mesh Dimension:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Spatial Dimension:       2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Nodes:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Total:                 72
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Local:                 36
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Elems:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Total:                 50
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Local:                 25
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Subdomains:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Partitions:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Partitioner:             metis
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Nonlinear System:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num DOFs:                72
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Local DOFs:          36
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Variables:               "u"
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Finite Element Types:    "LAGRANGE"
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Approximation Orders:    "FIRST"
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Execution Information:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Executioner:             Transient
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   TimeStepper:             ConstantDT
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Solver Mode:             Preconditioned JFNK
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Time Step 0, time = 0
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Time Step 1, time = 0.01, dt = 0.01
misc/exception.parallel_error_jacobian_transient_non_zero_rank:  0 Nonlinear |R| = 7.071068e-01
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       0 Linear |R| = 7.071068e-01
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       1 Linear |R| = 1.290385e-03
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       2 Linear |R| = 4.866985e-06
misc/exception.parallel_error_jacobian_transient_non_zero_rank:  1 Nonlinear |R| = 4.866755e-06
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       0 Linear |R| = 4.866755e-06
misc/exception.parallel_error_jacobian_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Output from /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/misc/exception/parallel_error_jacobian_transient_non_zero_rank.processor.1
misc/exception.parallel_error_jacobian_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Framework Information:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
misc/exception.parallel_error_jacobian_transient_non_zero_rank: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
misc/exception.parallel_error_jacobian_transient_non_zero_rank: PETSc Version:           3.14.2
misc/exception.parallel_error_jacobian_transient_non_zero_rank: SLEPc Version:           3.14.0
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Current Time:            Fri Dec 25 22:22:15 2020
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Executable Timestamp:    Fri Dec 25 21:18:15 2020
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Parallelism:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Processors:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Threads:             1
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Mesh:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Parallel Type:           replicated
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Mesh Dimension:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Spatial Dimension:       2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Nodes:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Total:                 72
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Local:                 36
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Elems:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Total:                 50
misc/exception.parallel_error_jacobian_transient_non_zero_rank:     Local:                 25
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Subdomains:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Partitions:          2
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Partitioner:             metis
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Nonlinear System:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num DOFs:                72
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Num Local DOFs:          36
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Variables:               "u"
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Finite Element Types:    "LAGRANGE"
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Approximation Orders:    "FIRST"
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Execution Information:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Executioner:             Transient
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   TimeStepper:             ConstantDT
misc/exception.parallel_error_jacobian_transient_non_zero_rank:   Solver Mode:             Preconditioned JFNK
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Time Step 0, time = 0
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Time Step 1, time = 0.01, dt = 0.01
misc/exception.parallel_error_jacobian_transient_non_zero_rank:  0 Nonlinear |R| = 7.071068e-01
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       0 Linear |R| = 7.071068e-01
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       1 Linear |R| = 1.290385e-03
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       2 Linear |R| = 4.866985e-06
misc/exception.parallel_error_jacobian_transient_non_zero_rank:  1 Nonlinear |R| = 4.866755e-06
misc/exception.parallel_error_jacobian_transient_non_zero_rank:       0 Linear |R| = 4.866755e-06
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: *** ERROR ***
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Intentional error triggered during residual calculation
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank: ################################################################################
misc/exception.parallel_error_jacobian_transient_non_zero_rank: Tester failed, reason: NO CRASH
misc/exception.parallel_error_jacobian_transient_non_zero_rank:
misc/exception.parallel_error_jacobian_transient_non_zero_rank ................ [min_cpus=2] FAILED (NO CRASH)

vectorpostprocessors/csv_reader.tester_fail ................................... [min_cpus=2] FAILED (NO CRASH)

vectorpostprocessors/csv_reader.tester_fail: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/vectorpostprocessors/csv_reader
vectorpostprocessors/csv_reader.tester_fail: Running command: mpiexec -n 2 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i read.i UserObjects/tester/rank=1 UserObjects/tester/gold='1 2 3' Outputs/csv=false --error --error-unused --error-override --no-gdb-backtrace --keep-cout --redirect-output tester_fail
vectorpostprocessors/csv_reader.tester_fail: --------------------------------------------------------------------------
vectorpostprocessors/csv_reader.tester_fail: MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
vectorpostprocessors/csv_reader.tester_fail: with errorcode 1.
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
vectorpostprocessors/csv_reader.tester_fail: You may or may not see output from other processes, depending on
vectorpostprocessors/csv_reader.tester_fail: exactly when Open MPI kills them.
vectorpostprocessors/csv_reader.tester_fail: --------------------------------------------------------------------------
vectorpostprocessors/csv_reader.tester_fail: srun: Job step aborted: Waiting up to 122 seconds for job step to finish.
vectorpostprocessors/csv_reader.tester_fail: slurmstepd: error: *** STEP 32642259.162 ON cpu-p-628 CANCELLED AT 2020-12-25T22:22:23 ***
vectorpostprocessors/csv_reader.tester_fail: srun: error: cpu-p-629: task 1: Killed
vectorpostprocessors/csv_reader.tester_fail: srun: error: cpu-p-628: task 0: Killed
vectorpostprocessors/csv_reader.tester_fail: ################################################################################
vectorpostprocessors/csv_reader.tester_fail: Output from /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/vectorpostprocessors/csv_reader/tester_fail.processor.0
vectorpostprocessors/csv_reader.tester_fail: ################################################################################
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Framework Information:
vectorpostprocessors/csv_reader.tester_fail: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
vectorpostprocessors/csv_reader.tester_fail: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
vectorpostprocessors/csv_reader.tester_fail: PETSc Version:           3.14.2
vectorpostprocessors/csv_reader.tester_fail: SLEPc Version:           3.14.0
vectorpostprocessors/csv_reader.tester_fail: Current Time:            Fri Dec 25 22:22:23 2020
vectorpostprocessors/csv_reader.tester_fail: Executable Timestamp:    Fri Dec 25 21:18:15 2020
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Parallelism:
vectorpostprocessors/csv_reader.tester_fail:   Num Processors:          2
vectorpostprocessors/csv_reader.tester_fail:   Num Threads:             1
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Mesh:
vectorpostprocessors/csv_reader.tester_fail:   Parallel Type:           replicated
vectorpostprocessors/csv_reader.tester_fail:   Mesh Dimension:          1
vectorpostprocessors/csv_reader.tester_fail:   Spatial Dimension:       1
vectorpostprocessors/csv_reader.tester_fail:   Nodes:
vectorpostprocessors/csv_reader.tester_fail:     Total:                 2
vectorpostprocessors/csv_reader.tester_fail:     Local:                 2
vectorpostprocessors/csv_reader.tester_fail:   Elems:
vectorpostprocessors/csv_reader.tester_fail:     Total:                 1
vectorpostprocessors/csv_reader.tester_fail:     Local:                 1
vectorpostprocessors/csv_reader.tester_fail:   Num Subdomains:          1
vectorpostprocessors/csv_reader.tester_fail:   Num Partitions:          1
vectorpostprocessors/csv_reader.tester_fail:   Partitioner:             metis
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Execution Information:
vectorpostprocessors/csv_reader.tester_fail:   Executioner:             Steady
vectorpostprocessors/csv_reader.tester_fail:   Solver Mode:             Preconditioned JFNK
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail:  Solve Skipped!
vectorpostprocessors/csv_reader.tester_fail: ################################################################################
vectorpostprocessors/csv_reader.tester_fail: Output from /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/vectorpostprocessors/csv_reader/tester_fail.processor.1
vectorpostprocessors/csv_reader.tester_fail: ################################################################################
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Framework Information:
vectorpostprocessors/csv_reader.tester_fail: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
vectorpostprocessors/csv_reader.tester_fail: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
vectorpostprocessors/csv_reader.tester_fail: PETSc Version:           3.14.2
vectorpostprocessors/csv_reader.tester_fail: SLEPc Version:           3.14.0
vectorpostprocessors/csv_reader.tester_fail: Current Time:            Fri Dec 25 22:22:17 2020
vectorpostprocessors/csv_reader.tester_fail: Executable Timestamp:    Fri Dec 25 21:18:15 2020
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Parallelism:
vectorpostprocessors/csv_reader.tester_fail:   Num Processors:          2
vectorpostprocessors/csv_reader.tester_fail:   Num Threads:             1
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Mesh:
vectorpostprocessors/csv_reader.tester_fail:   Parallel Type:           replicated
vectorpostprocessors/csv_reader.tester_fail:   Mesh Dimension:          1
vectorpostprocessors/csv_reader.tester_fail:   Spatial Dimension:       1
vectorpostprocessors/csv_reader.tester_fail:   Nodes:
vectorpostprocessors/csv_reader.tester_fail:     Total:                 2
vectorpostprocessors/csv_reader.tester_fail:     Local:                 0
vectorpostprocessors/csv_reader.tester_fail:   Elems:
vectorpostprocessors/csv_reader.tester_fail:     Total:                 1
vectorpostprocessors/csv_reader.tester_fail:     Local:                 0
vectorpostprocessors/csv_reader.tester_fail:   Num Subdomains:          1
vectorpostprocessors/csv_reader.tester_fail:   Num Partitions:          1
vectorpostprocessors/csv_reader.tester_fail:   Partitioner:             metis
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: Execution Information:
vectorpostprocessors/csv_reader.tester_fail:   Executioner:             Steady
vectorpostprocessors/csv_reader.tester_fail:   Solver Mode:             Preconditioned JFNK
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail:  Solve Skipped!
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: *** ERROR ***
vectorpostprocessors/csv_reader.tester_fail: The supplied gold data does not match the VPP data on the given rank.
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail: ################################################################################
vectorpostprocessors/csv_reader.tester_fail: Tester failed, reason: NO CRASH
vectorpostprocessors/csv_reader.tester_fail:
vectorpostprocessors/csv_reader.tester_fail ................................... [min_cpus=2] FAILED (NO CRASH)

meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch .............. [min_cpus=4] FAILED (EXODIFF)

meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Running command: mpiexec -n 4 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i distributed_rectilinear_mesh_generator.i Mesh/gmg/dim=3 Mesh/gmg/nx=20 Mesh/gmg/ny=20 Mesh/gmg/nz=20 Mesh/gmg/part_package=hierarch Mesh/gmg/num_cores_per_compute_node=2 Outputs/file_base=distributed_rectilinear_mesh_generator_out_3d_hierarch Outputs/hide="pid npid"  --error --error-unused --error-override --no-gdb-backtrace
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Framework Information:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: PETSc Version:           3.14.2
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: SLEPc Version:           3.14.0
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Current Time:            Fri Dec 25 22:22:39 2020
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Executable Timestamp:    Fri Dec 25 21:18:15 2020
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Parallelism:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Processors:          4
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Threads:             1
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Mesh:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Parallel Type:           distributed
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Mesh Dimension:          3
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Spatial Dimension:       3
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Nodes:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Total:                 9261
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Local:                 2556
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Elems:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Total:                 8000
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Local:                 1998
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Subdomains:          1
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Partitions:          1
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Partitioner:             parmetis
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nonlinear System:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num DOFs:                9261
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Local DOFs:          2556
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Variables:               "u"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Finite Element Types:    "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Approximation Orders:    "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Auxiliary System:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num DOFs:                17261
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Local DOFs:          4554
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Variables:               "pid" "npid"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Finite Element Types:    "MONOMIAL" "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Approximation Orders:    "CONSTANT" "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Execution Information:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Executioner:             Steady
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Solver Mode:             NEWTON
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   MOOSE Preconditioner:    SMP (auto)
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  0 Nonlinear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       0 Linear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       1 Linear |R| = 1.301958e-02
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       2 Linear |R| = 4.944610e-04
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       3 Linear |R| = 1.000931e-05
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Linear solve converged due to CONVERGED_RTOL iterations 3
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  1 Nonlinear |R| = 1.000931e-05
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       0 Linear |R| = 1.000931e-05
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       1 Linear |R| = 2.739268e-07
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       2 Linear |R| = 7.530361e-09
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       3 Linear |R| = 1.373364e-10
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       4 Linear |R| = 3.146130e-12
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Linear solve converged due to CONVERGED_RTOL iterations 4
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  2 Nonlinear |R| = 3.146131e-12
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 2
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  Solve Converged!
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Framework Information:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: PETSc Version:           3.14.2
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: SLEPc Version:           3.14.0
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Current Time:            Fri Dec 25 22:22:39 2020
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Executable Timestamp:    Fri Dec 25 21:18:15 2020
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Parallelism:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Processors:          4
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Threads:             1
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Mesh:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Parallel Type:           distributed
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Mesh Dimension:          3
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Spatial Dimension:       3
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Nodes:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Total:                 9261
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Local:                 2556
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Elems:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Total:                 8000
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:     Local:                 1998
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Subdomains:          1
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Partitions:          1
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Partitioner:             parmetis
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nonlinear System:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num DOFs:                9261
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Local DOFs:          2556
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Variables:               "u"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Finite Element Types:    "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Approximation Orders:    "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Auxiliary System:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num DOFs:                17261
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Num Local DOFs:          4554
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Variables:               "pid" "npid"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Finite Element Types:    "MONOMIAL" "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Approximation Orders:    "CONSTANT" "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Execution Information:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Executioner:             Steady
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Solver Mode:             NEWTON
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   MOOSE Preconditioner:    SMP (auto)
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  0 Nonlinear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       0 Linear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       1 Linear |R| = 1.301958e-02
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       2 Linear |R| = 4.944610e-04
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       3 Linear |R| = 1.000931e-05
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Linear solve converged due to CONVERGED_RTOL iterations 3
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  1 Nonlinear |R| = 1.000931e-05
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       0 Linear |R| = 1.000931e-05
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       1 Linear |R| = 2.739268e-07
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       2 Linear |R| = 7.530361e-09
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       3 Linear |R| = 1.373364e-10
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:       4 Linear |R| = 3.146130e-12
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   Linear solve converged due to CONVERGED_RTOL iterations 4
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  2 Nonlinear |R| = 3.146131e-12
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 2
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:  Solve Converged!
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Running exodiff: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/framework/contrib/exodiff/exodiff -m  -F 1e-10 -t 5.5e-06  /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/gold/distributed_rectilinear_mesh_generator_out_3d_hierarch.e /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/distributed_rectilinear_mesh_generator_out_3d_hierarch.e
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: ERROR:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:    *****************************************************************
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:               EXODIFF	(Version: 2.90) Modified: 2018-02-15
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:               Authors:  Richard Drake, rrdrake@sandia.gov
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:                         Greg Sjaardema, gdsjaar@sandia.gov
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:               Run on    2020/12/25   22:22:41 GMT
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:    *****************************************************************
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Reading first file ...
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Reading second file ...
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   FILE 1: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/gold/distributed_rectilinear_mesh_generator_out_3d_hierarch.e
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:    Title: distributed_rectilinear_mesh_generator_out_3d_hierarch.e
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:           Dim = 3, Blocks = 1, Nodes = 9261, Elements = 8000, Nodesets = 6, Sidesets = 6
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:           Vars: Global = 0, Nodal = 1, Element = 0, Nodeset = 0, Sideset = 0, Times = 2
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   FILE 2: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/distributed_rectilinear_mesh_generator_out_3d_hierarch.e
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:    Title: distributed_rectilinear_mesh_generator_out_3d_hierarch.e
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:           Dim = 3, Blocks = 1, Nodes = 9261, Elements = 8000, Nodesets = 6, Sidesets = 6
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:           Vars: Global = 0, Nodal = 2, Element = 0, Nodeset = 0, Sideset = 0, Times = 2
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: DIFFERENCE .. The nodal variable "npid" is in the second file but not the first.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 1 with global id 1 in file1 has the global id 2557 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 2 with global id 2 in file1 has the global id 2558 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 3 with global id 3 in file1 has the global id 2559 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 4 with global id 4 in file1 has the global id 2560 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 5 with global id 5 in file1 has the global id 2561 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 6 with global id 6 in file1 has the global id 2562 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 7 with global id 7 in file1 has the global id 2563 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 8 with global id 8 in file1 has the global id 2564 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 9 with global id 9 in file1 has the global id 2565 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 10 with global id 10 in file1 has the global id 1 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 11 with global id 11 in file1 has the global id 2 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 12 with global id 12 in file1 has the global id 3 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 13 with global id 13 in file1 has the global id 4 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 14 with global id 14 in file1 has the global id 5 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 15 with global id 15 in file1 has the global id 6 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 16 with global id 16 in file1 has the global id 7 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 17 with global id 17 in file1 has the global id 8 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 18 with global id 18 in file1 has the global id 9 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 19 with global id 19 in file1 has the global id 10 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 20 with global id 20 in file1 has the global id 11 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 21 with global id 21 in file1 has the global id 12 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 22 with global id 22 in file1 has the global id 2566 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 23 with global id 23 in file1 has the global id 2567 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 24 with global id 24 in file1 has the global id 2568 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 25 with global id 25 in file1 has the global id 2569 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 26 with global id 26 in file1 has the global id 2570 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 27 with global id 27 in file1 has the global id 2571 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 28 with global id 28 in file1 has the global id 2572 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 29 with global id 29 in file1 has the global id 2573 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 30 with global id 30 in file1 has the global id 2574 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 31 with global id 31 in file1 has the global id 13 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 32 with global id 32 in file1 has the global id 14 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 33 with global id 33 in file1 has the global id 15 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 34 with global id 34 in file1 has the global id 16 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 35 with global id 35 in file1 has the global id 17 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 36 with global id 36 in file1 has the global id 18 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 37 with global id 37 in file1 has the global id 19 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 38 with global id 38 in file1 has the global id 20 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 39 with global id 39 in file1 has the global id 21 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 40 with global id 40 in file1 has the global id 22 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 41 with global id 41 in file1 has the global id 23 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 42 with global id 42 in file1 has the global id 24 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 43 with global id 43 in file1 has the global id 2575 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 44 with global id 44 in file1 has the global id 2576 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 45 with global id 45 in file1 has the global id 2577 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 46 with global id 46 in file1 has the global id 2578 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 47 with global id 47 in file1 has the global id 2579 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 48 with global id 48 in file1 has the global id 2580 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 49 with global id 49 in file1 has the global id 2581 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 50 with global id 50 in file1 has the global id 2582 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 51 with global id 51 in file1 has the global id 2583 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 52 with global id 52 in file1 has the global id 25 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 53 with global id 53 in file1 has the global id 26 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 54 with global id 54 in file1 has the global id 27 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 55 with global id 55 in file1 has the global id 28 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 56 with global id 56 in file1 has the global id 29 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 57 with global id 57 in file1 has the global id 30 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 58 with global id 58 in file1 has the global id 31 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 59 with global id 59 in file1 has the global id 32 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 60 with global id 60 in file1 has the global id 33 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 61 with global id 61 in file1 has the global id 34 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 62 with global id 62 in file1 has the global id 35 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 63 with global id 63 in file1 has the global id 36 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 64 with global id 64 in file1 has the global id 2584 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 65 with global id 65 in file1 has the global id 2585 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 66 with global id 66 in file1 has the global id 2586 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 67 with global id 67 in file1 has the global id 2587 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 68 with global id 68 in file1 has the global id 2588 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 69 with global id 69 in file1 has the global id 2589 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 70 with global id 70 in file1 has the global id 2590 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 71 with global id 71 in file1 has the global id 2591 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 72 with global id 72 in file1 has the global id 2592 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 73 with global id 73 in file1 has the global id 37 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 74 with global id 74 in file1 has the global id 38 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 75 with global id 75 in file1 has the global id 39 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 76 with global id 76 in file1 has the global id 40 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 77 with global id 77 in file1 has the global id 41 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 78 with global id 78 in file1 has the global id 42 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 79 with global id 79 in file1 has the global id 43 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 80 with global id 80 in file1 has the global id 44 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 81 with global id 81 in file1 has the global id 45 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 82 with global id 82 in file1 has the global id 46 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 83 with global id 83 in file1 has the global id 47 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 84 with global id 84 in file1 has the global id 48 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 85 with global id 85 in file1 has the global id 2593 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 86 with global id 86 in file1 has the global id 2594 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 87 with global id 87 in file1 has the global id 2595 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 88 with global id 88 in file1 has the global id 2596 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 89 with global id 89 in file1 has the global id 2597 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 90 with global id 90 in file1 has the global id 2598 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 91 with global id 91 in file1 has the global id 2599 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 92 with global id 92 in file1 has the global id 2600 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 93 with global id 93 in file1 has the global id 2601 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 94 with global id 94 in file1 has the global id 49 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 95 with global id 95 in file1 has the global id 50 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 96 with global id 96 in file1 has the global id 51 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 97 with global id 97 in file1 has the global id 52 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 98 with global id 98 in file1 has the global id 53 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 99 with global id 99 in file1 has the global id 54 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 100 with global id 100 in file1 has the global id 55 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local node 101 with global id 101 in file1 has the global id 56 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. Too many warnings, skipping remainder...
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 1 with global id 1 in file1 has the global id 1999 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 2 with global id 2 in file1 has the global id 2000 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 3 with global id 3 in file1 has the global id 2001 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 4 with global id 4 in file1 has the global id 2002 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 5 with global id 5 in file1 has the global id 2003 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 6 with global id 6 in file1 has the global id 2004 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 7 with global id 7 in file1 has the global id 2005 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 8 with global id 8 in file1 has the global id 2006 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 9 with global id 9 in file1 has the global id 2007 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 10 with global id 10 in file1 has the global id 1 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 11 with global id 11 in file1 has the global id 2 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 12 with global id 12 in file1 has the global id 3 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 13 with global id 13 in file1 has the global id 4 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 14 with global id 14 in file1 has the global id 5 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 15 with global id 15 in file1 has the global id 6 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 16 with global id 16 in file1 has the global id 7 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 17 with global id 17 in file1 has the global id 8 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 18 with global id 18 in file1 has the global id 9 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 19 with global id 19 in file1 has the global id 10 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 20 with global id 20 in file1 has the global id 11 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 21 with global id 21 in file1 has the global id 2008 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 22 with global id 22 in file1 has the global id 2009 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 23 with global id 23 in file1 has the global id 2010 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 24 with global id 24 in file1 has the global id 2011 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 25 with global id 25 in file1 has the global id 2012 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 26 with global id 26 in file1 has the global id 2013 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 27 with global id 27 in file1 has the global id 2014 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 28 with global id 28 in file1 has the global id 2015 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 29 with global id 29 in file1 has the global id 2016 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 30 with global id 30 in file1 has the global id 12 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 31 with global id 31 in file1 has the global id 13 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 32 with global id 32 in file1 has the global id 14 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 33 with global id 33 in file1 has the global id 15 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 34 with global id 34 in file1 has the global id 16 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 35 with global id 35 in file1 has the global id 17 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 36 with global id 36 in file1 has the global id 18 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 37 with global id 37 in file1 has the global id 19 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 38 with global id 38 in file1 has the global id 20 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 39 with global id 39 in file1 has the global id 21 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 40 with global id 40 in file1 has the global id 22 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 41 with global id 41 in file1 has the global id 2017 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 42 with global id 42 in file1 has the global id 2018 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 43 with global id 43 in file1 has the global id 2019 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 44 with global id 44 in file1 has the global id 2020 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 45 with global id 45 in file1 has the global id 2021 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 46 with global id 46 in file1 has the global id 2022 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 47 with global id 47 in file1 has the global id 2023 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 48 with global id 48 in file1 has the global id 2024 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 49 with global id 49 in file1 has the global id 2025 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 50 with global id 50 in file1 has the global id 23 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 51 with global id 51 in file1 has the global id 24 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 52 with global id 52 in file1 has the global id 25 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 53 with global id 53 in file1 has the global id 26 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 54 with global id 54 in file1 has the global id 27 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 55 with global id 55 in file1 has the global id 28 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 56 with global id 56 in file1 has the global id 29 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 57 with global id 57 in file1 has the global id 30 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 58 with global id 58 in file1 has the global id 31 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 59 with global id 59 in file1 has the global id 32 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 60 with global id 60 in file1 has the global id 33 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 61 with global id 61 in file1 has the global id 2026 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 62 with global id 62 in file1 has the global id 2027 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 63 with global id 63 in file1 has the global id 2028 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 64 with global id 64 in file1 has the global id 2029 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 65 with global id 65 in file1 has the global id 2030 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 66 with global id 66 in file1 has the global id 2031 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 67 with global id 67 in file1 has the global id 2032 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 68 with global id 68 in file1 has the global id 2033 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 69 with global id 69 in file1 has the global id 2034 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 70 with global id 70 in file1 has the global id 34 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 71 with global id 71 in file1 has the global id 35 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 72 with global id 72 in file1 has the global id 36 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 73 with global id 73 in file1 has the global id 37 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 74 with global id 74 in file1 has the global id 38 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 75 with global id 75 in file1 has the global id 39 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 76 with global id 76 in file1 has the global id 40 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 77 with global id 77 in file1 has the global id 41 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 78 with global id 78 in file1 has the global id 42 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 79 with global id 79 in file1 has the global id 43 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 80 with global id 80 in file1 has the global id 44 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 81 with global id 81 in file1 has the global id 2035 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 82 with global id 82 in file1 has the global id 2036 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 83 with global id 83 in file1 has the global id 2037 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 84 with global id 84 in file1 has the global id 2038 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 85 with global id 85 in file1 has the global id 2039 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 86 with global id 86 in file1 has the global id 2040 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 87 with global id 87 in file1 has the global id 2041 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 88 with global id 88 in file1 has the global id 2042 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 89 with global id 89 in file1 has the global id 2043 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 90 with global id 90 in file1 has the global id 45 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 91 with global id 91 in file1 has the global id 46 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 92 with global id 92 in file1 has the global id 47 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 93 with global id 93 in file1 has the global id 48 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 94 with global id 94 in file1 has the global id 49 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 95 with global id 95 in file1 has the global id 50 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 96 with global id 96 in file1 has the global id 51 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 97 with global id 97 in file1 has the global id 52 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 98 with global id 98 in file1 has the global id 53 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 99 with global id 99 in file1 has the global id 54 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 100 with global id 100 in file1 has the global id 55 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. The local element 101 with global id 101 in file1 has the global id 2044 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: WARNING .. Too many warnings, skipping remainder...
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nodal coordinates will be compared .. tol:    1e-06 (absolute), floor:        0
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Time step values will be compared .. tol:  5.5e-06 (relative), floor:    1e-10
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: No Global variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nodal variables to be compared:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: 	u                                tol:  5.5e-06 (relative), floor:    1e-10
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: No Element variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: No Element Attribute variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: No Nodeset variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: No Sideset variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Sideset Distribution Factors will be compared .. tol:    1e-06 (relative), floor:        0
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   ==============================================================
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   NOTE: All node and element ids are reported as global ids.
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Sideset Distribution Factors:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   --------- Time step 1, 0.0000000e+00 ~ 0.0000000e+00, rel diff:  0.00000e+00 ---------
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nodal variables:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:   --------- Time step 2, 1.0000000e+00 ~ 1.0000000e+00, rel diff:  0.00000e+00 ---------
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Nodal variables:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: exodiff: Files are different
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: ################################################################################
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch: Tester failed, reason: EXODIFF
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch:
meshgenerators/distributed_rectilinear_mesh_generator.3D_hierarch .............. [min_cpus=4] FAILED (EXODIFF)

meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out ............. [min_cpus=3] FAILED (EXODIFF)

meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Working Directory: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Running command: mpiexec -n 3 /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/moose_test-opt -i distributed_rectilinear_mesh_generator.i Mesh/gmg/num_cores_for_partition=2 Mesh/gmg/dim=3 Mesh/gmg/nx=20 Mesh/gmg/ny=20 Mesh/gmg/nz=20 Outputs/file_base=drmg_3d_scomm_out Outputs/hide="pid npid"  --error --error-unused --error-override --no-gdb-backtrace
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Framework Information:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: PETSc Version:           3.14.2
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: SLEPc Version:           3.14.0
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Current Time:            Fri Dec 25 22:22:47 2020
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Executable Timestamp:    Fri Dec 25 21:18:15 2020
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Parallelism:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Processors:          3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Threads:             1
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Mesh:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Parallel Type:           distributed
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Mesh Dimension:          3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Spatial Dimension:       3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Nodes:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Total:                 9261
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Local:                 3406
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Elems:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Total:                 8000
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Local:                 2677
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Subdomains:          1
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Partitions:          1
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Partitioner:             parmetis
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nonlinear System:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num DOFs:                9261
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Local DOFs:          3406
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Variables:               "u"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Finite Element Types:    "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Approximation Orders:    "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Auxiliary System:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num DOFs:                17261
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Local DOFs:          6083
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Variables:               "pid" "npid"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Finite Element Types:    "MONOMIAL" "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Approximation Orders:    "CONSTANT" "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Execution Information:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Executioner:             Steady
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Solver Mode:             NEWTON
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   MOOSE Preconditioner:    SMP (auto)
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  0 Nonlinear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       0 Linear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       1 Linear |R| = 1.256983e-02
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       2 Linear |R| = 3.233320e-04
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       3 Linear |R| = 1.207826e-05
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Linear solve converged due to CONVERGED_RTOL iterations 3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  1 Nonlinear |R| = 1.207826e-05
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       0 Linear |R| = 1.207826e-05
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       1 Linear |R| = 4.345058e-07
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       2 Linear |R| = 9.621480e-09
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       3 Linear |R| = 1.565968e-10
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       4 Linear |R| = 4.325451e-12
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Linear solve converged due to CONVERGED_RTOL iterations 4
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  2 Nonlinear |R| = 4.325443e-12
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 2
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  Solve Converged!
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Framework Information:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: MOOSE Version:           git commit 2f250bf011 on 2020-12-24
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: LibMesh Version:         964118e30ec2da83ed6642171ccd23074e57c2ad
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: PETSc Version:           3.14.2
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: SLEPc Version:           3.14.0
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Current Time:            Fri Dec 25 22:22:47 2020
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Executable Timestamp:    Fri Dec 25 21:18:15 2020
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Parallelism:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Processors:          3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Threads:             1
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Mesh:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Parallel Type:           distributed
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Mesh Dimension:          3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Spatial Dimension:       3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Nodes:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Total:                 9261
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Local:                 3406
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Elems:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Total:                 8000
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:     Local:                 2677
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Subdomains:          1
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Partitions:          1
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Partitioner:             parmetis
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nonlinear System:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num DOFs:                9261
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Local DOFs:          3406
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Variables:               "u"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Finite Element Types:    "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Approximation Orders:    "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Auxiliary System:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num DOFs:                17261
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Num Local DOFs:          6083
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Variables:               "pid" "npid"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Finite Element Types:    "MONOMIAL" "LAGRANGE"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Approximation Orders:    "CONSTANT" "FIRST"
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Execution Information:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Executioner:             Steady
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Solver Mode:             NEWTON
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   MOOSE Preconditioner:    SMP (auto)
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Warning:  This MeshOutput subclass only supports meshes which have been serialized!
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  0 Nonlinear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       0 Linear |R| = 2.100000e+01
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       1 Linear |R| = 1.256983e-02
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       2 Linear |R| = 3.233320e-04
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       3 Linear |R| = 1.207826e-05
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Linear solve converged due to CONVERGED_RTOL iterations 3
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  1 Nonlinear |R| = 1.207826e-05
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       0 Linear |R| = 1.207826e-05
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       1 Linear |R| = 4.345058e-07
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       2 Linear |R| = 9.621480e-09
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       3 Linear |R| = 1.565968e-10
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:       4 Linear |R| = 4.325451e-12
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   Linear solve converged due to CONVERGED_RTOL iterations 4
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  2 Nonlinear |R| = 4.325443e-12
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 2
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:  Solve Converged!
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Running exodiff: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/framework/contrib/exodiff/exodiff -m  -F 1e-10 -t 5.5e-06  /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/gold/drmg_3d_scomm_out.e /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/drmg_3d_scomm_out.e
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: ERROR:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:    *****************************************************************
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:               EXODIFF	(Version: 2.90) Modified: 2018-02-15
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:               Authors:  Richard Drake, rrdrake@sandia.gov
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:                         Greg Sjaardema, gdsjaar@sandia.gov
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:               Run on    2020/12/25   22:22:47 GMT
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:    *****************************************************************
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Reading first file ...
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Reading second file ...
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   FILE 1: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/gold/drmg_3d_scomm_out.e
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:    Title: drmg_3d_scomm_out.e
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:           Dim = 3, Blocks = 1, Nodes = 9261, Elements = 8000, Nodesets = 6, Sidesets = 6
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:           Vars: Global = 0, Nodal = 1, Element = 0, Nodeset = 0, Sideset = 0, Times = 2
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   FILE 2: /home/ir-inca1/projects/building_moose_with_dinosaurs/moose/test/tests/meshgenerators/distributed_rectilinear_mesh_generator/drmg_3d_scomm_out.e
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:    Title: drmg_3d_scomm_out.e
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:           Dim = 3, Blocks = 1, Nodes = 9261, Elements = 8000, Nodesets = 6, Sidesets = 6
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:           Vars: Global = 0, Nodal = 2, Element = 0, Nodeset = 0, Sideset = 0, Times = 2
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: DIFFERENCE .. The nodal variable "npid" is in the second file but not the first.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 1 with global id 1 in file1 has the global id 6517 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 2 with global id 2 in file1 has the global id 6518 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 3 with global id 3 in file1 has the global id 6519 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 4 with global id 4 in file1 has the global id 6520 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 5 with global id 5 in file1 has the global id 6521 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 6 with global id 6 in file1 has the global id 6522 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 7 with global id 7 in file1 has the global id 6523 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 8 with global id 8 in file1 has the global id 6524 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 9 with global id 9 in file1 has the global id 6525 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 10 with global id 10 in file1 has the global id 6526 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 11 with global id 11 in file1 has the global id 6527 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 12 with global id 12 in file1 has the global id 6528 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 13 with global id 13 in file1 has the global id 6529 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 14 with global id 14 in file1 has the global id 1 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 15 with global id 15 in file1 has the global id 2 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 16 with global id 16 in file1 has the global id 3 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 17 with global id 17 in file1 has the global id 4 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 18 with global id 18 in file1 has the global id 5 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 19 with global id 19 in file1 has the global id 6 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 20 with global id 20 in file1 has the global id 7 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 21 with global id 21 in file1 has the global id 8 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 22 with global id 22 in file1 has the global id 6530 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 23 with global id 23 in file1 has the global id 6531 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 24 with global id 24 in file1 has the global id 6532 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 25 with global id 25 in file1 has the global id 6533 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 26 with global id 26 in file1 has the global id 6534 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 27 with global id 27 in file1 has the global id 6535 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 28 with global id 28 in file1 has the global id 6536 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 29 with global id 29 in file1 has the global id 6537 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 30 with global id 30 in file1 has the global id 6538 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 31 with global id 31 in file1 has the global id 6539 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 32 with global id 32 in file1 has the global id 6540 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 33 with global id 33 in file1 has the global id 6541 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 34 with global id 34 in file1 has the global id 6542 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 35 with global id 35 in file1 has the global id 9 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 36 with global id 36 in file1 has the global id 10 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 37 with global id 37 in file1 has the global id 11 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 38 with global id 38 in file1 has the global id 12 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 39 with global id 39 in file1 has the global id 13 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 40 with global id 40 in file1 has the global id 14 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 41 with global id 41 in file1 has the global id 15 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 42 with global id 42 in file1 has the global id 16 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 43 with global id 43 in file1 has the global id 6543 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 44 with global id 44 in file1 has the global id 6544 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 45 with global id 45 in file1 has the global id 6545 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 46 with global id 46 in file1 has the global id 6546 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 47 with global id 47 in file1 has the global id 6547 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 48 with global id 48 in file1 has the global id 6548 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 49 with global id 49 in file1 has the global id 6549 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 50 with global id 50 in file1 has the global id 6550 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 51 with global id 51 in file1 has the global id 6551 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 52 with global id 52 in file1 has the global id 6552 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 53 with global id 53 in file1 has the global id 6553 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 54 with global id 54 in file1 has the global id 6554 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 55 with global id 55 in file1 has the global id 6555 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 56 with global id 56 in file1 has the global id 17 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 57 with global id 57 in file1 has the global id 18 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 58 with global id 58 in file1 has the global id 19 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 59 with global id 59 in file1 has the global id 20 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 60 with global id 60 in file1 has the global id 21 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 61 with global id 61 in file1 has the global id 22 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 62 with global id 62 in file1 has the global id 23 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 63 with global id 63 in file1 has the global id 24 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 64 with global id 64 in file1 has the global id 6556 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 65 with global id 65 in file1 has the global id 6557 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 66 with global id 66 in file1 has the global id 6558 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 67 with global id 67 in file1 has the global id 6559 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 68 with global id 68 in file1 has the global id 6560 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 69 with global id 69 in file1 has the global id 6561 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 70 with global id 70 in file1 has the global id 6562 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 71 with global id 71 in file1 has the global id 6563 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 72 with global id 72 in file1 has the global id 6564 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 73 with global id 73 in file1 has the global id 6565 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 74 with global id 74 in file1 has the global id 6566 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 75 with global id 75 in file1 has the global id 6567 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 76 with global id 76 in file1 has the global id 6568 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 77 with global id 77 in file1 has the global id 25 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 78 with global id 78 in file1 has the global id 26 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 79 with global id 79 in file1 has the global id 27 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 80 with global id 80 in file1 has the global id 28 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 81 with global id 81 in file1 has the global id 29 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 82 with global id 82 in file1 has the global id 30 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 83 with global id 83 in file1 has the global id 31 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 84 with global id 84 in file1 has the global id 32 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 85 with global id 85 in file1 has the global id 6569 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 86 with global id 86 in file1 has the global id 6570 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 87 with global id 87 in file1 has the global id 6571 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 88 with global id 88 in file1 has the global id 6572 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 89 with global id 89 in file1 has the global id 6573 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 90 with global id 90 in file1 has the global id 6574 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 91 with global id 91 in file1 has the global id 6575 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 92 with global id 92 in file1 has the global id 6576 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 93 with global id 93 in file1 has the global id 6577 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 94 with global id 94 in file1 has the global id 6578 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 95 with global id 95 in file1 has the global id 6579 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 96 with global id 96 in file1 has the global id 6580 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 97 with global id 97 in file1 has the global id 6581 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 98 with global id 98 in file1 has the global id 33 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 99 with global id 99 in file1 has the global id 34 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 100 with global id 100 in file1 has the global id 35 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local node 101 with global id 101 in file1 has the global id 36 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. Too many warnings, skipping remainder...
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 1 with global id 1 in file1 has the global id 5361 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 2 with global id 2 in file1 has the global id 5362 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 3 with global id 3 in file1 has the global id 5363 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 4 with global id 4 in file1 has the global id 5364 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 5 with global id 5 in file1 has the global id 5365 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 6 with global id 6 in file1 has the global id 5366 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 7 with global id 7 in file1 has the global id 5367 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 8 with global id 8 in file1 has the global id 5368 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 9 with global id 9 in file1 has the global id 5369 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 10 with global id 10 in file1 has the global id 5370 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 11 with global id 11 in file1 has the global id 5371 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 12 with global id 12 in file1 has the global id 5372 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 13 with global id 13 in file1 has the global id 5373 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 14 with global id 14 in file1 has the global id 1 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 15 with global id 15 in file1 has the global id 2 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 16 with global id 16 in file1 has the global id 3 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 17 with global id 17 in file1 has the global id 4 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 18 with global id 18 in file1 has the global id 5 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 19 with global id 19 in file1 has the global id 6 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 20 with global id 20 in file1 has the global id 7 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 21 with global id 21 in file1 has the global id 5374 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 22 with global id 22 in file1 has the global id 5375 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 23 with global id 23 in file1 has the global id 5376 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 24 with global id 24 in file1 has the global id 5377 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 25 with global id 25 in file1 has the global id 5378 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 26 with global id 26 in file1 has the global id 5379 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 27 with global id 27 in file1 has the global id 5380 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 28 with global id 28 in file1 has the global id 5381 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 29 with global id 29 in file1 has the global id 5382 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 30 with global id 30 in file1 has the global id 5383 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 31 with global id 31 in file1 has the global id 5384 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 32 with global id 32 in file1 has the global id 5385 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 33 with global id 33 in file1 has the global id 5386 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 34 with global id 34 in file1 has the global id 8 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 35 with global id 35 in file1 has the global id 9 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 36 with global id 36 in file1 has the global id 10 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 37 with global id 37 in file1 has the global id 11 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 38 with global id 38 in file1 has the global id 12 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 39 with global id 39 in file1 has the global id 13 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 40 with global id 40 in file1 has the global id 14 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 41 with global id 41 in file1 has the global id 5387 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 42 with global id 42 in file1 has the global id 5388 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 43 with global id 43 in file1 has the global id 5389 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 44 with global id 44 in file1 has the global id 5390 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 45 with global id 45 in file1 has the global id 5391 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 46 with global id 46 in file1 has the global id 5392 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 47 with global id 47 in file1 has the global id 5393 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 48 with global id 48 in file1 has the global id 5394 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 49 with global id 49 in file1 has the global id 5395 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 50 with global id 50 in file1 has the global id 5396 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 51 with global id 51 in file1 has the global id 5397 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 52 with global id 52 in file1 has the global id 5398 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 53 with global id 53 in file1 has the global id 5399 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 54 with global id 54 in file1 has the global id 15 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 55 with global id 55 in file1 has the global id 16 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 56 with global id 56 in file1 has the global id 17 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 57 with global id 57 in file1 has the global id 18 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 58 with global id 58 in file1 has the global id 19 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 59 with global id 59 in file1 has the global id 20 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 60 with global id 60 in file1 has the global id 21 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 61 with global id 61 in file1 has the global id 5400 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 62 with global id 62 in file1 has the global id 5401 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 63 with global id 63 in file1 has the global id 5402 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 64 with global id 64 in file1 has the global id 5403 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 65 with global id 65 in file1 has the global id 5404 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 66 with global id 66 in file1 has the global id 5405 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 67 with global id 67 in file1 has the global id 5406 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 68 with global id 68 in file1 has the global id 5407 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 69 with global id 69 in file1 has the global id 5408 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 70 with global id 70 in file1 has the global id 5409 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 71 with global id 71 in file1 has the global id 5410 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 72 with global id 72 in file1 has the global id 5411 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 73 with global id 73 in file1 has the global id 5412 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 74 with global id 74 in file1 has the global id 22 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 75 with global id 75 in file1 has the global id 23 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 76 with global id 76 in file1 has the global id 24 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 77 with global id 77 in file1 has the global id 25 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 78 with global id 78 in file1 has the global id 26 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 79 with global id 79 in file1 has the global id 27 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 80 with global id 80 in file1 has the global id 28 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 81 with global id 81 in file1 has the global id 5413 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 82 with global id 82 in file1 has the global id 5414 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 83 with global id 83 in file1 has the global id 5415 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 84 with global id 84 in file1 has the global id 5416 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 85 with global id 85 in file1 has the global id 5417 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 86 with global id 86 in file1 has the global id 5418 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 87 with global id 87 in file1 has the global id 5419 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 88 with global id 88 in file1 has the global id 5420 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 89 with global id 89 in file1 has the global id 5421 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 90 with global id 90 in file1 has the global id 5422 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 91 with global id 91 in file1 has the global id 5423 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 92 with global id 92 in file1 has the global id 5424 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 93 with global id 93 in file1 has the global id 5425 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 94 with global id 94 in file1 has the global id 29 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 95 with global id 95 in file1 has the global id 30 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 96 with global id 96 in file1 has the global id 31 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 97 with global id 97 in file1 has the global id 32 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 98 with global id 98 in file1 has the global id 33 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 99 with global id 99 in file1 has the global id 34 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 100 with global id 100 in file1 has the global id 35 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. The local element 101 with global id 101 in file1 has the global id 5426 in file2.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: WARNING .. Too many warnings, skipping remainder...
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nodal coordinates will be compared .. tol:    1e-06 (absolute), floor:        0
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Time step values will be compared .. tol:  5.5e-06 (relative), floor:    1e-10
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: No Global variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nodal variables to be compared:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: 	u                                tol:  5.5e-06 (relative), floor:    1e-10
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: No Element variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: No Element Attribute variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: No Nodeset variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: No Sideset variables on either file.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Sideset Distribution Factors will be compared .. tol:    1e-06 (relative), floor:        0
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   ==============================================================
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   NOTE: All node and element ids are reported as global ids.
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Sideset Distribution Factors:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   --------- Time step 1, 0.0000000e+00 ~ 0.0000000e+00, rel diff:  0.00000e+00 ---------
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nodal variables:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:   --------- Time step 2, 1.0000000e+00 ~ 1.0000000e+00, rel diff:  0.00000e+00 ---------
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Nodal variables:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: exodiff: Files are different
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: ################################################################################
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out: Tester failed, reason: EXODIFF
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out:
meshgenerators/distributed_rectilinear_mesh_generator.3d_scomm_out ............. [min_cpus=3] FAILED (EXODIFF)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Installing MOOSE with GCC 7 and OpenMPI 4.0.1 #16546

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 5 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Installing MOOSE with GCC 7 and OpenMPI 4.0.1 #16546

jinca Dec 18, 2020

Replies: 2 comments · 5 replies

srinath-chakravarthy Dec 18, 2020

jinca Dec 18, 2020 Author

aeslaughter Dec 21, 2020

GiudGiud Dec 21, 2020 Collaborator

jinca Dec 23, 2020 Author

GiudGiud Dec 23, 2020 Collaborator

jinca Dec 25, 2020 Author

jinca
Dec 18, 2020

Replies: 2 comments 5 replies

srinath-chakravarthy
Dec 18, 2020

jinca Dec 18, 2020
Author

GiudGiud Dec 21, 2020
Collaborator

jinca Dec 23, 2020
Author

GiudGiud
Dec 23, 2020
Collaborator

jinca Dec 25, 2020
Author