Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

By default always do a final prepare_for_use #24018

Merged
merged 24 commits into from
May 6, 2023

Conversation

lindsayad
Copy link
Member

Refs #14329

@lindsayad lindsayad self-assigned this Apr 10, 2023
@lindsayad lindsayad marked this pull request as ready for review April 10, 2023 18:00
@loganharbour
Copy link
Member

Oof @ CI

@moosebuild
Copy link
Contributor

moosebuild commented Apr 10, 2023

Job Documentation on 9b26602 wanted to post the following:

View the site here

This comment will be updated on new commits.

@lindsayad
Copy link
Member Author

The outright errors are fixed by the most recent commit. The exodiffs illustrate the problem with not making sure your mesh is prepared 😆

@loganharbour
Copy link
Member

The exodiffs illustrate the problem with not making sure your mesh is prepared 😆

Yes this was the what the oof was about 😬

@lindsayad lindsayad force-pushed the paolo-problem branch 3 times, most recently from 8059c78 to c0defb4 Compare April 11, 2023 03:38
lindsayad added a commit to lindsayad/libmesh that referenced this pull request Apr 11, 2023
The blksize was wrong if `partition_range` was called (again) after
the mesh had been distributed. Now I'm getting the same partitioning
even if I call `prepare_for_use` twice

This is relevant to work on idaholab/moose#24018
@lindsayad lindsayad marked this pull request as draft April 11, 2023 19:37
@lindsayad
Copy link
Member Author

big simplification incoming

lindsayad added a commit to lindsayad/moose that referenced this pull request Apr 11, 2023
lindsayad added a commit to lindsayad/moose that referenced this pull request Apr 11, 2023
lindsayad added a commit to lindsayad/moose that referenced this pull request Apr 11, 2023
@lindsayad lindsayad marked this pull request as ready for review April 11, 2023 20:05
@lindsayad
Copy link
Member Author

There may be one test failure until libMesh/libmesh#3514 makes it into MOOSE

@lindsayad lindsayad changed the title By default always do a final prepare_for_use [WIP] By default always do a final prepare_for_use Apr 12, 2023
@lindsayad lindsayad marked this pull request as draft April 12, 2023 00:24
@lindsayad
Copy link
Member Author

Will be updating now that we have MeshTools::valid_is_prepared 🎉

lindsayad added a commit to lindsayad/moose that referenced this pull request Apr 20, 2023
@moosebuild
Copy link
Contributor

Job Framework 2 on 9b26602 : invalidated by @lindsayad

@moosebuild
Copy link
Contributor

Job Internal app tests on 9b26602 : invalidated by @lindsayad

@moosebuild
Copy link
Contributor

All jobs on 9b26602 : invalidated by @lindsayad

@lindsayad lindsayad requested a review from GiudGiud May 5, 2023 14:51
@lindsayad
Copy link
Member Author

ready for re-review

Copy link
Contributor

@GiudGiud GiudGiud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome

@lindsayad
Copy link
Member Author

Thanks for the review @GiudGiud !

@lindsayad lindsayad merged commit 27cba6c into idaholab:next May 6, 2023
@lindsayad lindsayad deleted the paolo-problem branch May 6, 2023 15:52
@loganharbour
Copy link
Member

In case you didn't see it: https://civet.inl.gov/event/122927/

@GiudGiud
Copy link
Contributor

GiudGiud commented May 8, 2023

Taking a look

@GiudGiud
Copy link
Contributor

GiudGiud commented May 8, 2023

Test seems to rely on the mesh not being prepared for the sidesetbetweensubdomaingenerators (either of them?)
(it passes when unprepared at p8 distributed)

EDIT: actually, setting as unprepared, at any point, creates the exodiff.
EDIT: skipping partitioning makes it pass again, even when preparing. I ll keep looking at ghosting things
EDIT: using LU also fixes it

GiudGiud added a commit to GiudGiud/moose that referenced this pull request May 8, 2023
@loganharbour
Copy link
Member

It looks like

meshgenerators/block_deletion_generator.block_deletion/delete_interior_parents

is failing quite often with -p 16 --distributed-mesh

@lindsayad
Copy link
Member Author

In what way?

@loganharbour
Copy link
Member

Crashes. Let me see if I can duplicate it easily on rod.

Elley-Folks pushed a commit to Elley-Folks/Elley-moose that referenced this pull request May 10, 2023
lindsayad added a commit to lindsayad/moose that referenced this pull request May 15, 2023
Defaulting got me in trouble again in SAM after idaholab#24018
lindsayad added a commit to lindsayad/moose that referenced this pull request May 15, 2023
Defaulting got me in trouble again in SAM after idaholab#24018
lindsayad added a commit to lindsayad/moose that referenced this pull request May 15, 2023
Defaulting got me in trouble again in SAM after idaholab#24018
lindsayad added a commit to lindsayad/moose that referenced this pull request May 31, 2023
In idaholab#24018 we checked to see whether the reference mesh base object was prepared
in `MooseMesh::prepare`, and if so then we would later also prepare the
displaced mesh. The issue with this is that even Metis may yield different
partitions for identical meshes and this plays havoc when we want to sync
vectors between undisplaced and displaced meshes. Back when we had this problem
in the past we proposed issue idaholab#12799 as a solution but ended up going with idaholab#12889
which has the same spirit as this new fix: *ensure* the displaced mesh is
an exact copy of the reference mesh. Now of course I am getting paranoid about
what can happen when we have adaptivity...

Thank you to discussion idaholab#24499 for illustrating that we had this issue
crop up again
lindsayad added a commit to lindsayad/moose that referenced this pull request May 31, 2023
In idaholab#24018 we checked to see whether the reference mesh base object was prepared
in `MooseMesh::prepare`, and if so then we would later also prepare the
displaced mesh. The issue with this is that even Metis may yield different
partitions for identical meshes and this plays havoc when we want to sync
vectors between undisplaced and displaced meshes. Back when we had this problem
in the past we proposed issue idaholab#12799 as a solution but ended up going with idaholab#12889
which has the same spirit as this new fix: *ensure* the displaced mesh is
an exact copy of the reference mesh. Now of course I am getting paranoid about
what can happen when we have adaptivity...

Thank you to discussion idaholab#24499 for illustrating that we had this issue
crop up again
lindsayad added a commit to lindsayad/moose that referenced this pull request Jun 21, 2023
tanoret pushed a commit to tanoret/moose that referenced this pull request Jul 10, 2023
In idaholab#24018 we checked to see whether the reference mesh base object was prepared
in `MooseMesh::prepare`, and if so then we would later also prepare the
displaced mesh. The issue with this is that even Metis may yield different
partitions for identical meshes and this plays havoc when we want to sync
vectors between undisplaced and displaced meshes. Back when we had this problem
in the past we proposed issue idaholab#12799 as a solution but ended up going with idaholab#12889
which has the same spirit as this new fix: *ensure* the displaced mesh is
an exact copy of the reference mesh. Now of course I am getting paranoid about
what can happen when we have adaptivity...

Thank you to discussion idaholab#24499 for illustrating that we had this issue
crop up again
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

5 participants