New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FSI: Duplicate Force contibutions in parallel simulations #40
Comments
Thank you for making this an issue Makis. I have some notes on this:
|
I am not sure I understand this. Why does the uni-directional coupling of the force giving the same error prove that it is not a problem in
Where else have you seen it? Still near the parallel boundary? Does it also appear in serial simulations then? (I guess you say this in bullet 1) |
The problem with the malfunctioning forces only occurs when running the fluid solver in parallel, and the boundary is broken up in several domains. For the coupling, so far I only tried serial coupling, so I cannot comment on parallel coupling. (although I think this is an issue independent of the type of coupling). |
I also found a workaround. In the decomposeParDict there is an option to force a faceSet + connecting cells on one core. This is called: The procure then becomes:
Decompose with the additional constraint:
The decomposition with additional constraint can however create a mesh which is highly suboptimal in terms of performance, because the first layer wrt to the FSI surface is added. A high amount of information then has to be communicated between cores. |
I cannot reproduce this anymore with our updated tutorial cases. I am trying with OpenFOAM v1806 and CalculiX 2.13 (the same as before). For our Additionally, with our latest setup, all the forces are smaller and inwards, contrary to the first picture. I am only plotting the Forces that the adapter writes, I have removed the I have currently only looked at the first coupling time steps, but this should be enough if this is an implementation error. |
As far as I see now you are evaluating the openfoam force object. I encountered this problem after the mapping from openfoam to the structural mesh. The time should not matter for this problem. Could you try exporting the vtk files for calculix and obtain the force on the points there? |
I exported vtk/vtu files from both participants and they all look smooth. Here are the Are these the files you are refering to? |
I've only checked for vtk, but this should't make any difference. Could you check the |
This also looks fine: Here are all the vtk/vtu files: vtk-all.tar.gz I am closing this for now, please reopen if you find any hints that this still holds. |
This issue has been mentioned on preCICE Forum on Discourse. There might be relevant details there: https://precice.discourse.group/t/mapping-problem-openfoam-fenics-on-cluster/1344/2 |
As observed by @derekrisseeuw, if the interface patch is split between two processes, there are duplicate contributions to the force on those cells (see figure).
This is relevant to #7.
The text was updated successfully, but these errors were encountered: