Wait for NFS file synchronization

[DanSava]

Issue
Resolves #7788
Resolves #7715

• PR title captures the intent of the changes, and is fitting for release notes.
• Added appropriate release note label
• Commit history is consistent and clean, in line with the contribution guidelines.
• Make sure tests pass locally (after every commit!)

When applicable

• When there are user facing changes: Updated documentation
• New behavior or changes to existing untested code: Ensured that unit tests are added (See Ground Rules).
• Large PR: Prepare changes in small commits for more convenient review
• Bug fix: Add regression test for the bug
• Bug fix: Create Backport PR to latest release

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 94.64286% with 6 lines in your changes missing coverage. Please review.

Project coverage is 86.57%. Comparing base (37c4d20) to head (f0e1f39).
Report is 5 commits behind head on main.

Files	Patch %	Lines
src/ert/scheduler/scheduler.py	88.37%	5 Missing ⚠️
src/ert/scheduler/job.py	97.14%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #7927      +/-   ##
==========================================
+ Coverage   86.51%   86.57%   +0.06%     
==========================================
  Files         383      383              
  Lines       23742    23830      +88     
  Branches      629      635       +6     
==========================================
+ Hits        20540    20632      +92     
+ Misses       3126     3125       -1     
+ Partials       76       73       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[eivindjahren]

Just some initial comments to simplify reading to make it easier to look for errors.

[eivindjahren]

Looks like one of the tests are flaky:

FAILED tests/unit_tests/ensemble_evaluator/test_scheduler.py::test_scheduler_receives_checksum_and_waits_for_disk_sync - RuntimeError: Task <Task pending name='Task-1839' coro=<Event.wait() running at /opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/asyncio/locks.py:309> cb=[_done_callback() at /opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/_ert/async_utils.py:39, _release_waiter(<Future pendi...c6aee8520>()]>)() at /opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/asyncio/tasks.py:429]> got Future <Future pending> attached to a different loop

https://github.com/equinor/ert/actions/runs/9414224549/job/25932738059?pr=7927

[eivindjahren]

Looks good now!