Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move ert.job_runner to _ert_job_runner #4076

Merged
merged 2 commits into from
Oct 17, 2022

Conversation

eivindjahren
Copy link
Contributor

@eivindjahren eivindjahren commented Oct 14, 2022

Importing ert has significant overhead. Therefore we need to make sure job_runner.py does not do that. By avoiding this, the overhead of running job_runner.py goes from 2 seconds to 0.1 seconds. This seems to make the tests run 30 % faster as a consequence because it spawns job_dispatch.py many times.

@mortalisk
Copy link
Contributor

fix ya style

@mortalisk
Copy link
Contributor

Looks beautiful. The only concern is that of @sondreso regarding having two top level packages. Perhaps he would like to chime in here?

@sondreso
Copy link
Collaborator

My concern was that there was some workaround required for having multiple top-level packages with skbuild, but if this is OK I don't have any more concerns 😅

@mortalisk mortalisk enabled auto-merge (rebase) October 14, 2022 13:28
@codecov-commenter
Copy link

codecov-commenter commented Oct 17, 2022

Codecov Report

Merging #4076 (fc6bec0) into main (a97019d) will decrease coverage by 0.48%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main    #4076      +/-   ##
==========================================
- Coverage   58.16%   57.68%   -0.49%     
==========================================
  Files         526      510      -16     
  Lines       39312    38361     -951     
  Branches     3554     3444     -110     
==========================================
- Hits        22867    22129     -738     
+ Misses      15513    15353     -160     
+ Partials      932      879      -53     
Impacted Files Coverage Δ
src/ert/ensemble_evaluator/builder/_ensemble.py 90.27% <100.00%> (ø)
...c/ert/ensemble_evaluator/builder/_function_task.py 86.56% <100.00%> (ø)
src/ert/ensemble_evaluator/builder/_prefect.py 64.64% <100.00%> (ø)
src/ert/ensemble_evaluator/builder/_unix_task.py 91.20% <100.00%> (ø)
src/ert/simulator/forward_model_status.py 88.88% <0.00%> (-6.18%) ⬇️
src/clib/lib/enkf/obs_vector.cpp 15.77% <0.00%> (-1.36%) ⬇️
src/clib/lib/enkf/enkf_plot_gendata.cpp 23.65% <0.00%> (-1.35%) ⬇️
src/clib/lib/enkf/enkf_plot_genvector.cpp 58.33% <0.00%> (-0.93%) ⬇️
src/clib/lib/enkf/enkf_plot_data.cpp 30.23% <0.00%> (-0.88%) ⬇️
src/clib/lib/enkf/summary_key_set.cpp 24.32% <0.00%> (-0.68%) ⬇️
... and 77 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Importing ert has significant overhead. Therefore we need to make
sure job_runner.py does not do that. By avoiding this, the overhead
of running job_runner.py goes from 2 seconds to 0.1 seconds.
@mortalisk mortalisk merged commit 9d35798 into equinor:main Oct 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants