Skip to content

Conversation

@ekouts
Copy link
Contributor

@ekouts ekouts commented Nov 25, 2021

We need this PR before merging #2194, since it brakes all the old helloworld tests. This is anyway a more reliable way to get the compilation time since it emits some commands in the build script and it doesn't include ReFrame's overhead in the compilation phase.

@codecov-commenter
Copy link

codecov-commenter commented Nov 25, 2021

Codecov Report

Merging #2288 (1cc5e4f) into master (fcc6717) will not change coverage.
The diff coverage is n/a.

❗ Current head 1cc5e4f differs from pull request most recent head 311c7e2. Consider uploading reports for the commit 311c7e2 to get more accurate results
Impacted file tree graph

@@           Coverage Diff           @@
##           master    #2288   +/-   ##
=======================================
  Coverage   86.12%   86.12%           
=======================================
  Files          56       56           
  Lines       10206    10206           
=======================================
  Hits         8790     8790           
  Misses       1416     1416           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fcc6717...311c7e2. Read the comment docs.

@ekouts
Copy link
Contributor Author

ekouts commented Nov 25, 2021

As a reference I run both the old and new references and there is a significant reduction in compilation times:

==============================================================================
PERFORMANCE REPORT
------------------------------------------------------------------------------
HelloWorldTestMPIOpenMP_static_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 1.982937 s
      * new_compilation_time: 1.8461416490000002 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.254111 s
      * new_compilation_time: 0.9715607190000001 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.695414 s
      * new_compilation_time: 1.266889248 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.178065 s
      * new_compilation_time: 0.9398517660000001 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 2.183409 s
      * new_compilation_time: 1.997839216 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.271859 s
      * new_compilation_time: 0.94343208 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.656373 s
      * new_compilation_time: 1.2576853430000001 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.634386 s
      * new_compilation_time: 1.0257518840000002 s
------------------------------------------------------------------------------
HelloWorldTestMPIOpenMP_static_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.913359 s
      * new_compilation_time: 0.7792207870000001 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.228733 s
      * new_compilation_time: 0.918516948 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 3.000404 s
      * new_compilation_time: 1.378626686 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.324846 s
      * new_compilation_time: 1.0514569150000002 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 1.193671 s
      * new_compilation_time: 0.9979016890000001 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.411886 s
      * new_compilation_time: 0.9931947680000001 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.830874 s
      * new_compilation_time: 1.257172892 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.467336 s
      * new_compilation_time: 1.1513080210000002 s
------------------------------------------------------------------------------
HelloWorldTestMPIOpenMP_static_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 1.142999 s
      * new_compilation_time: 0.9313427870000001 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.200124 s
      * new_compilation_time: 0.9001161240000001 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 3.085323 s
      * new_compilation_time: 1.577303813 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.943312 s
      * new_compilation_time: 1.241603465 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 1.020854 s
      * new_compilation_time: 0.741580306 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.254611 s
      * new_compilation_time: 0.9615142910000001 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.573116 s
      * new_compilation_time: 1.135087913 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.859532 s
      * new_compilation_time: 1.0251789500000001 s
------------------------------------------------------------------------------
HelloWorldTestMPIOpenMP_dynamic_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.593489 s
      * new_compilation_time: 0.462191638 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 1.633291 s
      * new_compilation_time: 0.320434947 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 1.86836 s
      * new_compilation_time: 0.490291868 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 2.179051 s
      * new_compilation_time: 0.507715741 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.658681 s
      * new_compilation_time: 0.483816858 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 2.054647 s
      * new_compilation_time: 0.328015918 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.003818 s
      * new_compilation_time: 0.503261987 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 1.888816 s
      * new_compilation_time: 0.516397134 s
------------------------------------------------------------------------------
HelloWorldTestMPIOpenMP_dynamic_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.69368 s
      * new_compilation_time: 0.417334802 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 1.714037 s
      * new_compilation_time: 0.433430384 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.300598 s
      * new_compilation_time: 0.5521602 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 1.757672 s
      * new_compilation_time: 0.45020127600000004 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.410276 s
      * new_compilation_time: 0.248425748 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 1.682987 s
      * new_compilation_time: 0.38103943900000004 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 1.982769 s
      * new_compilation_time: 0.594516339 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 1.797427 s
      * new_compilation_time: 0.518546837 s
------------------------------------------------------------------------------
HelloWorldTestMPIOpenMP_dynamic_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.291347 s
      * new_compilation_time: 0.152316754 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 1.526821 s
      * new_compilation_time: 0.28103767 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.35378 s
      * new_compilation_time: 0.6281750180000001 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 1.744856 s
      * new_compilation_time: 0.349427401 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 6
      * compilation_time: 0.359002 s
      * new_compilation_time: 0.167375944 s
   - PrgEnv-gnu
      * num_tasks: 6
      * compilation_time: 1.777384 s
      * new_compilation_time: 0.32316079200000003 s
   - PrgEnv-intel
      * num_tasks: 6
      * compilation_time: 2.275747 s
      * new_compilation_time: 0.6265910140000001 s
   - PrgEnv-pgi
      * num_tasks: 6
      * compilation_time: 1.978628 s
      * new_compilation_time: 0.34561594 s
------------------------------------------------------------------------------
HelloWorldTestMPI_static_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 1.704822 s
      * new_compilation_time: 1.549473067 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.599393 s
      * new_compilation_time: 1.025518666 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.748804 s
      * new_compilation_time: 1.1234551400000001 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.409269 s
      * new_compilation_time: 1.123077624 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 1.448954 s
      * new_compilation_time: 1.268545982 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.595262 s
      * new_compilation_time: 1.147133415 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.688287 s
      * new_compilation_time: 1.1639082120000002 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.283361 s
      * new_compilation_time: 0.9719449000000001 s
------------------------------------------------------------------------------
HelloWorldTestMPI_static_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.708479 s
      * new_compilation_time: 0.574537708 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.446871 s
      * new_compilation_time: 0.902329777 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.521775 s
      * new_compilation_time: 1.115048929 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.351739 s
      * new_compilation_time: 0.9954764810000001 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.758047 s
      * new_compilation_time: 0.592266566 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.254947 s
      * new_compilation_time: 0.917346702 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.503791 s
      * new_compilation_time: 1.0919062800000001 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.295309 s
      * new_compilation_time: 0.991732197 s
------------------------------------------------------------------------------
HelloWorldTestMPI_static_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.695787 s
      * new_compilation_time: 0.5506121150000001 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.20558 s
      * new_compilation_time: 0.851092033 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.505554 s
      * new_compilation_time: 1.089218899 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.269378 s
      * new_compilation_time: 0.928089135 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.866098 s
      * new_compilation_time: 0.650631539 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.267538 s
      * new_compilation_time: 0.8943647520000001 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.680373 s
      * new_compilation_time: 1.2168010580000002 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.315409 s
      * new_compilation_time: 0.971855503 s
------------------------------------------------------------------------------
HelloWorldTestMPI_dynamic_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.608572 s
      * new_compilation_time: 0.46949962 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 1.850716 s
      * new_compilation_time: 0.295656827 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 1.863546 s
      * new_compilation_time: 0.4623275 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 1.791103 s
      * new_compilation_time: 0.320368078 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.724812 s
      * new_compilation_time: 0.5175510520000001 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 1.693995 s
      * new_compilation_time: 0.295623108 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 1.954479 s
      * new_compilation_time: 0.47713115100000003 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 1.889381 s
      * new_compilation_time: 0.35953922800000004 s
------------------------------------------------------------------------------
HelloWorldTestMPI_dynamic_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.381173 s
      * new_compilation_time: 0.220759954 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 2.223291 s
      * new_compilation_time: 0.550263185 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.045783 s
      * new_compilation_time: 0.5667797640000001 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.074233 s
      * new_compilation_time: 0.625330516 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.502473 s
      * new_compilation_time: 0.296543224 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 1.746542 s
      * new_compilation_time: 0.40612000200000004 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 1.99 s
      * new_compilation_time: 0.513804381 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 2.069175 s
      * new_compilation_time: 0.486698032 s
------------------------------------------------------------------------------
HelloWorldTestMPI_dynamic_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.27644 s
      * new_compilation_time: 0.13429058600000002 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 1.573938 s
      * new_compilation_time: 0.275635748 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.094022 s
      * new_compilation_time: 0.45255338100000003 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 1.764787 s
      * new_compilation_time: 0.432015705 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 2
      * compilation_time: 0.309329 s
      * new_compilation_time: 0.142414 s
   - PrgEnv-gnu
      * num_tasks: 2
      * compilation_time: 1.92268 s
      * new_compilation_time: 0.387592967 s
   - PrgEnv-intel
      * num_tasks: 2
      * compilation_time: 2.253759 s
      * new_compilation_time: 0.687940054 s
   - PrgEnv-pgi
      * num_tasks: 2
      * compilation_time: 1.679185 s
      * new_compilation_time: 0.330856921 s
------------------------------------------------------------------------------
HelloWorldTestOpenMP_static_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 1.805205 s
      * new_compilation_time: 1.658852905 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.498098 s
      * new_compilation_time: 0.9225428590000001 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.523783 s
      * new_compilation_time: 1.014300086 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.009388 s
      * new_compilation_time: 0.7341098970000001 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 2.068664 s
      * new_compilation_time: 1.8764671380000002 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.086922 s
      * new_compilation_time: 0.7060686060000001 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.38636 s
      * new_compilation_time: 0.9683444750000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.055993 s
      * new_compilation_time: 0.756508888 s
------------------------------------------------------------------------------
HelloWorldTestOpenMP_static_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.82234 s
      * new_compilation_time: 0.674761346 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.995531 s
      * new_compilation_time: 0.656762469 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.389157 s
      * new_compilation_time: 0.9428688040000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.958983 s
      * new_compilation_time: 0.688099717 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 1.014726 s
      * new_compilation_time: 0.801954657 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.06717 s
      * new_compilation_time: 0.6445113570000001 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.48867 s
      * new_compilation_time: 0.997748881 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.069972 s
      * new_compilation_time: 0.707437563 s
------------------------------------------------------------------------------
HelloWorldTestOpenMP_static_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.850531 s
      * new_compilation_time: 0.709768727 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.007604 s
      * new_compilation_time: 0.6614821740000001 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.348113 s
      * new_compilation_time: 0.9115803690000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.969052 s
      * new_compilation_time: 0.698405155 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.783971 s
      * new_compilation_time: 0.616914884 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.083034 s
      * new_compilation_time: 0.626804009 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.588551 s
      * new_compilation_time: 1.025517244 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.194098 s
      * new_compilation_time: 0.854374831 s
------------------------------------------------------------------------------
HelloWorldTestOpenMP_dynamic_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.492528 s
      * new_compilation_time: 0.348899813 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.865848 s
      * new_compilation_time: 0.459230793 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.108969 s
      * new_compilation_time: 0.45106306700000004 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.798695 s
      * new_compilation_time: 0.450923073 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.506679 s
      * new_compilation_time: 0.345179986 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.751187 s
      * new_compilation_time: 0.281002119 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.194311 s
      * new_compilation_time: 0.46192193600000003 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.660152 s
      * new_compilation_time: 0.301331626 s
------------------------------------------------------------------------------
HelloWorldTestOpenMP_dynamic_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.307259 s
      * new_compilation_time: 0.158004523 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.599332 s
      * new_compilation_time: 0.287393605 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.440457 s
      * new_compilation_time: 0.7194848030000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.594755 s
      * new_compilation_time: 0.319308268 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.370381 s
      * new_compilation_time: 0.20884881600000002 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.657705 s
      * new_compilation_time: 0.293560354 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.463536 s
      * new_compilation_time: 0.712412872 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.934545 s
      * new_compilation_time: 0.402923144 s
------------------------------------------------------------------------------
HelloWorldTestOpenMP_dynamic_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.293734 s
      * new_compilation_time: 0.142766835 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.12485 s
      * new_compilation_time: 0.370748412 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.315697 s
      * new_compilation_time: 0.6580315200000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.88225 s
      * new_compilation_time: 0.572945276 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.343193 s
      * new_compilation_time: 0.154048027 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.01968 s
      * new_compilation_time: 0.386513202 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.024433 s
      * new_compilation_time: 0.46037633600000005 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.632298 s
      * new_compilation_time: 0.30289818700000004 s
------------------------------------------------------------------------------
HelloWorldTestSerial_static_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 1.089654 s
      * new_compilation_time: 0.941947654 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.970422 s
      * new_compilation_time: 0.641020044 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.454012 s
      * new_compilation_time: 1.046275945 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.972836 s
      * new_compilation_time: 0.70767428 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 1.074584 s
      * new_compilation_time: 0.9120815250000001 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.047766 s
      * new_compilation_time: 0.64536812 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.38144 s
      * new_compilation_time: 0.8739878470000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.191362 s
      * new_compilation_time: 0.746320674 s
------------------------------------------------------------------------------
HelloWorldTestSerial_static_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.998586 s
      * new_compilation_time: 0.851387866 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.588786 s
      * new_compilation_time: 1.2161196600000002 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.827474 s
      * new_compilation_time: 1.369908417 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.759439 s
      * new_compilation_time: 1.503677771 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.918027 s
      * new_compilation_time: 0.749946324 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.563909 s
      * new_compilation_time: 1.225878719 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.835696 s
      * new_compilation_time: 1.3648781300000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.651244 s
      * new_compilation_time: 1.360053028 s
------------------------------------------------------------------------------
HelloWorldTestSerial_static_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.491341 s
      * new_compilation_time: 0.36380328500000003 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.86137 s
      * new_compilation_time: 0.568689981 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.776263 s
      * new_compilation_time: 1.420838995 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.874956 s
      * new_compilation_time: 0.6325945900000001 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.486631 s
      * new_compilation_time: 0.334269749 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.854162 s
      * new_compilation_time: 0.558223653 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.208924 s
      * new_compilation_time: 0.7886844780000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.968061 s
      * new_compilation_time: 0.6140445800000001 s
------------------------------------------------------------------------------
HelloWorldTestSerial_dynamic_f90
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.446553 s
      * new_compilation_time: 0.31424677900000003 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.545155 s
      * new_compilation_time: 0.26804236800000003 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.296401 s
      * new_compilation_time: 0.8002929270000001 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.52181 s
      * new_compilation_time: 0.281804321 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.476937 s
      * new_compilation_time: 0.318013396 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.650471 s
      * new_compilation_time: 0.274469018 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 1.853964 s
      * new_compilation_time: 0.41398983100000003 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.013307 s
      * new_compilation_time: 0.424183878 s
------------------------------------------------------------------------------
HelloWorldTestSerial_dynamic_cpp
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.617966 s
      * new_compilation_time: 0.46637642300000004 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.164289 s
      * new_compilation_time: 0.6308750740000001 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.150217 s
      * new_compilation_time: 0.651893406 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.482088 s
      * new_compilation_time: 0.905515088 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.712956 s
      * new_compilation_time: 0.539976989 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 2.316939 s
      * new_compilation_time: 0.6721141730000001 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.260288 s
      * new_compilation_time: 0.713884983 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 2.292845 s
      * new_compilation_time: 0.810065165 s
------------------------------------------------------------------------------
HelloWorldTestSerial_dynamic_c
- daint:gpu
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.34334 s
      * new_compilation_time: 0.16648411200000002 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.69395 s
      * new_compilation_time: 0.26245671800000003 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 1.938727 s
      * new_compilation_time: 0.501584374 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.71137 s
      * new_compilation_time: 0.305198589 s
- daint:mc
   - PrgEnv-cray
      * num_tasks: 1
      * compilation_time: 0.284164 s
      * new_compilation_time: 0.125602196 s
   - PrgEnv-gnu
      * num_tasks: 1
      * compilation_time: 1.753093 s
      * new_compilation_time: 0.259323762 s
   - PrgEnv-intel
      * num_tasks: 1
      * compilation_time: 2.070668 s
      * new_compilation_time: 0.435076599 s
   - PrgEnv-pgi
      * num_tasks: 1
      * compilation_time: 1.613346 s
      * new_compilation_time: 0.28590304 s
------------------------------------------------------------------------------

The reference (60seconds) was already too high, I don't know if there is a point of updating it.

@vkarak vkarak added this to the ReFrame sprint 21.11.2 milestone Nov 25, 2021
@vkarak vkarak changed the title [test] Update method to get compilation time in HelloWorldTest* [test] Update method to get compilation time in HelloWorldTests Nov 29, 2021
@vkarak vkarak merged commit c1cc49b into reframe-hpc:master Nov 29, 2021
@ekouts ekouts deleted the test/hello_world_compilation_time branch December 16, 2021 12:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants