Normalize training time metric

[karl-richter]

🔬 Background

• The training time metric depends on the system performance, but github action workers have varying system specifications.

🔮 Key changes

• This pr normalizes the training time based on the currently available system specs.

📋 Review Checklist

• I have performed a self-review of my own code.
• I have commented my code, added docstrings and data types to function definitions.
• I have added pytests to check whether my feature / fix works.

Please make sure to follow our best practices in the Contributing guidelines.

[github-actions]

c8e0fa2

Model Benchmark

Benchmark	Metric	main	current	diff
AirPassengers	MAE_val	15.2698	15.2698	0.0%	✅
AirPassengers	RMSE_val	19.4209	19.4209	0.0%	✅
AirPassengers	Loss_val	0.00195	0.00195	0.0%	✅
AirPassengers	MAE	9.82902	9.82902	0.0%	✅
AirPassengers	RMSE	11.7005	11.7005	0.0%	✅
AirPassengers	Loss	0.00056	0.00056	0.0%	✅
AirPassengers	time	4.52798	4.48	-1.06%	✅
PeytonManning	MAE_val	0.64636	0.64636	0.0%	✅
PeytonManning	RMSE_val	0.79276	0.79276	0.0%	✅
PeytonManning	Loss_val	0.01494	0.01494	0.0%	✅
PeytonManning	MAE	0.42701	0.42701	0.0%	✅
PeytonManning	RMSE	0.57032	0.57032	0.0%	✅
PeytonManning	Loss	0.00635	0.00635	0.0%	✅
PeytonManning	time	11.7359	11.82	0.72%	✅
YosemiteTemps	MAE_val	1.72949	1.72949	0.0%	✅
YosemiteTemps	RMSE_val	2.27386	2.27386	0.0%	✅
YosemiteTemps	Loss_val	0.00096	0.00096	0.0%	✅
YosemiteTemps	MAE	1.45189	1.45189	0.0%	✅
YosemiteTemps	RMSE	2.16631	2.16631	0.0%	✅
YosemiteTemps	Loss	0.00066	0.00066	0.0%	✅
YosemiteTemps	time	93.0425	92.06	-1.06%	✅

Model training plots

Model Training

PeytonManning

YosemiteTemps

AirPassengers

[codecov-commenter]

Codecov Report

Merging #1045 (c8e0fa2) into main (66021de) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1045   +/-   ##
=======================================
  Coverage   90.26%   90.26%           
=======================================
  Files          21       21           
  Lines        4736     4736           
=======================================
  Hits         4275     4275           
  Misses        461      461           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[karl-richter]

This function assumes a linear relationship between training time and CPU performance test (we use the rule of three for calculation). If the relationship is not linear, this might explain why the training times do not always match up.