Promotion Gate Fix V44.0.4

This update clears up several older open issues and improves especially the Options menu, zero-feed-in, and the Promotion Gate.

Fuel my late-night ideas with a coffee? I'd really appreciate it — keep this project running!

Options menu in SFML cleaned up

• The Options menu has been cleaned up and adapted to the current functional scope of the code. Outdated or now ineffective settings have been removed.
• In addition, the notifications have been correctly reconnected to the associated events. This concerns, among other things, forecast updates, training messages, and unexpected weather deviations.
• When a battery storage system is activated, a suitable solar-to-battery power sensor must now also be selected. This way, incomplete configurations are already detected when saving.

Important note on forecast notifications

• The Coordinator calculates an updated forecast by default once per hour. This calculation is important for internal processing and learning, but does not overwrite an already locked morning forecast.
• Please only activate the notification for forecast updates if you want to observe or check these regular Coordinator runs. Otherwise, every scheduled update can generate a new message, which can lead to confusion. 😉

Zero feed-in and battery storage

The detection of zero feed-in, inverter throttling, and fully charged battery storage systems has been revised.
Affected hours are now more reliably excluded from learning and from clean model evaluation.
This is intended to prevent technically throttled production from being incorrectly learned as actual generation potential.

AI selection removed

The manual selection of the AI model as well as the previous option to enable or disable individual AI components have been removed.
The current AI stack decides autonomously which model can be used depending on the data situation, maturity level, and quality. A manual selection would by now be more misleading than helpful.

Home Assistant app and Nabu Casa

The STATS web interface can now be used again via the Home Assistant Companion App and a Nabu Casa connection.
Login is performed via the existing Home Assistant session or the authentication of the Companion App.

Promotion Gate, Bootstrap, and database schema – ongoing construction site
I have fundamentally reviewed the Promotion Gate once more and corrected several errors.

New installations and existing databases now reliably receive the required tables and schema extensions again. The evaluation of a new model candidate is no longer dependent on certain ensemble rows. Valid comparison evidence can now also be collected during the Bootstrap phase. Restarts and multiple consecutive test days are correctly taken into account. Incomplete or unsuitable data can no longer accidentally lead to a model release.

Important note on “Pending Candidate”
Pending Candidate 1 does not mean that the counter has stopped!! A candidate remains in the “Pending” status until enough valid and comparable data from the planned test cycles is available. At least seven independent and fully evaluable days are required for a possible release. A more detailed explanation can also be found in the help section on the SFML website (www.solarforecastml.com). Simply search for “Pending Candidate”.

Database optimized

• The storage of the extensive Shadow and Promotion data has been optimized so that the database does not grow unnecessarily.
• The existing evidence is retained. The optimization is lossless and additionally checks the integrity of the stored data.

🚚 A small design error is intentionally left in place

For the heat pump, a yellow truck is still displayed. I find the error funny and have therefore deliberately not removed it. 😉