Extend with action points

[rvandernoort]

Summary

Currently, the implementation only reports the energy consumption (EC) measurements visually and leaves it up to the ML developer to act accordingly. We have a few ideas for which GATorch can be extended with certain suggestion/action points. These action points can be reported to the user with a direct suggestion to for example define an early stopping criteria based on the energy consumption per unit of loss. This should provide even more awareness about the energy consumption of ML and possibly reduce wasted energy.

Roadmap

• Investigate awareness level with the current implementation
• Investigate possible action points and their criteria
• Implement action points seamlessly

Possible action points

• Suggestions for optimizers based on EC.
• Early stopping criteria based on EC per unit of loss.
• Model architecture adjustments based on individual layer EC.
• Hyperparameters adjustment based on EC
• etc.