Capture metrics by default in the Hugging Face Estimator #2537
Description
Describe the feature you'd like
In order to capture metrics on a SageMaker Training job, one needs to write one regexp per metrics. Couldn't the SDK have those metrics already written instead? Some frameworks provide standard metrics, hence those regexp can be done once by the SDK team in the estimator, instead of being done by developers N times. This is for example the case of the SM RL Estimator, that has regexp built into the object. Could we have built-in metrics for the Hugging Face Estimator as well?
How would this feature be used? Please describe.
This would allow to capture Hugging Face-generated metrics without the need for an ad-hoc regexp.
Describe alternatives you've considered
Alternative is to have developer writes regexp, like here. This is the default SageMaker expectation, yet it is verbose and difficult to get right for beginners.