Add more stats to the training log

[Emrys365]

This is related to #5134

[codecov]

Codecov Report

Merging #5147 (c6a1b57) into master (b973527) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff            @@
##           master    #5147    +/-   ##
========================================
  Coverage   74.98%   74.99%            
========================================
  Files         617      618     +1     
  Lines       55209    55583   +374     
========================================
+ Hits        41399    41684   +285     
- Misses      13810    13899    +89     

Flag	Coverage Δ
test_integration_espnet1	66.28% <ø> (ø)
test_integration_espnet2	47.61% <100.00%> (-0.17%)	⬇️
test_python	65.45% <100.00%> (+0.07%)	⬆️
test_utils	23.28% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
espnet2/train/trainer.py	76.92% <100.00%> (+0.05%)	⬆️

... and 21 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[sw005320]

Can you share what it looks like in the log?

[Emrys365]

Can you share what it looks like in the log?

Yes. The following example is also mentioned in the related issue above:

With the above modifications, the training log of a speech enhancement task will look like this:

2023-04-22 13:52:12,339 (trainer:732) INFO: 8epoch:train:2901-3000batch: iter_time=0.070, forward_time=0.360,
si_snr_loss=-17.036, loss=-17.036, backward_time=0.294, grad_norm=37.450, clip=100.000, loss_scale=1.000,
optim_step_time=0.022, optim0_lr0=3.765e-04, train_time=1.137

[sw005320]

Thanks a lot!
This is very useful!