standard weekly patch release

Detail changes

Added

• Added metrics aggregation in Horovod and fixed early stopping (#3775)
• Added manual_optimizer_step which work with AMP Native and accumulated_grad_batches (#4485)
• Added persistent(mode) method to metrics, to enable and disable metric states being added to state_dict (#4482)
• Added congratulations at the end of our notebooks (#4555)

Changed

• Changed fsspec to tuner (#4458)
• Unify sLURM/TorchElastic under backend plugin (#4578, #4580, #4581, #4582, #4583)

Fixed

• Fixed feature-lack in hpc_load (#4526)
• Fixed metrics states being overridden in DDP mode (#4482)
• Fixed lightning_getattr, lightning_hasattr not finding the correct attributes in datamodule (#4347)
• Fixed automatic optimization AMP by manual_optimization_step (#4485)
• Replace MisconfigurationException with warning in ModelCheckpoint Callback (#4560)
• Fixed logged keys in mlflow logger (#4412)
• Fixed is_picklable by catching AttributeError (#4508)

Contributors

@dscarmo, @jtamir, @kazhang, @maxjeblick, @rohitgr7, @SkafteNicki, @tarepan, @tchaton, @tgaddair, @williamFalcon

If we forgot someone due to not matching commit email with GitHub account, let us know :]