XLA CI is broken

## 🐛 Bug description

XLA CI is broken on tests: 
```
FAILED tests/ignite/contrib/handlers/test_trains_logger.py::test_distrib_single_device_xla
FAILED tests/ignite/handlers/test_checkpoint.py::test_distrib_single_device_xla
```
https://github.com/pytorch/ignite/runs/1311651780#step:5:23