Cannot use multiple Gpus properly. #16954
Description
Bug description
I've set up to use 8 gpus and to use ddp, but I'm actually only using 1 gpu, I don't know why.
My core code:
The log:
The usage of CUDA:
The envs:
pytorch-lightning==1.6.0
torch==1.9.0+cu111
How to reproduce the bug
No response
Error messages and logs
# Error messages and logs here please
Environment
Current environment
#- Lightning Component (e.g. Trainer, LightningModule, LightningApp, LightningWork, LightningFlow):
#- PyTorch Lightning Version (e.g., 1.5.0):
#- Lightning App Version (e.g., 0.5.2):
#- PyTorch Version (e.g., 2.0):
#- Python version (e.g., 3.9):
#- OS (e.g., Linux):
#- CUDA/cuDNN version:
#- GPU models and configuration:
#- How you installed Lightning(`conda`, `pip`, source):
#- Running environment of LightningApp (e.g. local, cloud):
More info
No response