Support PyTorch Lightning's FSDP optimizer states saving and loading #18807
Job | Run time |
---|---|
6s | |
19s | |
26s | |
27s | |
22s | |
35s | |
39s | |
2m 21s | |
2m 23s | |
2m 30s | |
2m 26s | |
3m 29s | |
2m 50s | |
4m 8s | |
2m 49s | |
1m 18s | |
1m 6s | |
2m 28s | |
1m 48s | |
2m 10s | |
1m 40s | |
2m 18s | |
2m 41s | |
2m 36s | |
2m 43s | |
1m 21s | |
1m 30s | |
1m 49s | |
2m 5s | |
2m 32s | |
3m 31s | |
3m 59s | |
3m 24s | |
2m 32s | |
3m 30s | |
1h 12m 51s |