Requesting some insight on time spent during recovery when training with torchFT enabled

[PGG106]

Hello! i've opened an issue on the torchFT repo but since it's about torchft + titan and this repo seems a bit more active i thought i could also post it here. Here's the link meta-pytorch/torchft#329. Thank you for any insight you might share

[tianyu-l]

cc @tushar00jain @d4l3k

[d4l3k]

@PGG106 commented on the torchft issue