TF32 support, MI300 & MI325 spec list TF32 performance numbers but it seems there is no way of enabling it in pytorch

[Delaunay]

🚀 The feature, motivation and pitch

TF32 support, MI300 & MI325 spec list TF32 performance numbers, but it seems there is no way of enabling it in pytorch
as per the torch compat document.

TF32 yields significant performance uplift across the board.

Alternatives

No response

Additional context

No response

[ppanchad-amd]

Hi @Delaunay. Internal ticket has been created to assist with your issue. Thanks!

[adityas-amd]

@Delaunay there is a tf32 support for earlier versions of ROCm/Pytorch in the [release/2.5] branch #1838