rocWMMA support?

[tedliosu]

Issue Type

Feature Request

Source

binary

Tensorflow Version

tf 2.10.0.530

Custom Code

No

OS Platform and Distribution

Linux Ubuntu 20.04

Mobile device

N/A

Python version

3.8

Bazel version

N/A

GCC/Compiler version

N/A

CUDA/cuDNN version

N/A

GPU model and memory

N/A

Current Behaviour?

With the impending release of GFX11 GPUs which support WMMA instructions, there seems to be currently no support for such WMMA instructions integrated into the ROCm tensorflow stack yet. I'm a bit concerned as the main competition already has TensorFloat-32 support for their GPUs in their tensorflow stack, and if tensorflow-ROCm is to remain relevant and competitive with the competition then at least I believe that support for WMMA instructions should be integrated into the ROCm tensorflow stack ASAP. And if the ROCm + proprietary amdgpu stack can _also_ start fully supporting GFX11 GPUs within the next few months after they launch then that'd be huge incentive for me to purchase a RX 7000 series GPU with at least 12 GB VRAM and rocWMMA support ;)

Standalone code to reproduce the issue

N/A

Relevant log output

N/A