Interchange Cast and Transpose operations to facilitate Transpose-MatMul fusion

[satyajandhyala]

Description: Modify Transpose-MatMul fusion code to interchange a Cast, between Transpose and MatMul preventing fusion, with the Transpose

Motivation and Context

• The change is required to facilitate Transpose-MatMul fusion for better optimization
• If it fixes an open issue, please link to the issue here. https://msdata.visualstudio.com/Vienna/_sprints/taskboard/ONNX%20Training/Vienna/Cobalt

[ashbhandare]

could you also check in the python file that generated the onnx files for tests?

[satyajandhyala]

could you also check in the python file that generated the onnx files for tests?

I actually created the ONNX file from the existing model

[ytaous]

+1

---

In reply to: 793008584 [](ancestors = 793008584)

[ytaous]

you should be able to take a similar .py code to generate the onnx model, it's fun to play with :-)

---

In reply to: 793034066 [](ancestors = 793034066)

[SherlockNoMad]

Please add label to future PRs.
We are using the label to filter the PRs we should review.