6900XT invalid value encountered in reduce/multiply

[HappiestCow22]

Can't get any model to train without erroring out after 1-5 minutes.
Running DirectX12 version on windows. Using 6900XT

[HappiestCow22]

I've tried many things for months now to fix this, but I think it was related to my overclock. After DDU'ing my driver and trying it again, it seemed to be training correctly. Then when I applied my overclock profile, it instantly broke. I have it running right now at default settings which are pushing 90C on my gpu. It seems to also break if I underclock it. Leaving this open until I'm comfortable that I've fixed it.

[HappiestCow22]

Reproducible behavior, looks like its directly related to unstable clocks. (stability for training seems to be more strict than running games). Running a lower clock speed with almost untouched voltages seems to work well.