AttributeError: module 'torch.cuda.amp' has no attribute 'autocast'

[weqvr]

AttributeError: module 'torch.cuda.amp' has no attribute 'autocast'

[WongKinYiu]

what is your pytorch version?
it seems your pytorch version is too old.

[huangruofei]

Have you solved this problem? I have the same problem

[huangruofei]

@weqvr

[Code-keys]

1、update your torch to 1.6+
2、return to use apex : "from apex import amp" and modify the code related.

[weqvr]

i solve this problem by installing torch=1.7.0

[laygond]

Yes, this model makes use of torch.cuda.amp which is available after pytorch v1.5; however, each pytorch version is built based on a CUDA version. For example, the maximum corresponding pytorch version for cuda 10.1 is pytorch 1.7.1 and therefore within the correct parameters (cuda 10.0 has a maximum pytorch version of 1.2). Also, this model architecture makes use of a manually installed mish-activation-function. Newer versions of Pytorch v1.9+ include built-in mish but you will have to change WongKinYiu's code (plus upgrade your cuda to 10.2+).