Fix autograd

[VitalyFedyunin]

Stack from ghstack:

• [WIP] explicitly provide memory format when calling to *_like operators #29680 [WIP] explicitly provide memory format when calling to *_like operators
• explicitly provide memory format when calling to *_like operators #29679 explicitly provide memory format when calling to *_like operators
• explicitly provide memory format when calling to *_like operators #29678 explicitly provide memory format when calling to *_like operators
• fix more derivatives #29677 fix more derivatives
• fix derivatives #29676 fix derivatives
• Fix autograd #29675 Fix autograd
• fix gumbel_softmax #29674 fix gumbel_softmax
• [WIP] switch defaults #29452 [WIP] switch defaults
• explicitly provide memory format when calling to *_like operators (Redo of 81bf73643b6552a63794fb889238aaf0c2a7baa6) #29451 explicitly provide memory format when calling to *_like operators (Redo of 81bf736)
• explicitly provide memory format when calling to *_like operators (Redo of cc1c0120bc86b049bba36f2ff19a4f7b00e8e841) #29450 explicitly provide memory format when calling to *_like operators (Redo of cc1c012)
• explicitly provide memory format when calling to *_like operators (Redo of e3e06549c196d4c6128d8cf3916037fdd386800e) #29449 explicitly provide memory format when calling to *_like operators (Redo of e3e0654)
• explicitly provide memory format when calling to *_like operators (Redo of 4b4aa20399fb4c762fb6d2395b39f0f794f9f322) #29448 explicitly provide memory format when calling to *_like operators (Redo of 4b4aa20399fb4c762fb6d2395b39f0f794f9f322)
• explicitly provide memory format when calling to *_like operators (Redo of ce438f6967) #29447 explicitly provide memory format when calling to *_like operators (Redo of ce438f6967)
• explicitly provide memory format when calling to *_like operators (Redo of 631b22dbed219dedecb66e483383bfdd43f486c4) #29446 explicitly provide memory format when calling to *_like operators (Redo of 631b22dbed219dedecb66e483383bfdd43f486c4)
• explicitly provide memory format when calling to *_like operators #29392 explicitly provide memory format when calling to *_like operators
• explicitly provide memory format when calling to *_like operators #29391 explicitly provide memory format when calling to *_like operators
• explicitly provide memory format when calling to *_like operators #29390 explicitly provide memory format when calling to *_like operators
• explicitly provide memory format when calling to *_like operators #29389 explicitly provide memory format when calling to *_like operators
• explicitly provide memory format when calling to *_like operators #29388 explicitly provide memory format when calling to *_like operators