Optim Perf Signal Detected by TorchBench CI on 'b5b99fe13b890232bb61155a46239922661f4695'

[github-actions]

TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: b3874abf04e0579fdc0025195593d90b97178f0e

Affected PyTorch commit: b5b99fe13b890232bb61155a46239922661f4695

Affected Tests:

Tests that were no longer run on affected commit:

Tests that were newly added on affected commit:

• timm_vision_transformer_large, Adadelta, cuda, (pt2) default: 0.02814946771832183
• timm_vision_transformer_large, Adadelta, cuda, (pt2) no_foreach: 0.038562088971957564
• timm_vision_transformer_large, Adadelta, cuda, (pt2) foreach: 0.02896553324535489
• timm_vision_transformer_large, Adadelta, cuda, foreach: 0.08906917941446106
• timm_vision_transformer_large, Adagrad, cuda, (pt2) default: 0.023091250823603734
• timm_vision_transformer_large, Adagrad, cuda, (pt2) no_foreach: 0.030158286315522025
• timm_vision_transformer_large, Adagrad, cuda, (pt2) foreach: 0.02312654722481966
• timm_vision_transformer_large, Adam, cuda, (pt2) default: 0.030340568561639105
• timm_vision_transformer_large, Adam, cuda, (pt2) no_foreach: 0.05908456491306424
• timm_vision_transformer_large, Adam, cuda, (pt2) foreach: 0.03233537796352591
• timm_vision_transformer_large, AdamW, cuda, (pt2) default: 0.03256231539749673
• timm_vision_transformer_large, AdamW, cuda, (pt2) no_foreach: 0.05833212053403258
• timm_vision_transformer_large, AdamW, cuda, (pt2) foreach: 0.031883069447108676
• timm_vision_transformer_large, AdamW, cuda, foreach: 0.06900479132309556
• timm_vision_transformer_large, Adamax, cuda, (pt2) no_foreach: 0.07628471342225869
• timm_vision_transformer_large, ASGD, cuda, foreach: 0.024120567785575985
• timm_vision_transformer_large, Rprop, cuda, (pt2) default: 0.030385738837399652
• timm_vision_transformer_large, Rprop, cuda, (pt2) no_foreach: 0.040980339888483285
• timm_vision_transformer_large, Rprop, cuda, (pt2) foreach: 0.029263119945036515
• timm_vision_transformer_large, Rprop, cuda, foreach: 0.11135207861661911
• timm_vision_transformer_large, NAdam, cuda, (pt2) no_foreach: 0.06171368760988116

Runtime regressions found?
An errors log was found. Please investigate runtime errors by looking into the logs of the workflow linked.

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/6045259308

cc @janeyx99

[janeyx99]

Seems related to #1839