Skip to content
This repository was archived by the owner on Aug 1, 2025. It is now read-only.
This repository was archived by the owner on Aug 1, 2025. It is now read-only.

[Inductor] [CPU] Accuracy failure in timm model cait_m36_384 on WW03.2 #2037

@yudongsi

Description

@yudongsi

🐛 Describe the bug

Compare with the ww02.4, there is a accuracy failure on Timm model cait_m36_384 on TorchInductor CPU Performance Dashboard on ww03.2:

WW03.2 SW info:

SW Nightly commit Master/Main commit
Pytorch 868797a d41b5d7
Torchbench / bbdc777
torchaudio ecc2781 4a037b0
torchtext 112d757 c7cc5fc
torchvision ac06efe 35f68a0
torchdata 049fb62 c0934b9
dynamo_benchmarks fac4361 /

WW02.4 SW info:

SW Nightly commit Master/Main commit
Pytorch 466be3f 364f526
Torchbench / bbdc777
torchaudio ecc2781 4a037b0
torchtext 112d757 c7cc5fc
torchvision ac06efe 35f68a0
torchdata 049fb62 c0934b9
dynamo_benchmarks fac4361 /

Error logs

cpu  eval  cait_m36_384                       [2023-01-16 07:57:33,035] torch._dynamo.utils: [ERROR] RMSE (res-fp64): 0.66366, (ref-fp64): 0.00000 and shape=torch.Size([4, 1000])
FAIL

Minified repro

python -m torch.backends.xeon.run_cpu --core_list 0 --ncores_per_instance 1 benchmarks/dynamo/timm_models.py --accuracy --float32 -dcpu -n50 --inductor  --no-skip --dashboard --only cait_m36_384


Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions