[inductor][cpu]opacus_cifar10 fp32 static shape default wrapper multiple threads performance regression

[zxd1997066]

🐛 Describe the bug

name	batch_size_new	speed_up_new	inductor_new	eager_new	compilation_latency_new	batch_size_old	speed_up_old	inductor_old	eager_old	compilation_latency_old	Ratio Speedup(New/old)	Eager Ratio(old/new)	Inductor Ratio(old/new)	Compilation_latency_Ratio(old/new)
opacus_cifar10	64	0.613604	0.011064978	0.006789514760712	59.939124	64	0.739715	0.009038787	0.006686126325705	27.589113	0.83	0.98	0.82	0.46

SW info

SW	Nightly commit	Main commit
Pytorch	ea7e229
Torchbench	/	770d5cf7
torchaudio	dc83b38
torchtext	c11d758
torchvision	58366ab
torchdata	1d231d1
dynamo_benchmarks	f228c8b	/

Repro:
bash inductor_single_test.sh multiple inference performance torchbench opacus_cifar10 float32 first static default 0
Suspected guilty commit: 9862c71
torchbench-opacus_cifar10-inference-float32-static-default-performance-multiple-drop_guilty_commit.log
cc @ezyang @msaroufim @bdhirsh @anijain2305 @zou3519 @WeizhuoZhang-intel @chuanqi129

[masnesral]

This is assigned, so adding the triaged label to remove it from our queue of untriaged

[leslie-fang-intel]

Also cc @yanboliang, since the suspected commit which causes regression points to 9862c71

[blzheng]

According to the latest report (#93531 (comment)), the absolute latency of inductor is 9.360099 ms, which is close to the latency before regression (9.038787ms).

[leslie-fang-intel]

Close this issue as it's close to the data before regression.