[ExecuTorch] Use parallel_for in bfloat16 gemm_transa_ kernel

[swolchok]

Stack from ghstack (oldest at bottom):

• [ExecuTorch] Use bfdot if compiled with ARM_FEATURE_BF16 #5197
• -> [ExecuTorch] Use parallel_for in bfloat16 gemm_transa_ kernel #5196
• [ExecuTorch] Make ForcedUnroll usage in bf16 BlasKernel actually work for -Oz builds #5195
• [ExecuTorch] Add trailing dims memoization to improve performance of permute_copy_out #5194
• [ExecuTorch] port bf16 dot product kernel from ATen CPUBlas #5193
• [ExecuTorch] Preserve undelegated Linear ops in Llama demo export #5192
• [ExecuTorch] Add optimized op_linear #5124
• [ExecuTorch] Optimized op_mm using CPUBlas gemm #5123

The upstream kernel uses this, I just didn't port it at first.

Differential Revision: D62154262

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5196

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 27 New Failures

As of commit d2d42ba with merge base 2b50c76 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  RuntimeError: Command docker exec -t c757e6bfb30443156afe12647ed8c199fe0a22a106106d7e2624e9a0ebfebb8f /exec failed with exit code 1
• Lint / lintrunner / linux-job (gh)
  >>> Lint for kernels/test/op_linear_test.cpp:
• pull / test-custom-ops-linux (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 4734b4fff7d2a9387e36312360796acd401f3b8e2f5e8164057823d8b3600e6e /exec failed with exit code 1
• pull / test-custom-ops-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t ba185897b77fc5447cb1b64fbc401cf1629f2036f527db7a02f8c51b9d0f43ac /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, buck2, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t 224344d32bd845647a19c2fe2b44e2004e5ddfbd8a1ce0dbd6ded673f6b5d3c9 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, buck2, xnnpack+custom) / linux-job (gh)
  RuntimeError: Command docker exec -t 7f8330a585e219e10e792f6d56e4556cddf4a2ad0e9d6a06caa3260ff242391f /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, buck2, xnnpack+custom+qe) / linux-job (gh)
  RuntimeError: Command docker exec -t 820254cc4433397cd55cfa7a784e0f5ea980dbe3df65173d506a35e4b8a199e5 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t 769e4b89420478e2cd26c0a825b73426d7d83e4aed37cbd0908e59c7452bbb5b /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake, xnnpack+custom) / linux-job (gh)
  RuntimeError: Command docker exec -t dca16309edfbaa15150afc0c0eb834dbc080a341e08eccf06100fd06708fcf0a /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake, xnnpack+custom+qe) / linux-job (gh)
  RuntimeError: Command docker exec -t a87ca302f5de17f072dd718e14b25e43021ef65a1fa8e6d6eb7a1b22a68d7df8 /exec failed with exit code 1
• pull / test-llama-runner-linux-android (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t f00ab2dc28f7d1530a8ffc0250a0ca0b9a31447495bd4256d20c994543b06f9d /exec failed with exit code 2
• pull / test-llama-runner-qnn-linux (fp32, cmake, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t c5018a3d1d67ce5af5bb234bac4ce7841a804506faf534b0450e731f9b9e1dfc /exec failed with exit code 2
• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t a96628f6558ea6c8994b1092a6c0c62303e31a66cee2ede8c833e0ff3510e364 /exec failed with exit code 1
• pull / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 109746de294f66308adc7b59f054cfbdc1e47b4f06be71fa657f30ff3e3fdfd2 /exec failed with exit code 1
• pull / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t cb66d52e706c27db3898afd605d13620815bf6459861128ab796fddb26f56f06 /exec failed with exit code 1
• pull / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t d5ae767280188f020f68375b1afd32db5683f69407aadab672d802b646140140 /exec failed with exit code 1
• pull / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t b11a3606004642b48be45b41f0ea332e42c6531a40e92ef4833d84a8d24219b3 /exec failed with exit code 1
• pull / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t e89da2c0be2b2120fdce59984e03d4e97ec453848ff78710f504f0f0f4edc23a /exec failed with exit code 1
• pull / test-models-linux (cmake, vit, xnnpack-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 009d9e1eebeae86ce6cb3a551b8bb7c3e76bd2fb6d6106accfaeaa513d6cbeb8 /exec failed with exit code 1
• pull / test-pybind-build-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 0ec3d522d9661ecc2a52ccc259866131da85cbce4e1ecbc3fefa7f4500ef5ce8 /exec failed with exit code 1
• pull / test-quantized-aot-lib-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 4ab8c37d4f3f1ecd44184547ca03b9cf3b1058f2b962abf9d527abca33c7fd2e /exec failed with exit code 1
• pull / test-selective-build-linux (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 8dd04bacba460ac4a975acec53fade647324d83884331e17e6e12e782116f2b0 /exec failed with exit code 1
• pull / test-selective-build-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t bf1e06af5b2ca7c15ae9733eb460089ae5a6207319bc8739f0add56c7da65856 /exec failed with exit code 1
• pull / test-setup-linux-gcc (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t a7007caff3359005092a4a83b570d2254dd6d6868750248169e7237daf3640f6 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  RuntimeError: Command docker exec -t e02e8c24e11dbb7b6d9f91c1bf64642b1fb6791068b28de45d27216bd6f5f1c1 /exec failed with exit code 1
• pull / unittest / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / unittest-arm (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 2d1863f36d6934007f70a268fe41eee94653fd8fb38c37b5de70b7f1ec85798a /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D62154262

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D62154262

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D62154262

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D62154262

[swolchok]

this stack needs re-export