Add a pass to fuse mul.Scalar into dequant

[mcremon-meta]

Summary: The scalar mul can be folded into the dequant args. Motivating example: vit_b_16 shows that pattern, resulting in 1% less latency (30k cycles).

Differential Revision: D74626626

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D74626626

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10853

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [PREEMPTIVE] Removal of ephemeral variants on scale-config.yml

❌ 9 New Failures, 4 Unrelated Failures

As of commit 0e816b4 with merge base a21022c ():

NEW FAILURES - The following jobs have failed:

• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t cf5c17e02757aff67139acb7d996951afdda74ac77d69bf1aa7d1bfeff8b5d5e /exec failed with exit code 1
• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 78501d45b23034f39a05d68de86186dda1ee430991b12ced681587397fa0d1b3 /exec failed with exit code 1
• pull / test-eval_llama-wikitext-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 978a08518a9f9bb16ad6660f9ef6f9de8c67dda5893cc3601b7d52e7f3e4b4c3 /exec failed with exit code 1
• pull / test-llama_runner_eager-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9374a50dbccc91d08513cff2f4aa3d2b97668e984386502f98eed5f7509ff623 /exec failed with exit code 1
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 4b23c949a6d932435d740acd13c226cb60d6bcd4fd2bb9beda21f4adf4b3040d /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 53caafa98b99a9a943b2c48fe9dc9ee00eb26b8eb547feb9207d7a74b8cd5b47 /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 1fc2b7ed3658c0a462f83ee606c029a1cbe2966d2dfb202b4fd879d9e4c43e08 /exec failed with exit code 1
• pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 6629c66a694144bf4343147f1b95e70cd884f165c2e3621e27d64e7312f528f5 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t f270a63881ada56f9703614ad86909577ef1b7ee6454590f1ddf05456e541823 /exec failed with exit code 1

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / unittest-editable / linux / linux-job (gh) (similar failure)
  examples/models/llama/tests/test_export_llama_lib.py::ExportLlamaLibTest::test_has_expected_ops_and_op_counts

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest / linux / linux-job (gh) (trunk failure)
  examples/models/llama/tests/test_export_llama_lib.py::ExportLlamaLibTest::test_has_expected_ops_and_op_counts
• pull / unittest / macos / macos-job (gh) (trunk failure)
  examples/models/llama/tests/test_export_llama_lib.py::ExportLlamaLibTest::test_has_expected_ops_and_op_counts
• pull / unittest-editable / macos / macos-job (gh) (trunk failure)
  examples/models/llama/tests/test_export_llama_lib.py::ExportLlamaLibTest::test_has_expected_ops_and_op_counts

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D74626626

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D74626626