Enable quantization for bf16 model

[navsud]

Summary: To save GPU memory bfloat16 dtype is commonly used for training of LLMs. Currently, the quantizer ignores quantizing the nodes if they are not float32. This change enables quantization of bf16 nodes as well.

Differential Revision: D82866443

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14558

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [Maintenance] MacOS runners update

❌ 4 New Failures, 2 Cancelled Jobs

As of commit 9a886d2 with merge base c98079a ():

NEW FAILURES - The following jobs have failed:

• pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t 768d0ffbfb969730747b7fae9cf506c5f430cfa27c419199a10af2f1ed3ae520 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t 370d0946939f9ff727b513cdebe3cce4777c371ea11c79830ca32ff14dcfc3f4 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t a85eb243824da1bad52be10f5fbe523bced022f0e954f4298b9d3bc584e0606e /exec failed with exit code 1
• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 20421365a6a5f9521eb2881c05b1a48eeff3cd5f16636e9caaa959fd4c91581b /exec failed with exit code 1

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• pull / test-binary-size-linux-gcc / linux-job (gh)
• pull / test-setup-linux-gcc / linux-job (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

@navsud has exported this pull request. If you are a Meta employee, you can view the originating diff in D82866443.

[facebook-github-bot]

@navsud has exported this pull request. If you are a Meta employee, you can view the originating diff in D82866443.