move float8 blockwise kernels out of prototype

[vkuzo]

Summary:

These will be useful as a fallback path for a_1_128_w_128_128 (DeepSeek)
scaling support for float8 inference. Bringing out of prototype folder.

Test Plan:

pytest test/kernel/test_blockwise_triton.py -s -x
python benchmarks/benchmark_blockwise_scaled_linear_triton.py

Reviewers:

Subscribers:

Tasks:

Tags:

[vkuzo]

Stack from ghstack (oldest at bottom):

• add bias handling for a_1_128_w_128_128 float8 scaling #3259
• add a_1_128_w_128_128 (DeepSeek) float8 scaling for inference #3257
• -> move float8 blockwise kernels out of prototype #3256

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3256

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Long queue for ROCM runners, also B200 and XPU queueing is observed

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[danielvegamyhre]

note for later: let's rename this torchao.kernels* (plural)