[CI/Test] Fix FP8 per-tensor quant test reference scale shape #30352
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Fixes
test_dynamic_per_tensor_fp8_quantthat was broken by #30257. (CI failure: https://buildkite.com/organizations/vllm/pipelines/ci/builds/42664/jobs/019b03c9-8e5a-4fb8-baec-7ba031141cbf/log)Issue
#30257 changed
ops.scaled_fp8_quantto return scale with shape[1]instead of[1, 1]. However, the test's reference functionref_dynamic_per_tensor_fp8_quantwas not updated to match, causing alltest_dynamic_per_tensor_fp8_quanttests to fail with:Fix
Updated
ref_dynamic_per_tensor_fp8_quantintests/kernels/quant_utils.pyto return scale with shape[1]instead of[1, 1], matching the new behavior of the ops implementation.Testing
pytest tests/kernels/quantization/test_fp8_quant.py -v # 109 passed