Skip to content

Add XFAIL to tests that regressed on Vulkan after vector swizzle store fix #546

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 3 commits into from
Closed

Add XFAIL to tests that regressed on Vulkan after vector swizzle store fix #546

wants to merge 3 commits into from

Conversation

@hekota
Copy link
Member

@hekota hekota commented Dec 2, 2025

Regressed after llvm/llvm-project#169090.

Issue tracing the fix for SPIRV is: llvm/llvm-project#170241

Icohedron and others added 3 commits December 2, 2025 13:12
@Icohedron
XFAIL Clang && Vulkan in matrix_scalar_arithmetic and `matrix_scala…
7c67cdd 
…r_constructor` tests (llvm#539)

As observed in llvm#538 the tests `Basic/matrix_scalar_arithmetic.test` and
`Basic/matrix_scalar_constructor.test` are failing on all runners under
Vulkan+Clang.

Until the issue is fixed, it shall be XFAILed to make the badges green.
@Icohedron
Update XFAILs of WaveReadLaneAt.16/32/Int.64/Float.64 (llvm#534)
8561a86 
Updates the XFAILs of the `WaveReadLaneAt.16/32/Int.64/Float.64` tests.

Vulkan results: (caused by
llvm/llvm-project#170241 so not XFAILed)
```
╭────┬──────────────────────┬─────────────┬─────────────────────────────┬─────────────┬──────────────────────────────────────╮
│  # │      timestamp       │   run-id    │          workflow           │   status    │                 test                 │
├────┼──────────────────────┼─────────────┼─────────────────────────────┼─────────────┼──────────────────────────────────────┤
│  0 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ FAIL        │ WaveOps/WaveReadLaneAt.16.test       │
│  1 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ FAIL        │ WaveOps/WaveReadLaneAt.32.test       │
│  2 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ FAIL        │ WaveOps/WaveReadLaneAt.Float.64.test │
│  3 │ 2025-11-28T18:06:34Z │ 19771064332 │ Windows Vulkan AMD Clang    │ FAIL        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│  4 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ FAIL        │ WaveOps/WaveReadLaneAt.32.test       │
│  5 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ FAIL        │ WaveOps/WaveReadLaneAt.16.test       │
│  6 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ FAIL        │ WaveOps/WaveReadLaneAt.Float.64.test │
│  7 │ 2025-11-28T20:04:28Z │ 19772907221 │ Windows Vulkan Intel Clang  │ FAIL        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│  8 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ FAIL        │ WaveOps/WaveReadLaneAt.32.test       │
│  9 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ FAIL        │ WaveOps/WaveReadLaneAt.16.test       │
│ 10 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ FAIL        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 11 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ FAIL        │ WaveOps/WaveReadLaneAt.16.test       │
│ 12 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ FAIL        │ WaveOps/WaveReadLaneAt.32.test       │
│ 13 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ FAIL        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 14 │ 2025-11-28T06:02:32Z │ 19755520578 │ Windows Vulkan NVIDIA Clang │ FAIL        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 15 │ 2025-11-28T18:05:50Z │ 19771050617 │ Windows Vulkan AMD DXC      │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 16 │ 2025-11-28T18:05:50Z │ 19771050617 │ Windows Vulkan AMD DXC      │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 17 │ 2025-11-28T18:05:50Z │ 19771050617 │ Windows Vulkan AMD DXC      │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 18 │ 2025-11-28T18:05:50Z │ 19771050617 │ Windows Vulkan AMD DXC      │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 19 │ 2025-11-28T22:01:55Z │ 19774580028 │ Windows Vulkan Intel DXC    │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 20 │ 2025-11-28T22:01:55Z │ 19774580028 │ Windows Vulkan Intel DXC    │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 21 │ 2025-11-28T22:01:55Z │ 19774580028 │ Windows Vulkan Intel DXC    │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 22 │ 2025-11-28T22:01:55Z │ 19774580028 │ Windows Vulkan Intel DXC    │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 23 │ 2025-11-28T02:35:49Z │ 19752462306 │ Windows Vulkan NVIDIA DXC   │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 24 │ 2025-11-28T02:35:49Z │ 19752462306 │ Windows Vulkan NVIDIA DXC   │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 25 │ 2025-11-28T02:35:49Z │ 19752462306 │ Windows Vulkan NVIDIA DXC   │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 26 │ 2025-11-28T02:35:49Z │ 19752462306 │ Windows Vulkan NVIDIA DXC   │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 27 │ 2025-11-28T18:02:29Z │ 19770990351 │ Windows Vulkan QC DXC       │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 28 │ 2025-11-28T18:02:29Z │ 19770990351 │ Windows Vulkan QC DXC       │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 29 │ 2025-11-28T18:02:29Z │ 19770990351 │ Windows Vulkan QC DXC       │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 30 │ 2025-11-28T22:06:03Z │ 19774646176 │ Windows Vulkan QC Clang     │ UNSUPPORTED │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 31 │ 2025-11-28T18:02:29Z │ 19770990351 │ Windows Vulkan QC DXC       │ UNSUPPORTED │ WaveOps/WaveReadLaneAt.Float.64.test │
├────┼──────────────────────┼─────────────┼─────────────────────────────┼─────────────┼──────────────────────────────────────┤
│  # │      timestamp       │   run-id    │          workflow           │   status    │                 test                 │
╰────┴──────────────────────┴─────────────┴─────────────────────────────┴─────────────┴──────────────────────────────────────╯
```

D3D12 / DirectX results:
```
╭────┬──────────────────────┬─────────────┬────────────────────────────────┬─────────────┬──────────────────────────────────────╮
│  # │      timestamp       │   run-id    │            workflow            │   status    │                 test                 │
├────┼──────────────────────┼─────────────┼────────────────────────────────┼─────────────┼──────────────────────────────────────┤
│  0 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ FAIL        │ WaveOps/WaveReadLaneAt.Float.64.test │
│  1 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ FAIL        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│  2 │ 2025-11-28T18:01:00Z │ 19770962737 │ Windows D3D12 AMD DXC          │ FAIL        │ WaveOps/WaveReadLaneAt.Float.64.test │
│  3 │ 2025-11-28T18:01:00Z │ 19770962737 │ Windows D3D12 AMD DXC          │ FAIL        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│  4 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ FAIL        │ WaveOps/WaveReadLaneAt.16.test       │
│  5 │ 2025-11-28T22:05:58Z │ 19774644845 │ Windows D3D12 QC DXC           │ FAIL        │ WaveOps/WaveReadLaneAt.16.test       │
│  6 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│  7 │ 2025-11-28T18:05:56Z │ 19771052674 │ Windows D3D12 AMD Clang        │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│  8 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│  9 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 10 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 11 │ 2025-11-28T18:01:00Z │ 19770962737 │ Windows D3D12 AMD DXC          │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 12 │ 2025-11-28T18:01:00Z │ 19770962737 │ Windows D3D12 AMD DXC          │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 13 │ 2025-11-28T18:08:36Z │ 19771099390 │ Windows D3D12 Warp DXC         │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 14 │ 2025-11-28T18:08:36Z │ 19771099390 │ Windows D3D12 Warp DXC         │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 15 │ 2025-11-28T18:08:36Z │ 19771099390 │ Windows D3D12 Warp DXC         │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 16 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 17 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 18 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 19 │ 2025-11-28T20:03:54Z │ 19772898840 │ Windows D3D12 Intel Clang      │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 20 │ 2025-11-28T22:00:55Z │ 19774566187 │ Windows D3D12 Intel DXC        │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 21 │ 2025-11-28T22:00:55Z │ 19774566187 │ Windows D3D12 Intel DXC        │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 22 │ 2025-11-28T22:00:55Z │ 19774566187 │ Windows D3D12 Intel DXC        │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 23 │ 2025-11-28T22:00:55Z │ 19774566187 │ Windows D3D12 Intel DXC        │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 24 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 25 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 26 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 27 │ 2025-11-28T18:06:07Z │ 19771055797 │ Windows D3D12 NVIDIA Clang     │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 28 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 29 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 30 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 31 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 32 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 33 │ 2025-11-28T22:05:58Z │ 19774644845 │ Windows D3D12 QC DXC           │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 34 │ 2025-11-28T22:05:58Z │ 19774644845 │ Windows D3D12 QC DXC           │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 35 │ 2025-11-28T22:00:47Z │ 19774563511 │ Windows ARM64 D3D12 Warp DXC   │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 36 │ 2025-11-28T22:00:47Z │ 19774563511 │ Windows ARM64 D3D12 Warp DXC   │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 37 │ 2025-11-28T22:00:47Z │ 19774563511 │ Windows ARM64 D3D12 Warp DXC   │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 38 │ 2025-11-28T06:03:54Z │ 19755547346 │ Windows D3D12 NVIDIA DXC       │ PASS        │ WaveOps/WaveReadLaneAt.16.test       │
│ 39 │ 2025-11-28T06:03:54Z │ 19755547346 │ Windows D3D12 NVIDIA DXC       │ PASS        │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 40 │ 2025-11-28T06:03:54Z │ 19755547346 │ Windows D3D12 NVIDIA DXC       │ PASS        │ WaveOps/WaveReadLaneAt.Int.64.test   │
│ 41 │ 2025-11-28T06:03:54Z │ 19755547346 │ Windows D3D12 NVIDIA DXC       │ PASS        │ WaveOps/WaveReadLaneAt.32.test       │
│ 42 │ 2025-11-28T22:00:51Z │ 19774564659 │ Windows D3D12 QC Clang         │ UNSUPPORTED │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 43 │ 2025-11-28T22:05:58Z │ 19774644845 │ Windows D3D12 QC DXC           │ UNSUPPORTED │ WaveOps/WaveReadLaneAt.Float.64.test │
│ 44 │ 2025-11-28T18:03:22Z │ 19771005843 │ Windows D3D12 Warp Clang       │ XFAIL       │ WaveOps/WaveReadLaneAt.16.test       │
│ 45 │ 2025-11-28T18:08:36Z │ 19771099390 │ Windows D3D12 Warp DXC         │ XFAIL       │ WaveOps/WaveReadLaneAt.16.test       │
│ 46 │ 2025-11-28T22:04:42Z │ 19774625191 │ Windows ARM64 D3D12 Warp Clang │ XFAIL       │ WaveOps/WaveReadLaneAt.16.test       │
│ 47 │ 2025-11-28T22:00:47Z │ 19774563511 │ Windows ARM64 D3D12 Warp DXC   │ XFAIL       │ WaveOps/WaveReadLaneAt.16.test       │
├────┼──────────────────────┼─────────────┼────────────────────────────────┼─────────────┼──────────────────────────────────────┤
│  # │      timestamp       │   run-id    │            workflow            │   status    │                 test                 │
╰────┴──────────────────────┴─────────────┴────────────────────────────────┴─────────────┴──────────────────────────────────────╯
```
@hekota
Merge branch 'main' of https://github.com/llvm/offload-test-suite int…
971b739 
…o xfail-vector-swizzle
@hekota hekota closed this Dec 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@hekota @Icohedron