Skip to content

[E2E] Enable end-to-end tests supported by the SPIR-V backend #20418

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Oct 28, 2025
Merged

[E2E] Enable end-to-end tests supported by the SPIR-V backend #20418

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
34049eb
Enable tests that are marked as unsupported but are passing with SPIR-V
YixingZhang007 Sep 15, 2025
545078e
code clean up
YixingZhang007 Sep 25, 2025
154d898
resolve CI failure. update the xfail tracker for bindless_image and U…
YixingZhang007 Sep 26, 2025
3da7e81
disable the test in USM/memops2d
YixingZhang007 Oct 19, 2025
3f49dce
Add changes in sycl-post-commit.yml to enable post-commit testing
YixingZhang007 Oct 23, 2025
bd6de38
add XFAIL to tests that fail in post commit CI
YixingZhang007 Oct 24, 2025
6a473c3
remove new line from post commit yml
YixingZhang007 Oct 24, 2025
ebef10f
enable post commit testing
YixingZhang007 Oct 25, 2025
b7fd2cf
remove the extra line in sycl-post-commit.yaml
YixingZhang007 Oct 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 0 additions & 3 deletions sycl/test-e2e/Basic/device_event.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,9 +1,6 @@
// RUN: %{build} -o %t.run
// RUN: %{run} %t.run

// UNSUPPORTED: spirv-backend
// UNSUPPORTED-TRACKER: CMPLRLLVM-64705

//==--------device_event.cpp - SYCL class device_event test ----------------==//
//
// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/Basic/image/image.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,9 @@
// RUN: %{build} -o %t.out
// RUN: %{run} %t.out

// XFAIL: spirv-backend
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160589

//==------------------- image.cpp - SYCL image basic test -----------------==//
//
// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/Basic/image/image_array.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,9 @@
// RUN: %{build} -o %t.out
// RUN: %{run} %t.out

// XFAIL: spirv-backend
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160589

//==------------------- image.cpp - SYCL image basic test -----------------==//
//
// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
Expand Down
2 changes: 1 addition & 1 deletion sycl/test-e2e/Basic/image/lit.local.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#
# Legacy images aren't supported on AMD and also don't compile, so mark them
# unsupported here. Bindless images should be used instead.
config.unsupported_features += ['spirv-backend', 'target-amd']
config.unsupported_features += ['target-amd']

# Legacy images aren't supported on Native CPU. Bindless images should be used
# instead when they are working.
Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/Basic/image/srgba-read.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@
// RUN: %{build} -o %t.out
// RUN: %{run} %t.out | FileCheck %s

// XFAIL: spirv-backend
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160589

#include <iostream>
#include <sycl/accessor_image.hpp>
#include <sycl/detail/core.hpp>
Expand Down
4 changes: 0 additions & 4 deletions sycl/test-e2e/NonUniformGroups/chunk_algorithms.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,10 +11,6 @@
// UNSUPPORTED: target-amd
// UNSUPPORTED-INTENDED: fixed_size_group aspect not available on amd

// UNSUPPORTED: spirv-backend
// UNSUPPORTED-TRACKER: CMPLRLLVM-64702
// The test is disabled for spirv-backend while we investigate the root cause.

// XFAIL: target-native_cpu
// XFAIL-TRACKER: https://github.com/intel/llvm/issues/20142

Expand Down
4 changes: 0 additions & 4 deletions sycl/test-e2e/NonUniformGroups/fragment_algorithms.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,6 @@
// UNSUPPORTED: cuda
// UNSUPPORTED-TRACKER: https://github.com/intel/llvm/issues/12995

// UNSUPPORTED: spirv-backend
// UNSUPPORTED-TRACKER: CMPLRLLVM-64702
// The test is disabled for spirv-backend while we investigate the root cause.

#include <sycl/detail/core.hpp>
#include <sycl/ext/oneapi/experimental/fragment.hpp>
#include <sycl/group_algorithm.hpp>
Expand Down
4 changes: 0 additions & 4 deletions sycl/test-e2e/Reduction/reduction_span.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,6 @@

// This test performs basic checks of reductions initialized with a sycl::span

// Depends on SPIR-V Backend & run-time drivers version.
// XFAIL: spirv-backend && cpu
// XFAIL-TRACKER: CMPLRLLVM-64705

#include <sycl/detail/core.hpp>

#include <sycl/reduction.hpp>
Expand Down
4 changes: 0 additions & 4 deletions sycl/test-e2e/Reduction/reduction_span_pack.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,6 @@
// This test performs basic checks of reductions initialized with a pack
// containing at least one sycl::span

// Depends on SPIR-V Backend & run-time drivers version.
// XFAIL: spirv-backend && cpu
// XFAIL-TRACKER: CMPLRLLVM-64705

#include <sycl/detail/core.hpp>

#include <sycl/reduction.hpp>
Expand Down
2 changes: 1 addition & 1 deletion sycl/test-e2e/Sampler/lit.local.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
#
# Legacy images aren't supported on AMD and also don't compile, so mark them
# unsupported here. Bindless images should be used instead.
config.unsupported_features += ['spirv-backend', 'target-amd']
config.unsupported_features += ['target-amd']

# Legacy images aren't supported on Native CPU. Use bindless_images when working.
# https://github.com/intel/llvm/issues/20142
Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/aot/gpu.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,6 @@

// RUN: %{run-aux} %{build} %device_tsan_aot_flags -O3 -g %S/Inputs/usm_data_race.cpp -o %t.out
// RUN: %{run} %t.out 2>&1 | FileCheck %S/Inputs/usm_data_race.cpp

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602
3 changes: 3 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/check_buffer.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,9 @@
// RUN: %{build} %device_tsan_flags -O2 -g -o %t2.out
// RUN: %{run} %t2.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include <sycl/detail/core.hpp>

static const int N = 128;
Expand Down
4 changes: 4 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/check_device_global.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,10 @@
// RUN: %{run} %t1.out 2>&1 | FileCheck %s
// RUN: %{build} %device_tsan_flags -O2 -g -o %t2.out
// RUN: %{run} %t2.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include <sycl/detail/core.hpp>
#include <sycl/ext/oneapi/device_global/device_global.hpp>

Expand Down
4 changes: 4 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/check_device_usm.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@
// ALLOW_RETRIES: 10
// RUN: %{build} %device_tsan_flags -O0 -g -o %t.out
// RUN: %{run} %t.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include "sycl/detail/core.hpp"
#include "sycl/usm.hpp"

Expand Down
4 changes: 4 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/check_host_usm.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@
// ALLOW_RETRIES: 10
// RUN: %{build} %device_tsan_flags -O0 -g -o %t.out
// RUN: %{run} %t.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include "sycl/detail/core.hpp"
#include "sycl/usm.hpp"

Expand Down
4 changes: 4 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/check_shared_usm.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@
// ALLOW_RETRIES: 10
// RUN: %{build} %device_tsan_flags -O0 -g -o %t.out
// RUN: %{run} %t.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include "sycl/detail/core.hpp"
#include "sycl/usm.hpp"

Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/check_sub_buffer.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,9 @@
// RUN: %{build} %device_tsan_flags -O2 -g -o %t2.out
// RUN: %{run} %t2.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include <sycl/detail/core.hpp>

int main() {
Expand Down
4 changes: 4 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/group_local_memory.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@
// ALLOW_RETRIES: 10
// RUN: %{build} %device_tsan_flags -O0 -g -o %t.out
// RUN: %{run} %t.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include "sycl/ext/oneapi/group_local_memory.hpp"
#include "sycl/detail/core.hpp"
#include "sycl/usm.hpp"
Expand Down
3 changes: 0 additions & 3 deletions sycl/test-e2e/ThreadSanitizer/lit.local.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,6 @@ config.unsupported_features += ['target-nvidia', 'target-amd']
# TRACKER: https://github.com/intel/llvm/issues/16184
config.unsupported_features += ['gpu-intel-gen12', 'gpu-intel-dg2']

# CMPLRLLVM-64052
Copy link
Contributor

@KseniyaTikhomirova KseniyaTikhomirova Oct 24, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do see more disabled tests in repo:


./sycl/test-e2e/AddressSanitizer/lit.local.cfg:config.unsupported_features += ['spirv-backend']
enabled back ./sycl/test-e2e/Basic/image/lit.local.cfg:config.unsupported_features += ['spirv-backend', 'target-amd']
enabled back ./sycl/test-e2e/Sampler/lit.local.cfg:config.unsupported_features += ['spirv-backend', 'target-amd']
./sycl/test-e2e/MemorySanitizer/lit.local.cfg:config.unsupported_features += ['spirv-backend']
./sycl/test-e2e/ESIMD/lit.local.cfg:config.unsupported_features += ['spirv-backend']
enabled back ./sycl/test-e2e/bindless_images/lit.local.cfg:config.unsupported_features += ['spirv-backend']
./sycl/test-e2e/Matrix/lit.local.cfg:config.unsupported_features += ['spirv-backend']
enabled back ./sycl/test-e2e/ThreadSanitizer/lit.local.cfg:config.unsupported_features += ['spirv-backend']
./sycl/test-e2e/USM/memops2d/lit.local.cfg:config.unsupported_features += ['spirv-backend']
./sycl/test-e2e/InvokeSimd/lit.local.cfg:config.unsupported_features += ['spirv-backend']

memory sanitizer test disabling refers to the same Jira as here:
https://github.com/intel/llvm/blob/sycl/sycl/test-e2e/MemorySanitizer/lit.local.cfg#L18

Just want to ensure that other tests are intentionally not enabled back. Could you please confirm?

Copy link
Contributor Author

@YixingZhang007 YixingZhang007 Oct 24, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for pointing this out! You can find more details about which tests were enabled and the Jira tickets that resolved them in Jira CMPLRLLVM-70031. The tests that remain disabled are intentional, as they are still failing and need to be resolved by the SPIR-V Backend team.

config.unsupported_features += ['spirv-backend']

# https://github.com/intel/llvm/issues/16920
config.unsupported_features += ['arch-intel_gpu_bmg_g21']

Expand Down
4 changes: 4 additions & 0 deletions sycl/test-e2e/ThreadSanitizer/local_accessor.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@
// ALLOW_RETRIES: 10
// RUN: %{build} %device_tsan_flags -O0 -g -o %t.out
// RUN: %{run} %t.out 2>&1 | FileCheck %s

// XFAIL: spirv-backend && arch-intel_gpu_pvc
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160602

#include "sycl/detail/core.hpp"
#include "sycl/usm.hpp"

Expand Down
3 changes: 0 additions & 3 deletions sycl/test-e2e/USM/copy.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,6 @@
// RUN: %{build} -fsycl-device-code-split=per_kernel -o %t1.out
// RUN: %{run} %t1.out

// UNSUPPORTED: spirv-backend && arch-intel_gpu_bmg_g21
// UNSUPPORTED-TRACKER: CMPLRLLVM-64705

#include <sycl/detail/core.hpp>
#include <sycl/usm.hpp>

Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/bindless_images/array/read_write_unsampled_array.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@
// RUN: %{build} -o %t.out
// RUN: %{run} env NEOReadDebugKeys=1 UseBindlessMode=1 UseExternalAllocatorForSshAndDsh=1 %t.out

// XFAIL: spirv-backend
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160893

#include "../helpers/common.hpp"
#include <iostream>
#include <random>
Expand Down
4 changes: 0 additions & 4 deletions sycl/test-e2e/bindless_images/lit.local.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,3 @@
# Support of this feature is waiting for the upstream PR
# https://github.com/llvm/llvm-project/pull/127737 to be merged with intel/llvm.
config.unsupported_features += ['spirv-backend']

# https://github.com/intel/llvm/issues/20142
config.unsupported_features += ['target-native_cpu']

Expand Down
3 changes: 3 additions & 0 deletions sycl/test-e2e/bindless_images/read_write_unsampled.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,9 @@
// RUN: %{build} -o %t.out
// RUN: %{run-unfiltered-devices} env NEOReadDebugKeys=1 UseBindlessMode=1 UseExternalAllocatorForSshAndDsh=1 %t.out

// XFAIL: spirv-backend
// XFAIL-TRACKER: https://github.com/llvm/llvm-project/issues/160893

#include "helpers/common.hpp"
#include <iostream>
#include <sycl/detail/core.hpp>
Expand Down
Loading