Skip to content

Releases: KhronosGroup/OpenXR-CTS

OpenXR CTS 1.1.37.0

06 Jun 22:25
openxr-cts-1.1.37.0
Compare
Choose a tag to compare

OpenXR CTS 1.1.37.0 (2024-06-06)

Status

  • Approved by the Working Group 06-June-2024
  • Not yet subject to a withdrawal vote.

Assets

There are (or will be) Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

Changes

  • Conformance Tests
    • Fix: Action test when constrained to right-hand only.
      (internal MR 3244)
    • Fix: Skip StereoWithFoveatedInset-interactive if runtime does not support it.
      (internal MR 3350)
    • Fix: Dangling pointer in action test.
      (internal MR 3357)
    • Fix: Resolve Vulkan validation warning in some tests.
      (internal MR 3367)
    • Improvement: Use absolute epsilons for pose comparison in action test.
      (internal MR 3244)
    • Improvement: Improve user message in action test.
      (internal MR 3244)
    • Improvement: Only suggest binding the proceed action to ".../click" binding
      paths, rather than all binding paths of boolean type, to avoid accidental
      activation.
      (internal MR 3312)
    • Improvement: Support hiding parts of models in the glTF/PBR subsystem.
      (internal MR 3314)
    • Improvement: Code cleanup.
      (internal MR 3323)
    • Improvement: Use new XR_API_VERSION_1_0 and XR_API_VERSION_1_1 defines.
      (internal MR 3329)
    • Improvement: Relax too strict palm/grip_surface pose assumptions.
      (internal MR 3345)
    • Improvement: Add missing extension name tags to test cases.
      (internal MR 3355)
    • Improvement: Code cleanup and documentation in helper utilities.
      (internal MR 3356)
    • Improvement: Code cleanups and clang-tidy fixes.
      (internal MR 3357,
      internal MR 3357)
    • Improvement: Improve readability of test sources.
      (internal MR 3358)
    • Improvement: Fix duplicated inaccurate code comment.
      (internal MR 3372)
    • New test: Add interactive tests for XR_KHR_composition_layer_equirect and
      XR_KHR_composition_layer_equirect2.
      (internal MR 2882)
    • New test: Add test which creates a session but does not call
      xrDestroySession.
      (internal MR 3247)

OpenXR CTS 1.1.36.0

08 May 22:05
openxr-cts-1.1.36.0
Compare
Choose a tag to compare

OpenXR CTS 1.1.36.0 (2024-04-25)

Status

  • Approved by the Working Group 25-April-2024
  • Will be withdrawn 3-December-2024, 180 days after the publication of the subsequent approved release, 1.1.37.0.

Assets

There are (or will be) Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

Errata

There is a test related to the XR_VARJO_quad_views extension that will (erroneously) fail if you do not implement it. A fix for this is forthcoming in the next release. Submissions with this release may include a reference to this known errata in the conformance statement.

Changes

This new release supports testing both OpenXR 1.0 and OpenXR 1.1 runtimes, and
defaults to OpenXR 1.1 mode. See the README for more details.

OpenXR CTS 1.0.34.0

05 Mar 16:01
openxr-cts-1.0.34.0
Compare
Choose a tag to compare

OpenXR CTS 1.0.34.0 (2024-02-29)

Status

  • Approved by the Working Group 29-February-2024
  • Will be withdrawn for submissions effective 04-November-2024.

Assets

There are (or will be) Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

Changes

  • Conformance Tests
    • Fix: Correct the warning for when Wrist Z variance is above the 14 degree
      threshold.
      (internal MR 3043)
    • Improvement: Code cleanup and documentation in the conformance layer.
      (internal MR 3044)
    • Improvement: Make the conformance layer throw a distinct error when it
      encounters a handle whose creation it did not wrap.
      (internal MR 3089)
    • Improvement: Mention in the instructions/README that the conformance automation
      extension may not be used for conformance submissions, and write a comment
      about this to the XML output when it is in use for easier identification.
      (internal MR 3143)
    • Improvement: Reduce the maximum time allowed for transitioning session state in
      debug mode from 1 hour to 1 minute, and add a notice message in debug mode
      explaining this.
      (internal MR 3151)
    • New test: Validate that XrEventDataInteractionProfileChanged is only queued
      during xrSyncActions using the conformance layer.
      (internal MR 3044,
      internal issue 1883,
      internal MR 3211)
    • New test: "SpaceOffset" interactive test validates the results of calling
      xrLocateSpace on spaces created with a non-identity pose. This tests some of
      the same math that Interactive Throw is intended to test, but with automatic
      pass/fail detection and better troubleshooting assistance and debugging
      visualization.
      (internal MR 3058,
      internal issue 1855)

OpenXR CTS 1.0.33.0

18 Jan 23:34
openxr-cts-1.0.33.0
Compare
Choose a tag to compare

Status

  • Approved by the Working Group 18-January-2024
  • Withdrawal effective 2024-September-01

Assets

There are (or will be) Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

Note that the Android APK attached to this release is signed with a different key and certificate than previous releases. You will need to uninstall any old builds of OpenXR-CTS before installing this new one. The new signer is:

Number of signers: 1
Signer #1 certificate DN: EMAILADDRESS=openxr-speceditor@khronos.org, CN=OpenXR APK CTS Signer S1, OU=OpenXR Working Group, O=The Khronos Group Inc, L=Beaverton, ST=Oregon, C=US
Signer #1 certificate SHA-256 digest: 6d8124d54016c7dbe5c80a998a3a7ef79cc361841dfd0dd94e1e988dbb9d0bc8
Signer #1 certificate SHA-1 digest: ef41b23e37655f26106354108fe5571be5c24974
Signer #1 certificate MD5 digest: 11c8fe93e55d07de52e37f0890e333ac
Signer #1 key algorithm: RSA
Signer #1 key size (bits): 4096
Signer #1 public key SHA-256 digest: 6c1fb50247e148506529d8557aea6e595041d055237fe9bd476b852cf667afa6
Signer #1 public key SHA-1 digest: db68b546a45fc53fa11141d636ac1cebb4573ea4
Signer #1 public key MD5 digest: 911e1348b5ebebb291ada23d52a66181

Changes

  • Conformance Tests
    • Fix: Refactor Pbr::Model into an immutable Pbr::Model and Pbr::Instance that
      holds the state for one drawn instance of the model. This corrects the known
      issue in the self-tests mentioned in a previous changelog.
      (internal MR 3079,
      internal issue 2139,
      internal MR 3141)
    • Fix: Avoid artificial error precedence requirement in test for
      XR_ERROR_GRAPHICS_DEVICE_INVALID, by making sure to call the "check graphics
      requirements" function if applicable.
      (internal MR 3093,
      internal issue 2155)
    • Fix: Remove extra xrSyncActions call in test_glTFRendering to resolve
      interaction issue.
      (internal MR 3107,
      internal issue 2163)
    • Fix: Skip XR_MSFT_controller_model interactive test if extension is not
      supported.
      (internal MR 3146,
      internal issue 2187)
    • Improvement: Adjust StringToPath utility function to be easier to use.
      (internal MR 2076)
    • Improvement: Simplify how some tests refer to the main OpenXR handles.
      (internal MR 3023)
    • Improvement: Make AutoBasicSession use EventReader to support event
      multiplexing.
      (internal MR 3023)
    • Improvement: Do not require system support for XR_EXT_eye_gaze_interaction
      before running XrPath and interaction profile related tests. Paths are valid as
      long as the extension is offered and enabled, regardless of whether there is
      system support for eye tracking.
      (internal MR 3055)
    • Improvement: General code cleanup, warning fixes, clang-tidy fixes, and
      refactoring to improve flexibility and maintainability.
      (internal MR 3082,
      internal MR 3023)
    • Improvement: On Android, log using the "FATAL" severity before triggering an
      abort from the conformance layer.
      (internal MR 3087)
    • Improvement: Exclude loader negotiation functions (added to XML and ratified
      spec in 1.0.33) from the list of functions automatically tested by the
      conformance suite.
      (internal MR 3113)
    • New test: Check behavior for actions created without subaction paths, but
      queried using subaction paths.
      (internal MR 3068)

OpenXR CTS 1.0.32.1

23 Dec 03:26
openxr-cts-1.0.32.1
Compare
Choose a tag to compare

OpenXR CTS 1.0.32.1 (2023-12-14)

Approved 14-December-2023.

Will be withdrawn 16-July-2024, 180 days after the publication of the subsequent approved release, 1.0.33.0.

A notable change in this release is that the build system now checks for git
commit/tag information at configure time and reports this information in the CTS
logs. If you have taken any porting steps that involve changing the build
system, be sure to update your changes accordingly. See the README for more
information.

There is one known issue with the new PBR rendering subsystem, but it only
affects running a self test under Vulkan, which is not required for conformance
submissions. It will be fixed in the next release.

GitOrigin-RevId: d3f6efc6549af9cc244e28ac66c622a7b3411e12

OpenXR CTS 1.0.30.0

18 Oct 18:58
openxr-cts-1.0.30.0
Compare
Choose a tag to compare

OpenXR CTS 1.0.30.0 (2023-10-12)

Approved 12-Oct-2023.

Will be withdrawn 19-June-2024, 180 days after the publication of the subsequent approved release, 1.0.32.1.

There are Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

GitOrigin-RevId: c43f8b8c0380df42fe71b98c3d5a53632eda0eb9

OpenXR CTS 1.0.29.0

18 Sep 21:19
openxr-cts-1.0.29.0
Compare
Choose a tag to compare

OpenXR CTS 1.0.29.0 (2023-09-07)

Approved 7-Sept-2023.

Will be withdrawn 15-April-2024, 180 days after the publication of the subsequent approved release, 1.0.30.0.

There are Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

This release contains a large number of new or improved tests. It is expected
that many existing runtimes may initially fail some of these; implementers
should work to resolve these issues as soon as possible.

OpenXR CTS 1.0.27.0

17 May 21:26
openxr-cts-1.0.27.0
Compare
Choose a tag to compare

OpenXR CTS 1.0.27.0 (2023-05-10)

Approved 10-May-2023.

Withdrawal process approved by WG 7-Sept-2023, will be considered "withdrawn" 16-March-2024 (180 days after the publication of the approved 1.0.29.0 CTS release)

There are Windows and Android binaries attached to this release. While use of them is recommended for maximum compatibility, it is not required; you may follow the "porting process" in the conformance process document.

This release contains a large number of new or improved tests. It is expected
that many existing runtimes may initially fail some of these; implementers
should work to resolve these issues as soon as possible.

This also contains updated instructions for running tests and submitting
results, now that the test suite has a custom reporter that simplifies review of
results, and now that an improved method of running the tests is available on
Android.

Read more

OpenXR CTS 1.0.26.0

01 Dec 23:46
openxr-cts-1.0.26.0
Compare
Choose a tag to compare

OpenXR CTS 1.0.26.0 (2022-12-01)

Approved 1-December-2022.
Withdrawal vote 10-May-2023: will no longer be acceptable for submission 7-November-2023.

Read more

OpenXR CTS 1.0.22.1

24 Feb 17:31
openxr-cts-1.0.22.1
Compare
Choose a tag to compare

Approved 13-January-2022.

Will be withdrawn on 30-May-2023 (180 days after the vote to withdraw this version and the approval of 1.0.26.0.)

OpenXR CTS 1.0.22.1 (Approved 2022-01-13)

  • Registry
    • All changes found in 1.0.15 through 1.0.22.
  • Conformance Tests
    • Fix: Do not require optional extensions on Android.
      (internal MR 1949,
      internal issue 1480,
      internal issue 1481,
      OpenXR-CTS issue 5,
      OpenXR-CTS issue 6)
    • Fix: Resolve invalid handle error on xrEnumerateBoundSourcesForAction in
      multithreaded test.
      (internal MR 2094)
    • Fix: Check graphics plugin usage to allow XR_MND_headless to be used with
      non-interactive conformance tests.
      (internal MR 2163)
    • Fix: Vulkan validation and OpenGL context usage issues in conformance test
      suite.
      (internal MR 2165)
    • Fix: Update Catch2 from 2.9.2 to 2.13.8 to fix builds on newer Linux
      distributions.
      (internal MR 2203)
    • Fix: Add more formats to pick from in OpenGL; do not use sRGB as rendering is
      broken with that.
      (OpenXR-CTS PR 20)
    • Fix: Make "Grip and Aim Pose" and "Projection Mutable Field-of-View" tests
      visible.
      (OpenXR-CTS PR 21)
    • Fix: Read access violation for D3D12 device on shutdown.
      (OpenXR-CTS PR 22)
    • Fix: Mutable field-of-view X and Y flip for non-symmetrical FOVs.
      (OpenXR-CTS PR 23)
    • Fix: Make some failures caused by missing layer flag implementations more
      obvious.
      (OpenXR-CTS PR 25)
    • Fix: Converted all conformance tests to use SRGB 8-bit textures since some
      runtimes don't support linear 8-bit textures.
      (OpenXR-CTS PR 26)
    • Fix: Avoid submitting projection layers when the referenced swapchain hasn't
      been used yet.
      (OpenXR-CTS PR 27)
    • Improvement: Add Android build system, using new cross-vendor Android loader,
      and fix some runtime errors in Android-specific code.
      (internal MR 1949,
      internal issue 1425)
    • Improvement: Use Asset Manager for assets on Android, and fix build.
      (internal MR 1950)
    • Improvement: Refactor xrGetInstanceProcAddr implementation in conformance
      layer to avoid deeply-nested if ... else blocks. (Some compilers have limits
      we were nearing or hitting.)
      (internal MR 2050)
    • Improvement: Add device re-use test to XR_KHR_D3D11_enable test.
      (internal MR 2054)
    • Improvement: Add device re-use test to XR_KHR_D3D12_enable test.
      (internal MR 2054)
    • Improvement: Add device re-use test to XR_KHR_opengl_enable test.
      (internal MR 2054)
    • Improvement: Add support for XR_KHR_vulkan_enable2 to conformance test suite.
      (internal MR 2073)
    • Improvement: Add tests for xrApplyHapticFeedback and xrLocateSpace to
      multithreading test in the conformance test suite.
      (internal MR 2077)
    • Improvement: Add swapchain create and destroy test to graphics enable tests.
      (internal MR 2086)
    • Improvement: Check XrPerfSettings*EXT enums in conformance layer, which also
      solves a compiler warning.
      (internal MR 2107)
    • Improvement: Shutdown graphics plugin after running tests in the conformance
      test suite.
      (internal MR 2132)
    • Improvement: Implement D3D11 graphics validator to validate usage flags.
      (internal MR 2139)
    • Improvement: Adjust interactive tests to keep submitting frames while waiting,
      to avoid missing many frames while doing input-related tests.
      (internal MR 2142)
    • Improvement: Include NVIDIA-defined and AMD-defined exported symbols to signal
      favoring high performance/discrete graphics devices for test application.
      (internal MR 2156)
    • Improvement: Fix Android building and add documentation on building for
      Android.
      (OpenXR-CTS PR 33,
      OpenXR-CTS issue 31,
      internal MR 2198)
    • New test: Add XR_KHR_vulkan_enable test to validate simple failure and
      success cases.
      (internal MR 2054)
    • New test: Add XR_KHR_opengl_es_enable test to validate simple failure and
      success cases.
      (internal MR 2054)
    • New test: Add XR_KHR_vulkan_enable2 test to validate simple failure and
      success cases.
      (internal MR 2073)
    • New test: Add tests for XR_EXT_hand_tracking to validate basic API usage.
      (internal MR 2164)