Skip to content

Commit

Permalink
[Tests] Ignore a number of tests that fail on a VM. Update README. (#…
Browse files Browse the repository at this point in the history 
…12597)
  • Loading branch information
@mandel-macaque
mandel-macaque committed Aug 31, 2021
1 parent ef0667d commit cda8808
Show file tree
Hide file tree
Showing 9 changed files with 14 additions and 0 deletions.
6 changes: 6 additions & 0 deletions tests/README.md
View file
@@ -1,5 +1,11 @@
# Various tests to be executed prior to releases

## Test permissions

There are a number of tests that acccess the file system and the bluetooh. For these tests to correctly execute you have to ensure that
the terminal application that you are using to execute the tests has access to the full filesystem and the bluetooth. If you do not do this
step the macOS tests will crash.

## Test solutions

Many of the test solutions and test projects are generated, and will
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSAccelerationStructureTests.cs
View file
Expand Up @@ -33,6 +33,7 @@ public void Metal ()
{
TestRuntime.AssertDevice ();
TestRuntime.AssertXcodeVersion (10, 0);
TestRuntime.AssertNotVirtualMachine ();

device = MTLDevice.SystemDefault;
// some older hardware won't have a default
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSImageBatchTests.cs
View file
Expand Up @@ -31,6 +31,7 @@ public void Metal ()
{
TestRuntime.AssertDevice ();
TestRuntime.AssertXcodeVersion (10, 0);
TestRuntime.AssertNotVirtualMachine ();

device = MTLDevice.SystemDefault;
// some older hardware won't have a default
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSImageHistogramEqualizationTest.cs
View file
Expand Up @@ -30,6 +30,7 @@ public void Metal ()
Assert.Inconclusive ("Metal Performance Shaders is not supported in the simulator");
#else
TestRuntime.AssertXcodeVersion (9, 0);
TestRuntime.AssertNotVirtualMachine ();
#endif

device = MTLDevice.SystemDefault;
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSImageHistogramSpecificationTest.cs
View file
Expand Up @@ -30,6 +30,7 @@ public void Metal ()
Assert.Inconclusive ("Metal Performance Shaders is not supported in the simulator");
#else
TestRuntime.AssertXcodeVersion (9, 0);
TestRuntime.AssertNotVirtualMachine ();
#endif

device = MTLDevice.SystemDefault;
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSImageHistogramTest.cs
View file
Expand Up @@ -30,6 +30,7 @@ public void Metal ()
Assert.Inconclusive ("Metal Performance Shaders is not supported in the simulator");
#else
TestRuntime.AssertXcodeVersion (9, 0);
TestRuntime.AssertNotVirtualMachine ();
#endif

device = MTLDevice.SystemDefault;
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSImageNormalizedHistogramTests.cs
View file
Expand Up @@ -30,6 +30,7 @@ public void Metal ()
{
TestRuntime.AssertDevice ();
TestRuntime.AssertXcodeVersion (10, 0);
TestRuntime.AssertNotVirtualMachine ();

device = MTLDevice.SystemDefault;
// some older hardware won't have a default
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSStateBatchTests.cs
View file
Expand Up @@ -31,6 +31,7 @@ public void Metal ()
{
TestRuntime.AssertDevice ();
TestRuntime.AssertXcodeVersion (10, 0);
TestRuntime.AssertNotVirtualMachine ();

device = MTLDevice.SystemDefault;
// some older hardware won't have a default
Expand Down
1 change: 1 addition & 0 deletions tests/monotouch-test/MetalPerformanceShaders/MPSStateResourceListTests.cs
View file
Expand Up @@ -30,6 +30,7 @@ public void Metal ()
{
TestRuntime.AssertDevice ();
TestRuntime.AssertXcodeVersion (10, 0);
TestRuntime.AssertNotVirtualMachine ();

device = MTLDevice.SystemDefault;
// some older hardware won't have a default
Expand Down

5 comments on commit cda8808

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❌ [CI Build] Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

✅ API Diff (from PR only) (no change)
✅ Generator Diff (only version changes)

Packages generated

View packages

Test results

1 tests failed, 248 tests passed.

Failed tests

  • monotouch-test/watchOS 32-bits - simulator/Release (all optimizations): Failed

Pipeline on Agent XAMBOT-1033.BigSur'
[Tests] Ignore a number of tests that fail on a VM. Update README. (#12597)

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Tests were not ran (VSTS: device tests tvOS). ⚠️

Results were skipped for this run due to provisioning problems Azure Devops. Please contact the bot administrator.

Pipeline on Agent
[Tests] Ignore a number of tests that fail on a VM. Update README. (#12597)

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Tests were not ran (VSTS: device tests iOS). ⚠️

Results were skipped for this run due to provisioning problems Azure Devops. Please contact the bot administrator.

Pipeline on Agent
[Tests] Ignore a number of tests that fail on a VM. Update README. (#12597)

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❌ Tests failed on macOS M1 - Mac Big Sur (11.5) ❌

Tests failed on M1 - Mac Big Sur (11.5).

Failed tests are:

  • xammac_tests

Pipeline on Agent
[Tests] Ignore a number of tests that fail on a VM. Update README. (#12597)

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Tests passed on macOS Mac Mojave (10.14) ✅

Tests passed

All tests on macOS X Mac Mojave (10.14) passed.

Pipeline on Agent
[Tests] Ignore a number of tests that fail on a VM. Update README. (#12597)

Please sign in to comment.