Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[UITest] Re-enable iOS Scrolling tests #20618

Merged
merged 4 commits into from Feb 27, 2024

Merge remote-tracking branch 'origin/main' into dev/TJ/FixUITest2

984eefe
Select commit
Failed to load commit list.
Merged

[UITest] Re-enable iOS Scrolling tests #20618

Merge remote-tracking branch 'origin/main' into dev/TJ/FixUITest2
984eefe
Select commit
Failed to load commit list.
Azure Pipelines / MAUI-UITests-public failed Feb 26, 2024 in 1h 7m 35s

Build #8.0.10-ci.net8.9003+pr.20618-sha.92c05e6d0-azdo.109607 had test failures

Details

Tests

  • Failed: 3 (0.32%)
  • Passed: 620 (66.10%)
  • Other: 315 (33.58%)
  • Total: 938

Annotations

Check failure on line 19 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Build log #L19

There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.

Check failure on line 2066 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Build log #L2066

PowerShell exited with code '1'.

Check failure on line 3953 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Build log #L3953

PowerShell exited with code '1'.

Check failure on line 1239 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Build log #L1239

PowerShell exited with code '1'.

Check failure on line 1 in Microsoft.Maui.AppiumTests.Issues.Issue17400(Windows).Issue17400Test

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Microsoft.Maui.AppiumTests.Issues.Issue17400(Windows).Issue17400Test

VisualTestUtils.VisualTestFailedException : 
Snapshot different than baseline: Issue17400Test.png (0.77% difference)
If the correct baseline has changed (this isn't a a bug), then update the baseline image.
See test attachment or download the build artifacts to get the new snapshot file.

More info: https://aka.ms/visual-test-workflow
Raw output
   at VisualTestUtils.VisualRegressionTester.Fail(String message)
   at VisualTestUtils.VisualRegressionTester.VerifyMatchesSnapshot(String name, ImageSnapshot actualImage, String environmentName, ITestContext testContext)
   at Microsoft.Maui.AppiumTests.UITest.VerifyScreenshot(String name) in D:\a\1\s\src\Controls\tests\UITests\UITest.cs:line 191
   at Microsoft.Maui.AppiumTests.Issues.Issue17400.Issue17400Test() in D:\a\1\s\src\Controls\tests\UITests\Tests\Issues\Issue17400.cs:line 25
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Check failure on line 1 in Microsoft.Maui.AppiumTests.InputTransparencyGalleryTests(Android).InputTransparencyWhenRootIsTransparentMatrix(False,True,True,True)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Microsoft.Maui.AppiumTests.InputTransparencyGalleryTests(Android).InputTransparencyWhenRootIsTransparentMatrix(False,True,True,True)

The app was expected to be running still, investigate as possible crash
TearDown : NUnit.Framework.AssertionException : The app was expected to be running still, investigate as possible crash
Raw output
   at UITest.Appium.NUnit.UITestBase.UITestBaseTearDown() in /Users/builder/azdo/_work/2/s/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 68
   at InvokeStub_UITestBase.UITestBaseTearDown(Object, Object, IntPtr*)

--TearDown
   at NUnit.Framework.Assert.ReportFailure(String message)
   at NUnit.Framework.Assert.Fail(String message, Object[] args)
   at NUnit.Framework.Assert.Fail(String message)
   at UITest.Appium.NUnit.UITestBase.UITestBaseTearDown() in /Users/builder/azdo/_work/2/s/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 68
   at InvokeStub_UITestBase.UITestBaseTearDown(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
1)    at UITest.Appium.NUnit.UITestBase.UITestBaseTearDown() in /Users/builder/azdo/_work/2/s/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 68
   at InvokeStub_UITestBase.UITestBaseTearDown(Object, Object, IntPtr*)

Check failure on line 1 in Microsoft.Maui.AppiumTests.InputTransparencyGalleryTests(Android).InputTransparencyWhenRootIsTransparentMatrix(True,True,False,True)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / MAUI-UITests-public

Microsoft.Maui.AppiumTests.InputTransparencyGalleryTests(Android).InputTransparencyWhenRootIsTransparentMatrix(True,True,False,True)

The app was expected to be running still, investigate as possible crash
TearDown : NUnit.Framework.AssertionException : The app was expected to be running still, investigate as possible crash
Raw output
   at UITest.Appium.NUnit.UITestBase.UITestBaseTearDown() in /Users/builder/azdo/_work/2/s/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 68
   at InvokeStub_UITestBase.UITestBaseTearDown(Object, Object, IntPtr*)

--TearDown
   at NUnit.Framework.Assert.ReportFailure(String message)
   at NUnit.Framework.Assert.Fail(String message, Object[] args)
   at NUnit.Framework.Assert.Fail(String message)
   at UITest.Appium.NUnit.UITestBase.UITestBaseTearDown() in /Users/builder/azdo/_work/2/s/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 68
   at InvokeStub_UITestBase.UITestBaseTearDown(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
1)    at UITest.Appium.NUnit.UITestBase.UITestBaseTearDown() in /Users/builder/azdo/_work/2/s/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 68
   at InvokeStub_UITestBase.UITestBaseTearDown(Object, Object, IntPtr*)