Navigation Menu

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[UITest] Android UI Tests are unstable #1259

Closed
9 tasks
jeromelaban opened this issue Jul 18, 2019 · 2 comments
Closed
9 tasks

[UITest] Android UI Tests are unstable #1259

jeromelaban opened this issue Jul 18, 2019 · 2 comments
Assignees
Labels
kind/bug Something isn't working

Comments

@jeromelaban
Copy link
Member

Current behavior

Android UI Tests fail randomly in PRs, giving this output on the device:

07-17 19:47:47.641  5730  5730 I mono-stdout: Initiate Running Test UITests.Shared.Windows_UI_Xaml_Controls.RadioButtonTests.RadioButton_IsEnabled_Automated
07-17 19:47:47.641  5730  5730 I mono-stdout: Searching sample UITests.Shared.Windows_UI_Xaml_Controls.RadioButtonTests.RadioButton_IsEnabled_Automated
07-17 19:47:47.642  5730  5730 I mono-stdout: Section changed: SamplesContent
07-17 19:47:47.655  5730  5730 E mono-rt : /proc/self/maps:
07-17 19:47:47.655  5730  5730 E mono-rt : 12c00000-12d40000 rw-p 00000000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.655  5730  5730 E mono-rt : 12d40000-12e00000 ---p 00140000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 12e00000-12f00000 rw-p 00200000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 12f00000-12f40000 ---p 00300000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 12f40000-12f80000 rw-p 00340000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 12f80000-13000000 ---p 00380000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13000000-130c0000 rw-p 00400000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 130c0000-13380000 ---p 004c0000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13380000-133c0000 rw-p 00780000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 133c0000-13440000 ---p 007c0000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13440000-13500000 rw-p 00840000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13500000-13540000 ---p 00900000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13540000-135c0000 rw-p 00940000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 135c0000-13840000 ---p 009c0000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13840000-13a00000 rw-p 00c40000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13a00000-13c80000 ---p 00e00000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 13c80000-2ac00000 rw-p 01080000 00:05 12095                              /dev/ashmem/dalvik-main space (region space) (deleted)
07-17 19:47:47.656  5730  5730 E mono-rt : 59c28000-59c2d000 r-xp 00000000 fc:00 2464                               /system/bin/app_process32
07-17 19:47:47.656  5730  5730 E mono-rt : 59c2d000-59c2e000 r--p 00004000 fc:00 2464                               /system/bin/app_process32
07-17 19:47:47.657  5730  5730 E mono-rt : 59c2e000-59c2f000 rw-p 00000000 00:00 0 
07-17 19:47:47.657  5730  5730 E mono-rt : 70cbf000-70ee4000 rw-p 00000000 fc:01 14669                              /data/dalvik-cache/x86/system@framework@boot.art
07-17 19:47:47.657  5730  5730 E mono-rt : 70ee4000-70efa000 r--p 00225000 fc:01 14669                              /data/dalvik-cache/x86/system@framework@boot.art
07-17 19:47:47.657  5730  5730 E mono-rt : 70efa000-70ff1000 rw-p 00000000 fc:01 14672                              /data/dalvik-cache/x86/system@framework@boot-core-libart.art
07-17 19:47:47.657  5730  5730 E mono-rt : 70ff1000-71003000 r--p 000f7000 fc:01 14672                              /data/dalvik-cache/x86/system@framework@boot-core-libart.art
07-17 19:47:47.657  5730  5730 E mono-rt : 71003000-71034000 rw-p 00000000 fc:01 14675                              /data/dalvik-cache/x86/system@framework@boot-conscrypt.art
07-17 19:47:47.717  5730  6165 I System.out: URI: /backdoor

Expected behavior

The tests don't fail.

How to reproduce it (as minimally and precisely as possible)

Run the UI tests suite in release.

Environment

Defined here:

https://github.com/unoplatform/uno/blob/master/build/android-uitest-run.sh#L4

Nuget Package:

Package Version(s):

Affected platform(s):

  • iOS
  • Android
  • WebAssembly
  • Windows
  • Build tasks

Visual Studio

  • 2017 (version: )
  • 2019 (version: )
  • for Mac (version: )

Relevant plugins

  • Resharper (version: )
@jeromelaban
Copy link
Member Author

When validating this very specific issue with VS 16.2 Pre 4, I'm not able to reproduce the issue.

@jeromelaban
Copy link
Member Author

jeromelaban commented Jul 23, 2019

Xamarin.Android issue: xamarin/xamarin-android#3385

jeromelaban added a commit that referenced this issue Sep 30, 2019
AutoRetry is still needed because of #1259
@jeromelaban jeromelaban self-assigned this Nov 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant