Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Many Instrumentation Tests not executed on some Test Configurations #25

Open
1 of 2 tasks
djbrown opened this issue Jun 1, 2023 · 0 comments
Open
1 of 2 tasks

Comments

@djbrown
Copy link

djbrown commented Jun 1, 2023

Steps to reproduce the behaviour

Run instrumentation tests in different configurations:

  • Execution Type: local physical device, local virtual device, remote firbase device
  • Device Model
  • Android API Level

Expected behaviour

All (currently 38) Tests should be executed and reported on all configurations.
Some tests may still fail, which we could then investigate further.

Actual behaviour

Overview as of ba1d24e

Type Model API
Physical Moto G22 27 10 28 0 38
Firebase Pixel 7 33 1 37 0 38
Virtual Pixel 3a 33 36 2 0 38
Firebase Pixel 5 (Report) 30 2 3 0 5
Firebase Nokia 1 27 3 2 0 5
History (older Commits)
Commit Type Model API
5860558 Physical Moto G22 27 18 20 0 38
5860558 Virtual Pixel 3a 33 6 11 0 17
5860558 Firebase Pixel 5 30 3 2 0 5
--- --- --- --- --- --- --- ---
3cc49e2 Physical Moto G22 27 3 0 5 8
3cc49e2 Virtual Pixel 3a 33 3 0 5 8
3cc49e2 Firebase Pixel 5 30 4 11 5 20

Suggested Resolution

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant