Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tests/android UI tests absolute #2077

Merged
merged 50 commits into from
Jun 13, 2022
Merged

Tests/android UI tests absolute #2077

merged 50 commits into from
Jun 13, 2022

Commits on Apr 20, 2022

  1. added benchmark ui tests 

    added end2end ui tests module with base test class (early version)
    @stefanosiano
    stefanosiano committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    476af3f View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2022

  1. big cleanup of BaseUiTest 

    added mock relay server with envelope and items assertions
    @stefanosiano
    stefanosiano committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    d62a03c View commit details
    Browse the repository at this point in the history

  2. Merge branch '6.x.x' into tests/android-ui-tests

    @stefanosiano
    stefanosiano committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    9243a93 View commit details
    Browse the repository at this point in the history

  3. changed benchmark to manual init 

    app cache is deleted on test start
MockRelay defaults to success response
    @stefanosiano
    stefanosiano committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    c6dc27f View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. started with javadoc and cleanup of benchmark test

    @stefanosiano
    stefanosiano committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    a580cc3 View commit details
    Browse the repository at this point in the history

  2. Merge branch '6.x.x' into tests/android-ui-tests

    @stefanosiano
    stefanosiano committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    368290e View commit details
    Browse the repository at this point in the history

  3. cleaned everything 

    added comments and javadoc to Benchmark module
added a README
    @stefanosiano
    stefanosiano committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    9850396 View commit details
    Browse the repository at this point in the history

  4. fixed spotless issues

    @stefanosiano
    stefanosiano committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    fc4ce1d View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2022

  1. Renamed modules: 

    *sentry-android-ui-tests -> sentry-uitest
*benchmark -> sentry-uitest-android-benchmark
*end2end -> sentry-uitest-android
Updated root build gradle file to ignore uitest modules from apiValidation, DistributionPlugin and aggregateJavadocs
Added comments and javadoc on sentry-uitest-android module
    @stefanosiano
    stefanosiano committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    2601afb View commit details
    Browse the repository at this point in the history

  2. Merge branch '6.x.x' into tests/android-ui-tests

    @stefanosiano
    stefanosiano committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    ae00661 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2022

  1. Merge branch '6.x.x' into tests/android-ui-tests

    @stefanosiano
    stefanosiano committed May 4, 2022
    Configuration menu
    Copy the full SHA
    51a1827 View commit details
    Browse the repository at this point in the history

  2. updated some gradle config to try to fix github build

    @stefanosiano
    stefanosiano committed May 4, 2022
    Configuration menu
    Copy the full SHA
    7a9c217 View commit details
    Browse the repository at this point in the history

  3. updated some gradle config to try to fix github build

    @stefanosiano
    stefanosiano committed May 4, 2022
    Configuration menu
    Copy the full SHA
    45b3669 View commit details
    Browse the repository at this point in the history

  4. updated some gradle config to fix github build

    @stefanosiano
    stefanosiano committed May 4, 2022
    Configuration menu
    Copy the full SHA
    4177c93 View commit details
    Browse the repository at this point in the history

  5. changed ui tests module to application modules, to have an apk to upl… 

    …oad to saucelabs

removed dependency between test modules
    @stefanosiano
    stefanosiano committed May 4, 2022
    Configuration menu
    Copy the full SHA
    d477a59 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2022

  1. added detekt and errorprone to uitests modules

    @stefanosiano
    stefanosiano committed May 5, 2022
    Configuration menu
    Copy the full SHA
    862819d View commit details
    Browse the repository at this point in the history

  2. added detekt and errorprone to uitests modules

    @stefanosiano
    stefanosiano committed May 5, 2022
    Configuration menu
    Copy the full SHA
    a30ecdc View commit details
    Browse the repository at this point in the history

Commits on May 12, 2022

  1. added saucelabs config files 

    removed proguard
fix typo in Hub transactionListener -> transactionProfiler
    @stefanosiano
    stefanosiano committed May 12, 2022
    Configuration menu
    Copy the full SHA
    f73b940 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2022

  1. refactored benchmark tests with a BaseBenchmarkTest 

    added a before and after method to optionally invoke in each iteration without being measured
added benchmarking sdk functions
    @stefanosiano
    stefanosiano committed May 16, 2022
    Configuration menu
    Copy the full SHA
    2e5215b View commit details
    Browse the repository at this point in the history

Commits on May 17, 2022

  1. fixed proguard rules (disabled shrinking) and enabled proguard 

    printing the number of cpu cores in benchmark results
pass a Choreographer object instead of the Runner to the BenchmarkOperation
    @stefanosiano
    stefanosiano committed May 17, 2022
    Configuration menu
    Copy the full SHA
    dd38ed4 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2022

  1. Merge branch 'tests/android-ui-tests' into tests/android-ui-tests-abs… 

    …olute

# Conflicts:
#	sentry-uitest/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/SentryBenchmarkTest.kt
#	sentry-uitest/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/util/BenchmarkOperation.kt
#	sentry-uitest/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/util/BenchmarkOperationResult.kt
    @stefanosiano
    stefanosiano committed May 18, 2022
    Configuration menu
    Copy the full SHA
    5e1b1b8 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2022

  1. pass a Choreographer object instead of the Runner to the BenchmarkOpe… 

    …ration in SdkBenchmarkTest
    @stefanosiano
    stefanosiano committed May 19, 2022
    Configuration menu
    Copy the full SHA
    4bf5b0e View commit details
    Browse the repository at this point in the history

  2. reverted profiling comparison rages from -1..5 to 0..5

    @stefanosiano
    stefanosiano committed May 19, 2022
    Configuration menu
    Copy the full SHA
    8f62a8c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'tests/android-ui-tests' into tests/android-ui-tests-abs… 

    …olute

# Conflicts:
#	sentry-uitest/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/SentryBenchmarkTest.kt
    @stefanosiano
    stefanosiano committed May 19, 2022
    Configuration menu
    Copy the full SHA
    3e87945 View commit details
    Browse the repository at this point in the history

  4. added idling resource to know when the activity has started

    @stefanosiano
    stefanosiano committed May 19, 2022
    Configuration menu
    Copy the full SHA
    6811071 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2022

  1. removed sentry providers through manifest instead of disabling the sdk 

    added ViewBinding
few cleanups
moved "androidx.test.runner.AndroidJUnitRunner" in Config.TestLibs.androidJUnitRunner
    @stefanosiano
    stefanosiano committed May 23, 2022
    Configuration menu
    Copy the full SHA
    2a9f83b View commit details
    Browse the repository at this point in the history

  2. Format code

    @getsentry-bot
    getsentry-bot committed May 23, 2022
    Configuration menu
    Copy the full SHA
    a9a163f View commit details
    Browse the repository at this point in the history

  3. renamed sentry-uitest folder to sentry-android-integration-tests

    @stefanosiano
    stefanosiano committed May 23, 2022
    Configuration menu
    Copy the full SHA
    ba41b1e View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/tests/android-ui-tests' into tes… 

    …ts/android-ui-tests
    @stefanosiano
    stefanosiano committed May 23, 2022
    Configuration menu
    Copy the full SHA
    04cd4ea View commit details
    Browse the repository at this point in the history

Commits on May 24, 2022

  1. moved EnvelopeAsserter.assertItem to assertions.kt as assertEnvelopeItem 

    assertEnvelopeItem is now a <reified T>
    @stefanosiano
    stefanosiano committed May 24, 2022
    Configuration menu
    Copy the full SHA
    6af1f1c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'tests/android-ui-tests' into tests/android-ui-tests-abs… 

    …olute

# Conflicts:
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/BaseBenchmarkTest.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/SdkBenchmarkTest.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/SentryBenchmarkTest.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/util/BenchmarkOperation.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/main/java/io/sentry/uitest/android/benchmark/BenchmarkActivity.kt
    @stefanosiano
    stefanosiano committed May 24, 2022
    Configuration menu
    Copy the full SHA
    5107224 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2022

  1. moved few prints to comments in BenchmarkOperationResult

    @stefanosiano
    stefanosiano committed May 25, 2022
    Configuration menu
    Copy the full SHA
    695eb2f View commit details
    Browse the repository at this point in the history

Commits on May 26, 2022

  1. sentry-uitest-android-benchmark now depends on sentry-uitest-android 

    BooleanIdlingResource is now only in sentry-uitest-android
    @stefanosiano
    stefanosiano committed May 26, 2022
    Configuration menu
    Copy the full SHA
    b3ae6f6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'tests/android-ui-tests' into tests/android-ui-tests-abs… 

    …olute

# Conflicts:
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/util/BenchmarkOperationResult.kt
    @stefanosiano
    stefanosiano committed May 26, 2022
    Configuration menu
    Copy the full SHA
    6094db8 View commit details
    Browse the repository at this point in the history

  3. merge uitest branch

    @stefanosiano
    stefanosiano committed May 26, 2022
    Configuration menu
    Copy the full SHA
    f4a7998 View commit details
    Browse the repository at this point in the history

  4. final (?) cleanups

    @stefanosiano
    stefanosiano committed May 26, 2022
    Configuration menu
    Copy the full SHA
    b815ee4 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2022

  1. added SauceLabs configuration with several devices for each Android a… 

    …pi level
    @stefanosiano
    stefanosiano committed May 30, 2022
    Configuration menu
    Copy the full SHA
    1d51f62 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2022

  1. added SauceLabs configuration with several devices for each Android a… 

    …pi level

added a sleep before warmup runs
    @stefanosiano
    stefanosiano committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    37ecc3a View commit details
    Browse the repository at this point in the history

  2. Merge branch '6.x.x' into tests/android-ui-tests-absolute 

    # Conflicts:
#	.sauce/sentry-uitest-android-benchmark.yml
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/SentryBenchmarkTest.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/util/BenchmarkOperation.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/androidTest/java/io/sentry/uitest/android/benchmark/util/BenchmarkOperationResult.kt
#	sentry-android-integration-tests/sentry-uitest-android-benchmark/src/main/java/io/sentry/uitest/android/benchmark/BenchmarkActivity.kt
    @stefanosiano
    stefanosiano committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    2b67d83 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2022

  1. sdk init increase is in millis, not nanos

    @stefanosiano
    stefanosiano committed Jun 6, 2022
    Configuration menu
    Copy the full SHA
    4c523e4 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2022

  1. added first github action (secrets are still to be confirmed) 

    added a couple jobs to the makefile for integration test apks
    @stefanosiano
    stefanosiano committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    f5d39a4 View commit details
    Browse the repository at this point in the history

  2. added first github action (secrets are still to be confirmed) 

    added a couple jobs to the makefile for integration test apks
    @stefanosiano
    stefanosiano committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    860ace5 View commit details
    Browse the repository at this point in the history

  3. added first github action (secrets are still to be confirmed) 

    added a couple jobs to the makefile for integration test apks
    @stefanosiano
    stefanosiano committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    1f54262 View commit details
    Browse the repository at this point in the history

  4. removed the build task from benchmarks, as it will be included in ano… 

    …ther job
    @stefanosiano
    stefanosiano committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    67b6bd3 View commit details
    Browse the repository at this point in the history

  5. added ui tests gh action config file

    @stefanosiano
    stefanosiano committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    1727ce9 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2022

  1. updated the github actions for running benchmarks and ui tests on sau… 

    …celabs
    @stefanosiano
    stefanosiano committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    b72594a View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2022

  1. updated the github actions for running benchmarks and ui tests on sau… 

    …celabs
    @stefanosiano
    stefanosiano committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    c635337 View commit details
    Browse the repository at this point in the history

  2. updated the github actions for running benchmarks and ui tests on sau… 

    …celabs
    @stefanosiano
    stefanosiano committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    0c982d9 View commit details
    Browse the repository at this point in the history

  3. moved choreographer to BaseBenchmarkTest 

    removed activityStartedIdlingResource from BenchmarkActivity as Espresso already waits for full activity creation when launching it
changed scrollingIdlingResource from BooleanIdlingResource to CountingIdlingResource to avoid dependency on another module
changed uitest module to "com.android.application", to allow apk creation to upload it to SauceLabs
    @stefanosiano
    stefanosiano committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    ff1ba13 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2022

  1. Merge branch 'main' into tests/android-ui-tests-absolute

    @marandaneto
    marandaneto committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    6120cd8 View commit details
    Browse the repository at this point in the history