✅ Add End-To-End tests #180

igorescodro · 2021-04-23T12:30:56Z

Add more UI Android Tests in order to have a better coverage and confidence in future changes and refactors.

New tests to validate the search feature.

Now that we have Unified Test Platform, it is easier to run Instrumented Tests directly in Gradle instead of relying in a separate service in Continuous Integration. New devices were setup in ready to go!

Gradle Manages Devices updated on Build Gradle due to recent updates to KTS and the command was also updated in the CI due to update in Android Studio Chipmunk.

At the moment, the UTP is not playing well with GitHub Actions, so the Android Emulator by ReactiveCircus is enabled again in order to develop more end-to-end tests. In the future, I will revaluate the UTP support in Alkaa.

Encapsulation reverted to be used in E2E tests.

Android.R imported added in the Android Tests to match the correct string

New tests to validate the category feature.

New tests to validate the preference feature.

In the `@Before` of the tests, all the tasks and categories are removed in order to add new ones every time. This way we avoid "dirty" or "clean" databases in between tests.

New tests to validate the alarm feature in the TaskFlowTest

New tests to validate the notification feature in the application

Add "DisableAnimationRule" for all tests in order to reduce the flakiness caused by animation delays. Also some tests were forced multiple times to detect flakiness and update each specific one.

More comments added in order to be clearer what each test is trying to achieve

Emulator script updated to make the tests less flaky

Re-enable the Unified Test platform in Alkaa.

Build Gradle version updated to latest version matching Android Studio Canary and the Gradle command based on the Issue Tracker reply

Update the syntax to the latest one since the previous was deprecated. Also, removed the emulator not working properly by now.

One more test added to check the notification action opening the task detail

Some tests are failing because Compose and Activity lifecycles are not playing well with Compose Tests. The error shown is: "No compose views found in the app. Is your Activity resumed?" The solution found at IssueTracker was to add a waitUntil before starting the actual test. See https://issuetracker.google.com/issues/201900572

After the merge, the AGP version was downgraded, now it's back to normal

igorescodro · 2022-06-11T20:25:00Z

That's an internal api. The correct form would be to use the NamedDomain* functions, i.e.:

import com.android.build.api.dsl.ManagedVirtualDevice

// ....
        create<ManagedVirtualDevice>("pixel4api31") {
          device = "Pixel 4"
          apiLevel = 30
          systemImageSource = "aosp-atd"
        }

Thanks a lot for the comment. I'll update it and try again.
Any luck on your side with flaky tests? One specific test fails some times on GitHub Actions, but never on local machine.
I opened this Issue Tracker with this issue.

@PaulWoitaschek

Based on @PaulWoitaschek comment, update to the correct API

Apparently the 7.3 is the correct version of Android Gradle Plugin to use with Gradle Managed Virtual Devices. Even though it compiles with 7.2 stable.

That's not a thing I would like to do, but I'm stuck with this issues for months. A Issue Tracker was opened for support, but in the meantime I will have this test annotated as Flaky and trying it 5 times before actually failing the tests. Let's see if now I'm able to finally merge this change.

igorescodro force-pushed the add/tests branch 5 times, most recently from d6f6b0d to 3fece44 Compare April 23, 2021 18:30

igorescodro force-pushed the add/tests branch from 3fece44 to 4af770e Compare July 6, 2021 18:53

igorescodro force-pushed the add/tests branch 2 times, most recently from 1b16850 to f71e58d Compare October 22, 2021 13:33

igorescodro force-pushed the add/tests branch 2 times, most recently from 644565e to 96b2ef9 Compare January 7, 2022 17:10

igorescodro force-pushed the add/tests branch 5 times, most recently from 56d9fad to 423a6e2 Compare January 21, 2022 18:04

igorescodro force-pushed the add/tests branch 13 times, most recently from 075b63a to 8e5f6ca Compare February 3, 2022 17:53

igorescodro force-pushed the add/tests branch 2 times, most recently from bbeb22c to a093bc8 Compare March 18, 2022 13:27

igorescodro added 19 commits May 31, 2022 14:02

✅ Add Search flow test

897e254

New tests to validate the search feature.

✅ Update Instrumented Tests to run in UTP

3984264

Now that we have Unified Test Platform, it is easier to run Instrumented Tests directly in Gradle instead of relying in a separate service in Continuous Integration. New devices were setup in ready to go!

♻️ Update code to reflect latest changes

2bdaa1e

Gradle Manages Devices updated on Build Gradle due to recent updates to KTS and the command was also updated in the CI due to update in Android Studio Chipmunk.

⏪️ Revert the UTP activation

614ca1c

At the moment, the UTP is not playing well with GitHub Actions, so the Android Emulator by ReactiveCircus is enabled again in order to develop more end-to-end tests. In the future, I will revaluate the UTP support in Alkaa.

⏪️ Revert database encapsulation

90cebda

Encapsulation reverted to be used in E2E tests.

🩹 Fix Android.R imports in tests

807c38a

Android.R imported added in the Android Tests to match the correct string

✅ Add Category flow test

46bf710

New tests to validate the category feature.

✅ Add Preference flow test

f9358ec

New tests to validate the preference feature.

💚 Make tests more independent

dc61d8c

In the `@Before` of the tests, all the tasks and categories are removed in order to add new ones every time. This way we avoid "dirty" or "clean" databases in between tests.

✅ Add Alarm tests in Task flow test

65866c5

New tests to validate the alarm feature in the TaskFlowTest

✅ Add Notification tests

d457fa8

New tests to validate the notification feature in the application

✅ Reduce flakiness

fd76153

Add "DisableAnimationRule" for all tests in order to reduce the flakiness caused by animation delays. Also some tests were forced multiple times to detect flakiness and update each specific one.

💡 Add more comments in the Instrumented Tests

762df1e

More comments added in order to be clearer what each test is trying to achieve

🔨 Update Emulator Script

89940fe

Emulator script updated to make the tests less flaky

⏪️ Re-enable UTP in the project

2fc0a0f

Re-enable the Unified Test platform in Alkaa.

⬆️ Upgrade Build Gradle version and run command

fe22bd3

Build Gradle version updated to latest version matching Android Studio Canary and the Gradle command based on the Issue Tracker reply

🔧 Update Gradle Managed Devices to latest syntax

a5fe6ae

Update the syntax to the latest one since the previous was deprecated. Also, removed the emulator not working properly by now.

✅ Add more notification test

8ce234c

One more test added to check the notification action opening the task detail

igorescodro force-pushed the add/tests branch from abc70c6 to 3cc3be8 Compare June 10, 2022 17:39

⬆️ Update AGP after merge

41523df

After the merge, the AGP version was downgraded, now it's back to normal

igorescodro force-pushed the add/tests branch from 3cc3be8 to 41523df Compare June 10, 2022 18:14

igorescodro force-pushed the add/tests branch from dba6ece to d564509 Compare June 11, 2022 20:36

🔧 Update Gradle Managed Devices to latest syntax

bad96ac

Based on @PaulWoitaschek comment, update to the correct API

igorescodro force-pushed the add/tests branch from d564509 to bad96ac Compare June 13, 2022 13:05

igorescodro added 2 commits June 15, 2022 12:30

⬆️ Update AGP to latest 7.3.x

e318515

Apparently the 7.3 is the correct version of Android Gradle Plugin to use with Gradle Managed Virtual Devices. Even though it compiles with 7.2 stable.

igorescodro merged commit e3ff773 into main Jun 16, 2022

igorescodro deleted the add/tests branch June 16, 2022 12:43

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

✅ Add End-To-End tests #180

✅ Add End-To-End tests #180

igorescodro commented Apr 23, 2021

igorescodro commented Jun 11, 2022

✅ Add End-To-End tests #180

✅ Add End-To-End tests #180

Conversation

igorescodro commented Apr 23, 2021

igorescodro commented Jun 11, 2022