Add column with test apk name in result table

[kozaxinan]

Describe the bug

A clear and concise description of what the bug is.

21.04.1
In result table, apk name is always app-debug.apk

To Reproduce

Steps to reproduce the behavior:

1. Have multimodule project
2. Configure it with fladle
3. run and see result table

Expected behavior

A clear and concise description of what you expected to happen.

Apk name column should show apk that used in that test run per module.

[bootstraponline]

The table is showing the app apk name. I agree showing the test apk instead may be more useful.

[kozaxinan]

Is it possible to have different app apk? I wasnt aware of that. test-apk name would be better as table shows result of test apk.

[pawelpasterz]

Is it possible to have different app apk?

Yes, you can define app - test app pair with additional-app-test-apks

flank/test_runner/flank.yml

Lines 295 to 301 in 475a124

	### Additional App/Test APKS
	## Include additional app/test apk pairs in the run. Apks are unique by just filename and not by path!
	## If app is omitted, then the top level app is used for that pair.
	# additional-app-test-apks:
	# - app: ../test_projects/android/apks/app-debug.apk
	# test: ../test_projects/android/apks/app1-debug-androidTest.apk
	# - test: ../test_projects/android/apks/app2-debug-androidTest.apk

Since flank supports the above feature, we can add additional column with test apk name

Changing label to feature request since it is working as designed

Dev note:

flank/test_runner/src/main/kotlin/ftl/json/SavedMatrix.kt

Line 110 in 475a124

private fun TestMatrix.extractAppFileName() = testSpecification?.run {

[kozaxinan]

I can confirm Fulladle plugin only adds app-debug to top level and doesnt add additional app to tests. https://github.com/runningcode/fladle/blob/master/fladle-plugin/src/main/java/com/osacky/flank/gradle/FulladlePlugin.kt#L73

What is the usecase for adding different app apks? Different variant support or something like that?

[bootstraponline]

What is the usecase for adding different app apks? Different variant support or something like that?

Some companies have multiple app apks and prefer to test them as a logical group. Typical use case doesn't need this feature.

[kozaxinan]

Even in that case, test apks need to have unique names. Printing test apk names would be much easier to spot which module has test fail. If using same test apk for different app is not possible, printing test apk name would be better in any case.

[bootstraponline]

printing test apk name would be better in any case.

I agree! Thanks for the feedback.