Package x.y.z must not be running prior to cold start!

[nuhkoca]

Hello,

I am trying to integrate Baseline Profiles but when I execute StartupBenchmark with COLD startup mode, it throws an exception

Package x.y.z must not be running prior to cold start!

Do you know why?

My config:

@RunWith(AndroidJUnit4::class)
class StartupBenchmark {

    @get:Rule
    val benchmarkRule = MacrobenchmarkRule()

    @Test
    fun startup() = benchmarkRule.measureRepeated(
        packageName = PACKAGE_NAME,
        metrics = listOf(StartupTimingMetric()),
        iterations = 5,
        startupMode = StartupMode.COLD
    ) {
        pressHome()
        startActivityAndWait()
    }
}

[nuhkoca]

I noticed that this happens if iterations is greater than 3

[mlykotom]

Could you give a bit more details on what device, OS version you encountered the error?

The error occurs because Macrobenchmark is not able to kill your app. But it does it in between iterations, so I don't know why changing the iterations would make a difference.

[nuhkoca]

The device is Samsung S21 5G Android 13.

[mlykotom]

@ChrisCraik Have we seen anything like that for any device? Or do you know what could be the cause of it?

[SubhrajyotiSen]

Noticing this issue on Pixel 6a running Android 14 Beta 2 as well.

[mlykotom]

Could you pls file a bug directly to the library? This doesn't look like a bug with the sample https://issuetracker.google.com/issues/new?component=975669&template=1519452

Thank you! 🙏🏼