Paparazzi conflicts when there is a Robolectric Test in the same module for paparazzi Version 2.0.0-alpha01

[bmesing]

Description
I have a module, where I have both paparazzi and robolectric tests. When I modifiy the code tested by the paparazzi tests, the paparazzi test being executed after the robolectric tests fail with two exceptions, an initial one and then the same for all following tests.
The problem occured only after an combined compose (2025.01 -> 2025.05) and paparazzi (1.3.5 -> 2.0.0-alpha01) update. I needed to update both in sync to make paparazzi run with 2025.05.

First Exception:

FAILED
java.lang.IllegalStateException: Failed to init Bridge.
at app.cash.paparazzi.internal.Renderer.prepare(Renderer.kt:97)
at app.cash.paparazzi.PaparazziSdk.prepare(PaparazziSdk.kt:125)
at app.cash.paparazzi.Paparazzi.prepare(Paparazzi.kt:86)
at app.cash.paparazzi.Paparazzi$apply$1.evaluate(Paparazzi.kt:74)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy1/jdk.proxy1.$Proxy4.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:122)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:72)
at worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)

Followup Exceptions:

FAILED
kotlin.UninitializedPropertyAccessException: lateinit property sessionParamsBuilder has not been initialized
at app.cash.paparazzi.PaparazziSdk$Companion.getSessionParamsBuilder$paparazzi(PaparazziSdk.kt:562)
at app.cash.paparazzi.PaparazziSdk.prepare(PaparazziSdk.kt:129)
at app.cash.paparazzi.Paparazzi.prepare(Paparazzi.kt:86)
at app.cash.paparazzi.Paparazzi$apply$1.evaluate(Paparazzi.kt:74)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy1/jdk.proxy1.$Proxy4.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:122)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:72)
at worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)

The robolectric test is minimal:

@RunWith(AndroidJUnit4::class)
class AdobeTrackingServiceTest {

    @Test
    fun `tracking state updates viewId`() = runTest {
        assertTrue { true }
    }
}

The paparazzi tests are testing compose ui.

Additional information:

• Paparazzi Version: 2.0.0-alpha01
• Robolectric Version: 4.14.1
• OS: macOS
• Compile SDK: 35
• Gradle Version: 8.14
• Android Gradle Plugin Version: 8.8..0

Running the test via gradle (./gradlew --rerun-tasks :mymodule:testDebugUnitTest) multiple times in a row seems to produce strictly alternating success/fail results.

[geoff-powell]

Can you provide a repro project. It will be helpful in diagnosing the issue

[eggman87]

I ran into the same exact thing, roboelectric compose ui tests and paparazzi tests in the same package. I see this on the runs where it fails:

WARNING: A Java agent has been loaded dynamically (/Users/h491478/.gradle/caches/8.10.2/transforms/150f6c54dc779534e80af0f0aa6cf52d/transformed/byte-buddy-agent-1.17.5.jar)
WARNING: If a serviceability tool is in use, please run with -XX:+EnableDynamicAgentLoading to hide this warning
WARNING: If a serviceability tool is not in use, please run with -Djdk.instrument.traceUsage for more information
WARNING: Dynamic loading of agents will be disallowed by default in a future release
Jun 13, 2025 4:23:42 PM app.cash.paparazzi.internal.PaparazziLogger logAndroidFramework
INFO: JNIHelp [6]: java.lang.NoSuchMethodError: Method 'long android.animation.PropertyValuesHolder.$$robo$$nGetIntMethod$nativeBinding(java.lang.Class, java.lang.String)' name or signature does not match
Jun 13, 2025 4:23:42 PM app.cash.paparazzi.internal.PaparazziLogger logAndroidFramework
INFO: JNIHelp [6]: RegisterNatives failed for 'android/animation/PropertyValuesHolder'; aborting...
Jun 13, 2025 4:23:42 PM app.cash.paparazzi.internal.PaparazziLogger logAndroidFramework
INFO: JNIHelp [3]: Discarding pending exception (java.lang.NoSuchMethodError: Method 'long android.animation.PropertyValuesHolder.$$robo$$nGetIntMethod$nativeBinding(java.lang.Class, java.lang.String)' name or signature does not match) to throw java/lang/RuntimeException
Jun 13, 2025 4:23:42 PM app.cash.paparazzi.internal.PaparazziLogger logAndroidFramework
INFO: java [4]: Unable to register all android native methods

Jun 13, 2025 4:23:42 PM app.cash.paparazzi.internal.PaparazziLogger error
SEVERE: broken: Native layoutlib failed to load
java.lang.UnsatisfiedLinkError: 'boolean android.util.Log.isLoggable(java.lang.String, int)'
	at android.util.Log.isLoggable(Native Method)
	at android.hardware.input.InputManagerGlobal.<clinit>(InputManagerGlobal.java:80)
	at com.android.layoutlib.bridge.Bridge.setInputManager(Bridge.java:767)
	at java.base/jdk.internal.loader.NativeLibraries.load(Native Method)
	at java.base/jdk.internal.loader.NativeLibraries$NativeLibraryImpl.open(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(Unknown Source)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(Unknown Source)
	at java.base/java.lang.ClassLoader.loadLibrary(Unknown Source)
	at java.base/java.lang.Runtime.load0(Unknown Source)
	at java.base/java.lang.System.load(Unknown Source)
	at com.android.layoutlib.bridge.Bridge.loadNativeLibraries(Bridge.java:812)
	at com.android.layoutlib.bridge.Bridge.loadNativeLibrariesIfNeeded(Bridge.java:787)
	at com.android.layoutlib.bridge.Bridge.init(Bridge.java:198)
	at app.cash.paparazzi.internal.Renderer.prepare(Renderer.kt:98)
	at app.cash.paparazzi.PaparazziSdk.prepare(PaparazziSdk.kt:125)
	at app.cash.paparazzi.Paparazzi.prepare(Paparazzi.kt:86)
	at app.cash.paparazzi.Paparazzi$apply$1.evaluate(Paparazzi.kt:74)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
	at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
	at jdk.proxy2/jdk.proxy2.$Proxy6.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
	at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
	at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:121)
	at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)

Consistently fail/pass/fail/pass, either running testDebugUnitTest or paparazzi tasks like recordPaparazziDebug. Going to try and setup a repro project here soon.

Also fails the same way on 2.0.0-SNAPSHOT.

[eggman87]

@geoff-powell here is a sample project: https://github.com/eggman87/paparazzi_issue1979

It produces the consistent pass/fail/pass/fail (editing test required for previous results to not be cached).

[JPUF]

On our project, we're in a similar situation as @bmesing
This issue is causing a catch-22 between recent Compose versions not working on Paparazzi 1.3, and this issue on 2.0.0

Thanks for the sample project.

[alashow]

Having same catch-22 situation - 1.3.5 fails with #1288 on latest composeBom, 2.0.0-alpha01 fails with this issue at random times.

[eygraber]

I was able to fix this by moving the Robolectric test to another package. It may be worth changing the title to indicate that the issue is Paparazzi and Robolectric tests being present in the same package (and not the same module). Also this only started for me after updating my target and compile sdk to 36.

[adecker89]

I was able to fix this by moving the Robolectric test to another package.

This workaround isn't working for me.

I think the problem has to do with test ordering. From my testing, once a Robolectric test runs, Paparazzi tests will fail.

If I move the tests around to a different folder that will affect the test ordering and can get those same tests to succeed, but only if Paparazzi runs first.

[eygraber]

Looks like Robolectric 4.16 exacerbates the issue in some way - robolectric/robolectric#10586