Skip to content

fix: isolate LiteRT conversations - #8

Merged
kdroidFilter merged 1 commit into
mainfrom
fix/reset-llm-conversation-each-turn
Aug 14, 2026
Merged

fix: isolate LiteRT conversations#8
kdroidFilter merged 1 commit into
mainfrom
fix/reset-llm-conversation-each-turn

Conversation

@kdroidFilter

@kdroidFilter kdroidFilter commented Aug 14, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Start a new LiteRT conversation for each desktop generate, then release it, matching Android.
  • Linux NVIDIA still skips close() (known SIGILL in libnvidia-gpucomp).

Test plan

  • ./gradlew :shared:compileKotlinJvm
  • ./gradlew :shared:jvmTest
  • Run a few translations in a row on desktop

Reusing the same conversation filled maxNumTokens until generate
went silent. Open a fresh session each turn and release it after,
matching Android. Linux NVIDIA still skips close (SIGILL).
@kdroidFilter
kdroidFilter merged commit 4e5c969 into main Aug 14, 2026
@kdroidFilter
kdroidFilter deleted the fix/reset-llm-conversation-each-turn branch August 14, 2026 12:03
@kdroidFilter kdroidFilter changed the title fix: reset LiteRT conversation after every generate fix: isolate LiteRT conversations Aug 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant