feat(overlay): show real-time interim ASR text during recording#6
Merged
Conversation
Add on_interim_text callback to SPCallbacks so the Obj-C frontend receives partial ASR results in real-time during recording. The callback is invoked from both the audio streaming loop and the post-recording drain in wait_for_final. Bridge, delegate, and AppDelegate forwarding are wired up. Overlay declares updateInterimText: with a no-op stub for now.
Replace the static "Listening…" label with real-time interim
recognition text as it arrives from the ASR service.
- Pill width grows with text but never shrinks within a session
- Width clamped to screen minus margins (32px each side)
- Width transitions use 0.15s ease-out animation
- Long text is left-truncated showing the trailing portion with
a gradient fade on the left edge
- State transitions clear interim text and reset max width
- Before first interim arrives, display is unchanged ("Listening…")
Update README and DESIGN.md to account for the floating status overlay and real-time interim ASR text display during recording. - Replace "No GUI at all" / "No visible GUI" with "Minimal GUI" - Remove "No floating screen bubble" from non-goals - Add Section 4.3 describing the floating overlay behavior - Add interim text display step to both Path A and Path B flows - Note overlay display in ASR Pipeline description
Owner
|
Cool! |
Owner
|
After my test, the overlay works fine when you speak continuously, but as long as you pause for 2-3 seconds while speaking, none of the subsequent text will be displayed. |
Owner
|
Fixed in c6aa702 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
on_interim_textFFI callback so the Obj-C frontend receives partial ASR results in real-timeDetails
Demo
interim-text.mp4
Test plan