streamlit might be too limiting Use htmx frontend, fastapi backend, connected via websockets When new audio transcription is received, send a post to fastapi fastapi pushes new transcription to the htmx frontend (it would also execute the llm query here) sse might work, but then it would be only uni directional. For the actual use case we will need the user to send messages back to the application.