[Platform][Vertex AI] Vertex stream generator error

[franzwilding]

When using the vertex ai platform to stream responses, I always get an
Generator passed to yield from was aborted without proper return and is unable to continue error in Symfony\AI\Platform\Result\StreamResult.

I tried to debug it, but I can't figure out the problem. As far as I can tell, the src/Bridge/VertexAi/Gemini/ResultConverter.php is working correctly and when I inspect each data-chunk in convertStream everything looks fine until the llm generation is done. After that, the error is thrown.

[chr-hertel]

Hey @franzwilding, was just debugging this and would recommend to shut of the token usage tracking for that agent/platform combining vertex and streaming - that should help.

It is related to the generator being consumed already by the TokenOutputProcessor

[franzwilding]

Thank's! Will try it, maybe I can find the the problem with the token output processor as well.