streamObject alternating between undefined and the response

[bernaferrari]

Description

This one is hard to reproduce, because there is no rawText for me to debug and send the issue :P #1486

But basically, in a certain circumstance, partialObject (from for await (const partialObject of stream.partialObjectStream) {) will return undefined, followed by the correct JSON, followed by undefined. It keeps alternating between undefined and the correct JSON.

I wish it either didn't return undefined, since that's not useful, or there were a better way to debug this so I could report to you.

Code example

No response

Additional context

No response

[lgrammel]

@bernaferrari are you able to reproduce this locally consistently each time?

[bernaferrari]

Yes!! But I wish I could send what is breaking instead of my whole prompt.

[lgrammel]

@bernaferrari is there a chance that you could provide a similar example that breaks and has nothing to do with your prompt? (e.g. using a structurally similar prompt/schema from a different domain)

[bernaferrari]

I don't know, but I could send the output before and after it is undefined so you can test character by character what is wrong. Would that be helpful?

[lgrammel]

I don't know, but I could send the output before and after it is undefined so you can test character by character what is wrong. Would that be helpful?

Maybe, would have to see

[bernaferrari]

Check if this helps, I'm printing JSON.stringify(partialObject). You can see there is a pattern. Always with the ,"props":{} it seems to crash.

{"type":"div","children":[{"type":"Card"}]}
undefined
{"type":"div","children":[{"type":"Card","props":{},"children":[]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":""}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"Card"}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader"}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader"}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader"}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader"}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader"}]}]}
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader"}]}]}
undefined
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader","props":{},"children":[]}]}]}

Then again at:

{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader","props":{},"children":[{"type":"CardTitle"}]}]}]}
undefined
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader","props":{},"children":[{"type":"CardTitle","props":{},"children":[""]}]}]}]}

and

{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader","props":{},"children":[{"type":"CardTitle","props":{},"children":["Tea Shop"]},{"type":"CardDescription","props":{},"children":["Explore and purchase a variety of teas."]}]},{"type":"CardContent"}]}]}
undefined
{"type":"div","children":[{"type":"Card","props":{},"children":[{"type":"CardHeader","props":{},"children":[{"type":"CardTitle","props":{},"children":["Tea Shop"]},{"type":"CardDescription","props":{},"children":["Explore and purchase a variety of teas."]}]},{"type":"CardContent","props":{},"children":[]}]}]}

[lgrammel]

@bernaferrari thank you! investigating now

[lgrammel]

Fix: #1529