Is it possible to stream responses via nuxt without using vercel-edge for your nitro preset?

[Oskilla69]

Hi, I know streaming responses was only recently rolled out for nuxt, but is it possible to get it working without vercel-edge as your nitro preset? I keep getting this cryptic error:
TypeError: Cannot read properties of undefined (reading 'bind')
at (index.mjs:56453:45)
at (__nitro:middleware.js:1:17)
when I use vercel-edge, but it works totally fine with vercel as my preset.

Any help would be greatly appreciated. Thank you!

[Oskilla69]

Was able to fix it by turning ssr off in nuxt config

[dosstx]

No longer need to turn off SSR. Just use this:

https://sdk.vercel.ai/docs/guides/frameworks/nuxt

[Oskilla69]

ok i tried only updating the ai package but im still getting the issue above if i dont use ssr: false

[dosstx]

@Oskilla69 I misread your question. Sorry. I do not have it working on any deployed Edge functions yet. I tried it on Netlify Edge and it won't stream (only shows the data once it's finished streaming). When viewing the data from the browser Network tab, I do see the data being streamed, just not to the client. Seems to be a client issue?

Did you see this thread ? #135

[dosstx]

@Oskilla69 I was able to deploy to Netlify edge: https://main--chipper-snickerdoodle-13271f.netlify.app/

Streaming works. The code I took was from here: https://github.com/pi0/nuxt-openai-demo/tree/a9e45546e76563b744d7de95b330fa9ae7d82db7

[Oskilla69]

Hey @dosstx thanks for the reply. So basically the issue was just that openai needed to be upgraded to 4.0.1?

[dosstx]

I don't know. Also, there is a new openAI update today, as well (4.1.0). I haven't tried it yet.