Support streaming openai outside Node (ie. without axios)

[nfcampos]

Use this in axios adapter https://github.com/Azure/fetch-event-source

[esaounkine]

Could you provide a bit more context of what's the desired outcome?

[nfcampos]

The official openai library (which we use) uses axios to make http requests.
Axios off-the-shelf doesn't work in non-node environments.
For non-streaming output we already use an axios adapter (https://github.com/hwchase17/langchainjs/blob/main/langchain/src/util/axios-fetch-adapter.js) to make it work outside Node. This issue is about updating that adapter to support the SSE responses that OpenAI uses for streaming

[alberduris]

Is it possible now to make streaming OpenAI requests, for example, on Cloudflare Workers? If so, how?

[nfcampos]

To set up Cloudflare Workers see #212 (comment)
To set up streaming see https://js.langchain.com/docs/modules/models/llms/additional_functionality#streaming-responses

[alberduris]

It's not working. I have followed those instructions and (after fixing several process is not defined errors) I'm still getting the ✘ [ERROR] Uncaught (in response) TypeError: adapter is not a function error as described https://github.com/fern-openai/openai-node/issues/7 and openai/openai-node#30 (comment).

[nfcampos]

Which version of langchain are you using?

[alberduris]

Which version of langchain are you using?

From your package.json specification:

  "dependencies": {
    "langchain": "^0.0.35"
  }

I get:

> npm view langchain version
$ 0.0.44

[nfcampos]

Update to the latest version with npm install langchain@latest and try again

[alberduris]

npm view langchain version still shows the same version (0.0.44) but it is working now, thanks!

Is there an example of how to send the response of the ChatOpenAI streamed back to the client from the cf workers?

Edit: I got it working here, in case someone is interested: https://gist.github.com/alberduris/32e4ad5827cb01c28022ded982bfd8bc