Feedback for “Getting Started” - Failed to convert the response to stream.

[JanKups]

Next: 13.4.18
OpenAI: 4.0.0

Basic route from /getting-started docs:

import OpenAI from 'openai';
import { OpenAIStream, StreamingTextResponse } from 'ai';
 
// Create an OpenAI API client (that's edge friendly!)
const openai = new OpenAI({
  apiKey: process.env.OPENAI_API_KEY,
});
 
// Set the runtime to edge for best performance
export const runtime = 'edge';
 
export async function POST(req: Request) {
  const { prompt } = await req.json();
 
  // Ask OpenAI for a streaming completion given the prompt
  const response = await openai.completions.create({
    model: 'text-davinci-003',
    stream: true,
    temperature: 0.6,
    max_tokens: 300,
    prompt: `Create three slogans for a business with unique features.
 
Business: Bookstore with cats
Slogans: "Purr-fect Pages", "Books and Whiskers", "Novels and Nuzzles"
Business: Gym with rock climbing
Slogans: "Peak Performance", "Reach New Heights", "Climb Your Way Fit"
Business: ${prompt}
Slogans:`,
  });
  // Convert the response into a friendly text-stream
  const stream = OpenAIStream(response);
  // Respond with the stream
  return new StreamingTextResponse(stream);
}

Causing the following error:
Failed to convert the response to stream. Received status code: undefined

TypeScript errors for OpenAIStream(response):

Argument of type 'Stream<Completion>' is not assignable to parameter of type 'Response'.
  Type 'Stream<Completion>' is missing the following properties from type 'Response': headers, ok, redirected, status, and 11 more.ts(2345)

[MaxLeiter]

Thank you, this should be fixed now. But all I did was adjust the types and it worked, so I'm unsure about your error. Are you on the most up-to-date ai and openai?

[Crayon-ShinChan]

"next": "13.4.19",
"openai": "^4.10.0",
"ai": "^2.2.13",

Met the similar problem from this get start, this line const stream = OpenAIStream(response);

Argument of type 'Stream<Completion>' is not assignable to parameter of type 'Response | AsyncIterableOpenAIStreamReturnTypes'.
  Type 'Stream<Completion>' is not assignable to type 'AsyncIterable<Completion>'.
    The types returned by '[Symbol.asyncIterator]().next(...)' are incompatible between these types.
      Type 'Promise<IteratorResult<import("/Users/leonz/Github/positive-diary/node_modules/openai/resources/completions").Completion, any>>' is not assignable to type 'Promise<IteratorResult<Completion, any>>'.
 ...
              ```

[bigxalx]

I get the same error, using the exact same versions of the packages. Maybe this issue should be re-opened.

[thewebalchemist]

"next": "13.4.19", "openai": "^4.10.0", "ai": "^2.2.13",

Met the similar problem from this get start, this line const stream = OpenAIStream(response);

Argument of type 'Stream<Completion>' is not assignable to parameter of type 'Response | AsyncIterableOpenAIStreamReturnTypes'.
  Type 'Stream<Completion>' is not assignable to type 'AsyncIterable<Completion>'.
    The types returned by '[Symbol.asyncIterator]().next(...)' are incompatible between these types.
      Type 'Promise<IteratorResult<import("/Users/leonz/Github/positive-diary/node_modules/openai/resources/completions").Completion, any>>' is not assignable to type 'Promise<IteratorResult<Completion, any>>'.
 ...
              ```

Hello, did you manage to get over the error?

[Crayon-ShinChan]

"next": "13.4.19", "openai": "^4.10.0", "ai": "^2.2.13",
Met the similar problem from this get start, this line const stream = OpenAIStream(response);

Argument of type 'Stream<Completion>' is not assignable to parameter of type 'Response | AsyncIterableOpenAIStreamReturnTypes'.
  Type 'Stream<Completion>' is not assignable to type 'AsyncIterable<Completion>'.
    The types returned by '[Symbol.asyncIterator]().next(...)' are incompatible between these types.
      Type 'Promise<IteratorResult<import("/Users/leonz/Github/positive-diary/node_modules/openai/resources/completions").Completion, any>>' is not assignable to type 'Promise<IteratorResult<Completion, any>>'.
 ...
              ```

Hello, did you manage to get over the error?

I used openai.chat.completions.create rather than openai.completions.create then problem solved. you can see the example here https://sdk.vercel.ai/docs/guides/providers/openai

[bigxalx]

You can also //tsignore in the line above to ignore the type error. Code runs just fine.

…

________________________________ From: Kuiliang Zhang ***@***.***> Sent: Friday, September 29, 2023 10:30 PM To: vercel/ai ***@***.***> Cc: bigxalx ***@***.***>; Comment ***@***.***> Subject: Re: [vercel/ai] Feedback for “Getting Started” - Failed to convert the response to stream. (Issue #472) "next": "13.4.19", "openai": "^4.10.0", "ai": "^2.2.13", Met the similar problem from this get start, this line const stream = OpenAIStream(response); Argument of type 'Stream<Completion>' is not assignable to parameter of type 'Response | AsyncIterableOpenAIStreamReturnTypes'. Type 'Stream<Completion>' is not assignable to type 'AsyncIterable<Completion>'. The types returned by '[Symbol.asyncIterator]().next(...)' are incompatible between these types. Type 'Promise<IteratorResult<import("/Users/leonz/Github/positive-diary/node_modules/openai/resources/completions").Completion, any>>' is not assignable to type 'Promise<IteratorResult<Completion, any>>'. ... ``` Hello, did you manage to get over the error? I used openai.chat.completions.create rather than openai.completions.create then problem solved. you can see the example here https://sdk.vercel.ai/docs/guides/providers/openai — Reply to this email directly, view it on GitHub<#472 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AAD42YWLVO67DVVSMH7VPALX44VUXANCNFSM6AAAAAA3VWSID4>. You are receiving this because you commented.Message ID: ***@***.***>