Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

Is there any plan to support batch requests for the completions endpoint? #160

Open
ziodave opened this issue Mar 5, 2023 · 0 comments
Open

Is there any plan to support batch requests for the completions endpoint? #160

ziodave opened this issue Mar 5, 2023 · 0 comments

Comments

@ziodave
Copy link

ziodave commented Mar 5, 2023 •
edited
Loading

Hello,

The completions endpoint supports batch requests by sending an array in the prompt parameter.

However the implementation currently only support String.

Is there any plan to support an array of strings?

The OpenAPI definition describes it.

Cheers
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ziodave