-
|
I purchased an API key from a low-cost third-party platform, but it appears to have strict restrictions on the AutoComplete role model. I received the following error in the admin panel |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
The setting you want is Continue still builds its own stop list for autocomplete, then trims it before sending the request. In the current codepath the OpenAI-compatible client does So for a provider that only accepts 5 stop strings, set that on the autocomplete model, for example: models:
- name: Cheap autocomplete
provider: openai
model: your-model
roles: [autocomplete]
apiBase: https://your-provider.example/v1
maxStopWords: 5
Docs reference: the |
Beta Was this translation helpful? Give feedback.
The setting you want is
maxStopWords, notdefaultCompletionOptions.stop.Continue still builds its own stop list for autocomplete, then trims it before sending the request. In the current codepath the OpenAI-compatible client does
body.stop = body.stop?.slice(0, this.getMaxStopWords()), andgetMaxStopWords()uses your configuredmaxStopWordswhen it is set.So for a provider that only accepts 5 stop strings, set that on the autocomplete model, for example:
defaultCompletionOptions.stoponly changes the actual stop value…