Skip to content

Conversation

danai-antoniou
Copy link

@danai-antoniou danai-antoniou commented Sep 16, 2024

adding MaxCompletionTokens to make our chat completions compatible with the o1 models, otherwise we fail with:

HTTP 500 Internal Server Error: { "code": "unknown", "message": "error, status code: 400, message: Unsupported parameter: 'max_tokens' is not supported with this model. Use 'max_completion_tokens' instead.", "details": null }

Also from the docs
Screenshot 2024-09-16 at 21 06 41

@danai-antoniou danai-antoniou changed the title Add new tokens field Add new max tokens field Sep 16, 2024
@danai-antoniou danai-antoniou merged commit 81e8687 into master Sep 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant