We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Within the context of the the LLM-based evaluators, the replies given by OpenAI contain different values for finish_reason:
finish_reason
for instance, content filter was triggered:
content filter
The completion for index 0 has been truncated due to the content filter. { "statements": [ "There is a major force uniting Americas
A full list of possible stopping conditions is here:
https://platform.openai.com/docs/guides/text-generation/chat-completions-response-format
We need to make sure we handle every possible stopping conditions and return a valid JSON
We can test this by making several successful evaluation runs over all the questions/queries on a dataset
The text was updated successfully, but these errors were encountered:
davidsbatista
Successfully merging a pull request may close this issue.
Within the context of the the LLM-based evaluators, the replies given by OpenAI contain different values for
finish_reason
:for instance,
content filter
was triggered:A full list of possible stopping conditions is here:
https://platform.openai.com/docs/guides/text-generation/chat-completions-response-format
We need to make sure we handle every possible stopping conditions and return a valid JSON
We can test this by making several successful evaluation runs over all the questions/queries on a dataset
The text was updated successfully, but these errors were encountered: