You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This bug report is about the stop param not working at all for the /v1/completions endpoint.
Expected behavior
It should work - currently it doesn't work at all. Ideally the same as OpenAI's behavior (i.e. no token boundary limitations - see above linked issue), but if that's not possible, then like /generate.
The text was updated successfully, but these errors were encountered:
System Info
Official docker image, v2.0.4
Information
Tasks
Reproduction
Try using the
stop
param for thev1/completions
endpoint. Note that this bug report is not related to this issue:This bug report is about the
stop
param not working at all for the/v1/completions
endpoint.Expected behavior
It should work - currently it doesn't work at all. Ideally the same as OpenAI's behavior (i.e. no token boundary limitations - see above linked issue), but if that's not possible, then like
/generate
.The text was updated successfully, but these errors were encountered: