Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stop param doesn't work at all for /v1/completions endpoint #1999

Open
2 of 4 tasks
josephrocca opened this issue Jun 3, 2024 · 2 comments
Open
2 of 4 tasks

stop param doesn't work at all for /v1/completions endpoint #1999

josephrocca opened this issue Jun 3, 2024 · 2 comments

Comments

@josephrocca
Copy link

josephrocca commented Jun 3, 2024

System Info

Official docker image, v2.0.4

Information

  • Docker
  • The CLI directly

Tasks

  • An officially supported command
  • My own modifications

Reproduction

Try using the stop param for the v1/completions endpoint. Note that this bug report is not related to this issue:

This bug report is about the stop param not working at all for the /v1/completions endpoint.

Expected behavior

It should work - currently it doesn't work at all. Ideally the same as OpenAI's behavior (i.e. no token boundary limitations - see above linked issue), but if that's not possible, then like /generate.

Copy link

github-actions bot commented Jul 4, 2024

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the Stale label Jul 4, 2024
@josephrocca
Copy link
Author

Not stale

@github-actions github-actions bot removed the Stale label Jul 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant