New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for repetition penalty during inference with sampling #396

Open

nischith-sarvam opened this issue Jan 30, 2024 · 1 comment

nischith-sarvam commented Jan 30, 2024

I am unable to set repetition penalty during inference with sampling. In case it is already supported can you please point me on how to use it.

Contributor

mrwyattii commented Feb 2, 2024

We do not have support for a repetition penalty in the current release. But this is something we can add in a future release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment