New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: Disallow early stopping during warmup #290

Merged

tgaddair merged 1 commit into main from warmup-stop

Feb 29, 2024

Contributor

tgaddair commented Feb 29, 2024

Fixes issue where instruct models can early stop during warmup resulting in a None batch being returned.

Also increases the default --max-input-length param to decrease default warmup time and support longer contexts by default.


          fix: Disallow early stopping during warmup

400cec8

tgaddair merged commit 36a24ba into main

2 checks passed

tgaddair deleted the warmup-stop branch

February 29, 2024 06:48

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment