Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixes for worker prompt truncation in ChatML case #3673

Merged
merged 6 commits into from Aug 29, 2023
Merged

Fixes for worker prompt truncation in ChatML case #3673

merged 6 commits into from Aug 29, 2023

Commits on Aug 29, 2023

  1. Fixes for ChatML support workers

    @olliestanley
    olliestanley committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    0db0992 View commit details
    Browse the repository at this point in the history

  2. Add explanatory note

    @olliestanley
    olliestanley committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    6a3bd4c View commit details
    Browse the repository at this point in the history

  3. Simplify logic now that we always have a list of IDs

    @olliestanley
    olliestanley committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    823b210 View commit details
    Browse the repository at this point in the history

  4. Add model config for CodeLlama 13B SFT-10

    @olliestanley
    olliestanley committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    ec5630f View commit details
    Browse the repository at this point in the history

  5. print instead

    @andreaskoepf
    andreaskoepf committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    370c8be View commit details
    Browse the repository at this point in the history

  6. fix get_tokens_until()

    @andreaskoepf
    andreaskoepf committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    5d0321a View commit details
    Browse the repository at this point in the history