Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dynamically set max_new_tokens based on output feature length, GMSL and model window size #3713

Merged
merged 14 commits into from
Oct 13, 2023
Merged

Dynamically set max_new_tokens based on output feature length, GMSL and model window size #3713

merged 14 commits into from
Oct 13, 2023

Commits on Oct 10, 2023

  1. Dynamically set max_new_tokens based on output feature length, global… 

    … max sequence length and model window size
    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    42d0fbc View commit details
    Browse the repository at this point in the history

  2. TODO comment

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    d9c8805 View commit details
    Browse the repository at this point in the history

  3. Fix comment'

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    00a97df View commit details
    Browse the repository at this point in the history

  4. Address PR comments

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    7598806 View commit details
    Browse the repository at this point in the history

  5. Fix failing tests

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    a57db6f View commit details
    Browse the repository at this point in the history

  6. Fix tests

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    1cec86f View commit details
    Browse the repository at this point in the history

  7. Revert to base

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    58406b7 View commit details
    Browse the repository at this point in the history

  8. Add temporary buffer

    @arnavgarg1
    arnavgarg1 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    f6adf08 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. Merge branch 'master' into max_sequence_length

    @arnavgarg1
    arnavgarg1 committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    db69970 View commit details
    Browse the repository at this point in the history

  2. Fix issues by defaulting to model context len // 2

    @arnavgarg1
    arnavgarg1 committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    27011e0 View commit details
    Browse the repository at this point in the history

  3. Add better comment for test

    @arnavgarg1
    arnavgarg1 committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    a8a2cc8 View commit details
    Browse the repository at this point in the history

  4. Group tests under a single test class

    @arnavgarg1
    arnavgarg1 committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    4d198d4 View commit details
    Browse the repository at this point in the history

  5. Refactor

    @arnavgarg1
    arnavgarg1 committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    3b5ec39 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. Address comments

    @arnavgarg1
    arnavgarg1 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    d40b75f View commit details
    Browse the repository at this point in the history