Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add LongLora for both full and lora fine-tuning #1350

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Add LongLora for both full and lora fine-tuning #1350

wants to merge 13 commits into from
+870 −58

Commits on Apr 24, 2024

  1. Add LongLora

    @belerico
    belerico committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    2ac1038 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Add LongLoraArgs

    @belerico
    belerico committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    95a6539 View commit details
    Browse the repository at this point in the history

  2. Add tests

    @belerico
    belerico committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b38f0ce View commit details
    Browse the repository at this point in the history

  3. Add configs

    @belerico
    belerico committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    7bfe9ef View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of github.com:Lightning-AI/litgpt into feature/lo… 

    …nglora
    @belerico
    belerico committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    9facaf3 View commit details
    Browse the repository at this point in the history

  5. Fix setting max_seq_length when using longlora

    @belerico
    belerico committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    2dfa7a5 View commit details
    Browse the repository at this point in the history

  6. Fix formatting

    @belerico
    belerico committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    f7c6971 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Merge branch 'main' of https://github.com/Lightning-AI/litgpt into fe… 

    …ature/longlora
    @belerico
    belerico committed May 6, 2024
    Configuration menu
    Copy the full SHA
    b35b79c View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge branch 'main' of github.com:Lightning-AI/litgpt into feature/lo… 

    …nglora
    @belerico
    belerico committed May 7, 2024
    Configuration menu
    Copy the full SHA
    909ce04 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Merge branch 'main' of github.com:Lightning-AI/litgpt into feature/lo… 

    …nglora
    @belerico
    belerico committed May 9, 2024
    Configuration menu
    Copy the full SHA
    6f631b3 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Merge branch 'main' of github.com:Lightning-AI/litgpt into feature/lo… 

    …nglora
    @belerico
    belerico committed May 28, 2024
    Configuration menu
    Copy the full SHA
    e87c9d7 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge branch 'main' of github.com:Lightning-AI/litgpt into feature/lo… 

    …nglora
    @belerico
    belerico committed May 29, 2024
    Configuration menu
    Copy the full SHA
    4867b0c View commit details
    Browse the repository at this point in the history

  2. Update LongLora configs

    @belerico
    belerico committed May 29, 2024
    Configuration menu
    Copy the full SHA
    073b027 View commit details
    Browse the repository at this point in the history