Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Separate out the biases #1156

Closed
wants to merge 11 commits into from
Closed

Separate out the biases #1156

wants to merge 11 commits into from

Commits on Mar 18, 2024

  1. Separate out the biases

    @rasbt
    rasbt committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    bfbda22 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. Merge branch 'main' into seperate-biases

    @rasbt
    rasbt committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    eec0eb9 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Merge branch 'main' into seperate-biases

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    ca6ecea View commit details
    Browse the repository at this point in the history

  2. Comma makes it a tuple

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    e6265de View commit details
    Browse the repository at this point in the history

  3. Test to validate bias value

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    e35b90a View commit details
    Browse the repository at this point in the history

  4. Make all biases to be False by default

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    58d442b View commit details
    Browse the repository at this point in the history

  5. Update tests to adapt to new default bias value

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    d9cbeab View commit details
    Browse the repository at this point in the history

  6. Update tinystories.yaml with separated biases

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    3761ab9 View commit details
    Browse the repository at this point in the history

  7. In HF there a single bias to rule them all

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    00ee6b6 View commit details
    Browse the repository at this point in the history

  8. Update Thunder tests for the new bias

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    19f2dea View commit details
    Browse the repository at this point in the history

  9. Update regular pretrain test for Thunder

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    a22e998 View commit details
    Browse the repository at this point in the history