Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bugfix: last minibatch padding #8

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Bugfix: last minibatch padding #8

wants to merge 5 commits into from

Commits on Feb 7, 2024

  1. Added right-padding to minibatch if less than expected size and remov… 

    …ed this from final logits/labels
    @ojh31
    ojh31 committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    19a6b90 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Set model parallel for mistral

    @ojh31
    ojh31 committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    20ab2c0 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. train runs now but gets suspicious 100% train accuracy despite eval a… 

    …ccuracy 50%
    @ojh31
    ojh31 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    313638f View commit details
    Browse the repository at this point in the history

  2. Fixed definition of mbatch len and logged std error of train accuracy

    @ojh31
    ojh31 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    6421868 View commit details
    Browse the repository at this point in the history

  3. Checked for empty minibatch and dropped std error of accuracy

    @ojh31
    ojh31 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    825da72 View commit details
    Browse the repository at this point in the history