Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluation script for Huggingface Causal models #13

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Evaluation script for Huggingface Causal models #13

wants to merge 5 commits into from

Commits on May 28, 2023

  1. Huggingface causal lms evaluation script

    @ollmer
    ollmer committed May 28, 2023
    Configuration menu
    Copy the full SHA
    a858088 View commit details
    Browse the repository at this point in the history

  2. save resulting accuracies as json

    @ollmer
    ollmer committed May 28, 2023
    Configuration menu
    Copy the full SHA
    f7b9140 View commit details
    Browse the repository at this point in the history

  3. use fp16 as default

    @ollmer
    ollmer committed May 28, 2023
    Configuration menu
    Copy the full SHA
    82d60d2 View commit details
    Browse the repository at this point in the history

  4. upcast before softmax

    @ollmer
    ollmer committed May 28, 2023
    Configuration menu
    Copy the full SHA
    d108312 View commit details
    Browse the repository at this point in the history

  5. fix imports

    @ollmer
    ollmer committed May 28, 2023
    Configuration menu
    Copy the full SHA
    461a388 View commit details
    Browse the repository at this point in the history