Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor qa #984

Draft
wants to merge 63 commits into
base: main
Choose a base branch
from
Draft

Refactor qa #984

wants to merge 63 commits into from

Commits on Jan 27, 2024

  1. start

    @bmosaicml
    bmosaicml committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    cd18e74 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. still need to migrate fixtures

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    1fffbad View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    5a6e81c View commit details
    Browse the repository at this point in the history

  3. wip onboarding tests

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    4aac81e View commit details
    Browse the repository at this point in the history

  4. still workin'

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    946a4af View commit details
    Browse the repository at this point in the history

  5. still wip

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    289ca55 View commit details
    Browse the repository at this point in the history

  6. maybe done; test out on mcli now

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    3696f8d View commit details
    Browse the repository at this point in the history

  7. mcli

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    a20877d View commit details
    Browse the repository at this point in the history

  8. remove calibration error

    @bmosaicml
    bmosaicml committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    53da3ea View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. merge

    @bmosaicml
    bmosaicml committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    16b8e32 View commit details
    Browse the repository at this point in the history

  2. migration

    @bmosaicml
    bmosaicml committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    a90766e View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. migration

    @bmosaicml
    bmosaicml committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    72ce793 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    667bdec View commit details
    Browse the repository at this point in the history

  2. full migration

    @bmosaicml
    bmosaicml committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    ceff0c4 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. precommit

    @bmosaicml
    bmosaicml committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    5bb06cc View commit details
    Browse the repository at this point in the history

  2. fix

    @bmosaicml
    bmosaicml committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    fe83828 View commit details
    Browse the repository at this point in the history

  3. fix pytests

    @bmosaicml
    bmosaicml committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    b54a12b View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. refactor QA

    @bmosaicml
    bmosaicml committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    71e8391 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. refactor generation tasks

    @bmosaicml
    bmosaicml committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    0cafbab View commit details
    Browse the repository at this point in the history

  2. refactor generation tasks

    @bmosaicml
    bmosaicml committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    9099495 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. update

    @bmosaicml
    bmosaicml committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    414153e View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. restore

    @bmosaicml
    bmosaicml committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    a3f5a31 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    820069a View commit details
    Browse the repository at this point in the history

  3. add

    @bmosaicml
    bmosaicml committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    4a1cd79 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    d265979 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    ddfd7b5 View commit details
    Browse the repository at this point in the history

  2. fix

    @bmosaicml
    bmosaicml committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    71f77e3 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. wip

    @bmosaicml
    bmosaicml committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    cb3725b View commit details
    Browse the repository at this point in the history

  2. update readme

    @bmosaicml
    bmosaicml committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    5135152 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    18bae17 View commit details
    Browse the repository at this point in the history

  4. final pyright

    @bmosaicml
    bmosaicml committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    c6162dd View commit details
    Browse the repository at this point in the history

  5. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    25d431e View commit details
    Browse the repository at this point in the history

  6. done

    @bmosaicml
    bmosaicml committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    f1b334d View commit details
    Browse the repository at this point in the history

  7. pass prelimiter into ALL the ICL task datasets

    @eitanturok
    eitanturok committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    c4ed644 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    2516c24 View commit details
    Browse the repository at this point in the history

  2. allow QA task name stil lfor backward compatibility

    @bmosaicml
    bmosaicml committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    f213a40 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    35fd2f1 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. fix

    @bmosaicml
    bmosaicml committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    d570e5d View commit details
    Browse the repository at this point in the history

  2. fix test

    @bmosaicml
    bmosaicml committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    a5cd308 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    0fb37cd View commit details
    Browse the repository at this point in the history

  4. add generation length

    @bmosaicml
    bmosaicml committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    901fc69 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    a313499 View commit details
    Browse the repository at this point in the history

  6. remove max_new_tokens

    @bmosaicml
    bmosaicml committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    df19c0d View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. fix cpu trsts

    @bmosaicml
    bmosaicml committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    54bb4c7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    9ebeaa0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into migrate_subclasses_to_foundry

    @maxisawesome
    maxisawesome committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    ca9816c View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. try and fix lm eval test

    @bmosaicml
    bmosaicml committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    b9d6cd1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    691ab20 View commit details
    Browse the repository at this point in the history

  3. temp disable lm task eval test

    @bmosaicml
    bmosaicml committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    c207cd9 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. fix test?

    @bmosaicml
    bmosaicml committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    c85813b View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. fix tet

    @bmosaicml
    bmosaicml committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    08ef908 View commit details
    Browse the repository at this point in the history

  2. finish

    @bmosaicml
    bmosaicml committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    aca0e63 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. fix

    @bmosaicml
    bmosaicml committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    30fcedd View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Merge branch 'main' into migrate_subclasses_to_foundry

    @maxisawesome
    maxisawesome committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    59daa26 View commit details
    Browse the repository at this point in the history

  2. Update scripts/eval/README.md 

    Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
    @bmosaicml @dakinggg
    bmosaicml and dakinggg committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    4217a78 View commit details
    Browse the repository at this point in the history

  3. fix comments

    @bmosaicml
    bmosaicml committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    6f597a9 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    8c6e622 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. fix bug with seq len

    @bmosaicml
    bmosaicml committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    f387a73 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    cbfa3da View commit details
    Browse the repository at this point in the history

  3. restore mcli

    @bmosaicml
    bmosaicml committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    2f405d9 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'migrate_subclasses_to_foundry' of github.com:mosaicml/l… 

    …lm-foundry into migrate_subclasses_to_foundry
    @bmosaicml
    bmosaicml committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    76e600a View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Merge branch 'main' into migrate_subclasses_to_foundry

    @bmosaicml
    bmosaicml committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    898928e View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. merge

    @bmosaicml
    bmosaicml committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    65962d7 View commit details
    Browse the repository at this point in the history