Skip to content
This repository has been archived by the owner on Nov 21, 2022. It is now read-only.

sparseml integration #197

Merged
merged 74 commits into from Sep 30, 2021
Merged

sparseml integration #197

merged 74 commits into from Sep 30, 2021

Commits on Sep 14, 2021

  1. initial commit for sparseml callback

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    a5b499f View commit details
    Browse the repository at this point in the history

  2. typos

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    c1864de View commit details
    Browse the repository at this point in the history

  3. typo

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    0ae5818 View commit details
    Browse the repository at this point in the history

  4. path for models

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    5c6ce32 View commit details
    Browse the repository at this point in the history

  5. move sparseml as callback

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    b13aa51 View commit details
    Browse the repository at this point in the history

  6. simplified change to one file for sparseml callback

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    4ceedd6 View commit details
    Browse the repository at this point in the history

  7. small bug with import sparseml

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    8d94e63 View commit details
    Browse the repository at this point in the history

  8. test change

    @mathemusician
    mathemusician committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    1b5fc82 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2021

  1. override callback with sparseml

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    40bf8e3 View commit details
    Browse the repository at this point in the history

  2. revert to not overriding callback

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    6e5010b View commit details
    Browse the repository at this point in the history

  3. added default

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    2532c8e View commit details
    Browse the repository at this point in the history

  4. added self to defaults

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    487bbe6 View commit details
    Browse the repository at this point in the history

  5. still trying to get hydra to play nice

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    54e7934 View commit details
    Browse the repository at this point in the history

  6. finally got sparseml to work

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    276706b View commit details
    Browse the repository at this point in the history

  7. added sparseml to plugins

    @mathemusician
    mathemusician committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    061ceba View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2021

  1. sparseml can now appropriately handle large inputs

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    2f88b52 View commit details
    Browse the repository at this point in the history

  2. wandb logging

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    db4097d View commit details
    Browse the repository at this point in the history

  3. logging is a lot more complicated than I thought it would be

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    8cf2dd6 View commit details
    Browse the repository at this point in the history

  4. finally got loggin to work

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    a50ab24 View commit details
    Browse the repository at this point in the history

  5. typo

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    7db8793 View commit details
    Browse the repository at this point in the history

  6. reformatted with black, add export to small model

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    31244ff View commit details
    Browse the repository at this point in the history

  7. allow saving of full model

    @mathemusician
    mathemusician committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    1ca7488 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2021

  1. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 17, 2021
    Configuration menu
    Copy the full SHA
    d3d77f1 View commit details
    Browse the repository at this point in the history

  2. get rid of automatic addition of sparseml from deepspeed and sharded … 

    …plugins
    @mathemusician
    mathemusician committed Sep 17, 2021
    Configuration menu
    Copy the full SHA
    e35884f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 17, 2021
    Configuration menu
    Copy the full SHA
    2bdf62e View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2021

  1. wandb to wab, LightningBoltsSparseMLCallback to TransformerSparseMLCa… 

    …llback, throw explicit error
    @mathemusician
    mathemusician committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    57d4c15 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    c38be9b View commit details
    Browse the repository at this point in the history

  3. get rid of wandblogger

    @mathemusician
    mathemusician committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    c0ca012 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    f49debf View commit details
    Browse the repository at this point in the history

  5. compute metrics only if labels are non -1

    @mathemusician
    mathemusician committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    e303dba View commit details
    Browse the repository at this point in the history

  6. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    afe2198 View commit details
    Browse the repository at this point in the history

  7. get rid of dependency on environment variables

    @mathemusician
    mathemusician committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    97b88c2 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    916e998 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2021

  1. add dependency to sparseml

    @mathemusician
    mathemusician committed Sep 21, 2021
    Configuration menu
    Copy the full SHA
    3863bef View commit details
    Browse the repository at this point in the history

  2. add logger to sparseml trainer

    @mathemusician
    mathemusician committed Sep 21, 2021
    Configuration menu
    Copy the full SHA
    622b5ca View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2021

  1. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    b4bb8cc View commit details
    Browse the repository at this point in the history

  2. Fix imports

    SeanNaren committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    c227247 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    aeb3b6e View commit details
    Browse the repository at this point in the history

  4. Fix

    SeanNaren committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    0bc39ca View commit details
    Browse the repository at this point in the history

  5. Indent

    SeanNaren committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    73a2331 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into sparseml

    SeanNaren committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    5de4dd1 View commit details
    Browse the repository at this point in the history

  7. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    461a6ef View commit details
    Browse the repository at this point in the history

  8. Add requirement for bolts

    SeanNaren committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    f9080b3 View commit details
    Browse the repository at this point in the history

  9. Update torch

    SeanNaren committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    8eee3e3 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2021

  1. add license

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    b162d4a View commit details
    Browse the repository at this point in the history

  2. made WABlogger test

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    f8d53cd View commit details
    Browse the repository at this point in the history

  3. delete unnecessary folders that were made during testing phase

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    7be9464 View commit details
    Browse the repository at this point in the history

  4. added callback unit test

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    6b8a398 View commit details
    Browse the repository at this point in the history

  5. handling of pure tensors from datamodule into model during onnx expor… 

    …t now works
    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    f18648a View commit details
    Browse the repository at this point in the history

  6. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    d3fa2f5 View commit details
    Browse the repository at this point in the history

  7. typo

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    6805e55 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    60a9ca2 View commit details
    Browse the repository at this point in the history

  9. PEP8 type checking to isinstance

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    cff9a44 View commit details
    Browse the repository at this point in the history

  10. get rid of unused import, comparison using unittest.assertequals

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    d872b0e View commit details
    Browse the repository at this point in the history

  11. skip callbacks test if the wrong torch version is downloaded

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    220cab6 View commit details
    Browse the repository at this point in the history

  12. correct way to check for instance of collections.ordereddict

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    93b2014 View commit details
    Browse the repository at this point in the history

  13. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    275398c View commit details
    Browse the repository at this point in the history

  14. skip test if wandb does not exist

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    372dd5c View commit details
    Browse the repository at this point in the history

  15. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    d334d61 View commit details
    Browse the repository at this point in the history

  16. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    0efcb29 View commit details
    Browse the repository at this point in the history

  17. skip loggers test if wandb exists

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    e05235b View commit details
    Browse the repository at this point in the history

  18. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    9abde72 View commit details
    Browse the repository at this point in the history

  19. PEP8

    @mathemusician
    mathemusician committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    635bfd9 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2021

  1. Add WANDB to available list and test install

    SeanNaren committed Sep 27, 2021
    Configuration menu
    Copy the full SHA
    3a8595b View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2021

  1. Add version

    SeanNaren committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    88708cf View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2021

  1. Skip tests for windows

    SeanNaren committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    dcc4f49 View commit details
    Browse the repository at this point in the history

  2. Revert "Skip tests for windows" 

    This reverts commit dcc4f49
    SeanNaren committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    f1af3a0 View commit details
    Browse the repository at this point in the history

  3. Skip for windows

    SeanNaren committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    31c900e View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2021

  1. fixed skipifs

    @mathemusician
    mathemusician committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    dd3d8dd View commit details
    Browse the repository at this point in the history

  2. sparseml documentation

    @mathemusician
    mathemusician committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    556d4b0 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    f10bc34 View commit details
    Browse the repository at this point in the history

  4. add sparseml documentation to rst tree

    @mathemusician
    mathemusician committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    1f0fe55 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' of https://github.com/mathemusician/lightning-t… 

    …ransformers
    @mathemusician
    mathemusician committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    92244f1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into sparseml

    SeanNaren committed Sep 30, 2021
    Configuration menu
    Copy the full SHA
    2788bea View commit details
    Browse the repository at this point in the history