Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CUDA optional deepspeed ops #2507

Merged
merged 65 commits into from
Jan 17, 2023
Merged

CUDA optional deepspeed ops #2507

merged 65 commits into from
Jan 17, 2023

Commits on Aug 5, 2021

  1. CPU-Adam: add compile-flag to enable param-copy from CPU to GPU

    Reza Yazdani committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    7f811bf View commit details
    Browse the repository at this point in the history

  2. guarde the CUDA-related include files and variables

    Reza Yazdani committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    2422ddf View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into cpu-adam/optional_CUDA-copy

    @tjruwase
    tjruwase committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    e181f45 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Merge branch 'master' into cpu-adam/optional_CUDA-copy

    @RezaYazdaniAminabadi
    RezaYazdaniAminabadi committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    248bb35 View commit details
    Browse the repository at this point in the history

  2. remove CUDA dependency from op_builder when building against CPU

    Reza Yazdani committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    2d8b7df View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2021

  1. Merge branch 'master' into cpu-adam/optional_CUDA-copy

    @RezaYazdaniAminabadi
    RezaYazdaniAminabadi committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    8ce051c View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2021

  1. fixing the builder issues

    Reza Yazdani committed Aug 27, 2021
    Configuration menu
    Copy the full SHA
    6eda144 View commit details
    Browse the repository at this point in the history

  2. fix formatting

    Reza Yazdani committed Aug 27, 2021
    Configuration menu
    Copy the full SHA
    71a4d3d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into cpu-adam/optional_CUDA-copy

    @RezaYazdaniAminabadi
    RezaYazdaniAminabadi committed Aug 27, 2021
    Configuration menu
    Copy the full SHA
    52f7f7b View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2021

  1. return true when there is no mismatch on the cuda version

    Reza Yazdani committed Aug 30, 2021
    Configuration menu
    Copy the full SHA
    ee35deb View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2021

  1. guard for when cuda is not available & test with cpu-only environment

    Reza Yazdani committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    8950731 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into cpu-adam/optional_CUDA-copy

    @RezaYazdaniAminabadi
    RezaYazdaniAminabadi committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    04d76d5 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2022

  1. Update cpu_adam and cpu_adagrad

    @tjruwase
    tjruwase committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    5625007 View commit details
    Browse the repository at this point in the history

  2. merge with master

    @tjruwase
    tjruwase committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    f30dffa View commit details
    Browse the repository at this point in the history

  3. Format fixes

    @tjruwase
    tjruwase committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    52ef0ea View commit details
    Browse the repository at this point in the history

  4. Add configurable half precision type; Build/run in CUDA environment

    @tjruwase
    tjruwase committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    472c7ba View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    70a0598 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    bf3ca2f View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    142fb21 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Nov 30, 2022
    Configuration menu
    Copy the full SHA
    63ef769 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    b031aa9 View commit details
    Browse the repository at this point in the history

  2. Run cpu_adam and cpu_adagrad in cpu only environment

    @tjruwase
    tjruwase committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    c7ae7d1 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    7dabb62 View commit details
    Browse the repository at this point in the history

  2. Mark CUDA only unit tests

    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    1d9c9ac View commit details
    Browse the repository at this point in the history

  3. Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee… 

    …pSpeed into olruwase/cuda_optional_ops
    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    291fb13 View commit details
    Browse the repository at this point in the history

  4. CPU environment CI

    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    f19532e View commit details
    Browse the repository at this point in the history

  5. Format fixes

    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    5c85a75 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    f26bf96 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    6973079 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2022

  1. Remove --forked

    @tjruwase
    tjruwase committed Dec 17, 2022
    Configuration menu
    Copy the full SHA
    980e994 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 17, 2022
    Configuration menu
    Copy the full SHA
    99c4716 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 18, 2022
    Configuration menu
    Copy the full SHA
    26a719e View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2022

  1. Add --forked

    @tjruwase
    tjruwase committed Dec 19, 2022
    Configuration menu
    Copy the full SHA
    fdb5c4c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee… 

    …pSpeed into olruwase/cuda_optional_ops
    @tjruwase
    tjruwase committed Dec 19, 2022
    Configuration menu
    Copy the full SHA
    0589fc1 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2022

  1. CPU only CI should pass

    @tjruwase
    tjruwase committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    214f2c8 View commit details
    Browse the repository at this point in the history

  2. Format fixes

    @tjruwase
    tjruwase committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    7fd2d26 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    6241f44 View commit details
    Browse the repository at this point in the history

  4. Format fixes

    @tjruwase
    tjruwase committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    c3a3999 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee… 

    …pSpeed into olruwase/cuda_optional_ops
    @tjruwase
    tjruwase committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    613ca7e View commit details
    Browse the repository at this point in the history

  6. Remove scattered pytest.skip

    @tjruwase
    tjruwase committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    fea4d85 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2022

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    5ed6ef1 View commit details
    Browse the repository at this point in the history

  2. Fix cpu_adam unit test

    @tjruwase
    tjruwase committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    8ca082d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee… 

    …pSpeed into olruwase/cuda_optional_ops
    @tjruwase
    tjruwase committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    8da0c26 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    86d72a4 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into olruwase/cuda_optional_ops

    @jeffra
    jeffra committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    7fe7d50 View commit details
    Browse the repository at this point in the history

  6. Update .github/workflows/nv-torch-latest-cpu.yml 

    Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
    @tjruwase @mrwyattii
    tjruwase and mrwyattii committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    1ebb130 View commit details
    Browse the repository at this point in the history

  7. Update .github/workflows/nv-torch-latest-cpu.yml 

    Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
    @tjruwase @mrwyattii
    tjruwase and mrwyattii committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    7c14844 View commit details
    Browse the repository at this point in the history

  8. Address PR feedback

    @tjruwase
    tjruwase committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    e1f7372 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2022

  1. OpenMP linking

    @tjruwase
    tjruwase committed Dec 22, 2022
    Configuration menu
    Copy the full SHA
    3583f97 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2022

  1. Rebase

    @tjruwase
    tjruwase committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    58d4106 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 7, 2023
    Configuration menu
    Copy the full SHA
    f654f6a View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 8, 2023
    Configuration menu
    Copy the full SHA
    fcf8c33 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    813dbba View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    f5a44d3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    ca9ffd3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    b94c878 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    a8abd7c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    9b344a2 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2023

  1. Fix unit tests

    @tjruwase
    tjruwase committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    93bc338 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    fbde29c View commit details
    Browse the repository at this point in the history

  3. Resolve conflict

    @tjruwase
    tjruwase committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    3aead39 View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    dc7017f View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2023

  1. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    4aaf788 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    5e2d556 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into olruwase/cuda_optional_ops

    @tjruwase
    tjruwase committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    4d47047 View commit details
    Browse the repository at this point in the history