Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[tensor] ColoTensor supports ZeRo #1015

Merged
merged 27 commits into from
May 31, 2022
Merged

[tensor] ColoTensor supports ZeRo #1015

merged 27 commits into from
May 31, 2022

Commits on May 24, 2022

  1. impl chunk manager

    @ver217
    ver217 committed May 24, 2022
    Configuration menu
    Copy the full SHA
    63ae7bf View commit details
    Browse the repository at this point in the history

  2. impl param op hook

    @ver217
    ver217 committed May 24, 2022
    Configuration menu
    Copy the full SHA
    a4d002e View commit details
    Browse the repository at this point in the history

  3. add reduce_chunk

    @ver217
    ver217 committed May 24, 2022
    Configuration menu
    Copy the full SHA
    3730baa View commit details
    Browse the repository at this point in the history

  4. add zero hook v2

    @ver217
    ver217 committed May 24, 2022
    Configuration menu
    Copy the full SHA
    cd5c51b View commit details
    Browse the repository at this point in the history

  5. add zero dp

    @ver217
    ver217 committed May 24, 2022
    Configuration menu
    Copy the full SHA
    cf588d8 View commit details
    Browse the repository at this point in the history

  6. fix TensorInfo

    @ver217
    ver217 committed May 24, 2022
    Configuration menu
    Copy the full SHA
    b4d5fa1 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2022

  1. impl load balancing when using zero without chunk

    @ver217
    ver217 committed May 25, 2022
    Configuration menu
    Copy the full SHA
    5d69c92 View commit details
    Browse the repository at this point in the history

  2. fix zero hook

    @ver217
    ver217 committed May 25, 2022
    Configuration menu
    Copy the full SHA
    ede5b0e View commit details
    Browse the repository at this point in the history

  3. polish chunk

    @ver217
    ver217 committed May 25, 2022
    Configuration menu
    Copy the full SHA
    fe8b7e7 View commit details
    Browse the repository at this point in the history

  4. fix bugs

    @ver217
    ver217 committed May 25, 2022
    Configuration menu
    Copy the full SHA
    eaad042 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2022

  1. ddp ok

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    aa9d5b1 View commit details
    Browse the repository at this point in the history

  2. zero ok

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    96131bc View commit details
    Browse the repository at this point in the history

  3. polish code

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    e95ba44 View commit details
    Browse the repository at this point in the history

  4. fix bugs about load balancing

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    388adac View commit details
    Browse the repository at this point in the history

  5. polish code

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    8599b3e View commit details
    Browse the repository at this point in the history

  6. polish code

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    1f336f9 View commit details
    Browse the repository at this point in the history

  7. add ene-to-end test

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    7c4a657 View commit details
    Browse the repository at this point in the history

  8. polish code

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    a85013f View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' into feature/colo-tensor-zero

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    75511a5 View commit details
    Browse the repository at this point in the history

  10. polish code

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    2a14d5d View commit details
    Browse the repository at this point in the history

  11. polish code

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    a1655b1 View commit details
    Browse the repository at this point in the history

  12. fix typo

    @ver217
    ver217 committed May 27, 2022
    Configuration menu
    Copy the full SHA
    c481911 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2022

  1. add test_chunk

    @ver217
    ver217 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    494acbd View commit details
    Browse the repository at this point in the history

  2. fix bugs

    @ver217
    ver217 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    7274951 View commit details
    Browse the repository at this point in the history

  3. fix bugs

    @ver217
    ver217 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    d3b7e0d View commit details
    Browse the repository at this point in the history

Commits on May 31, 2022

  1. polish code

    @ver217
    ver217 committed May 31, 2022
    Configuration menu
    Copy the full SHA
    9bc3391 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:hpcaitech/ColossalAI into feature/c… 

    …olo-tensor-zero
    @ver217
    ver217 committed May 31, 2022
    Configuration menu
    Copy the full SHA
    c028cb5 View commit details
    Browse the repository at this point in the history