Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Support torch ZeroRedundancyOptimizer #551

Merged
merged 25 commits into from
Oct 27, 2022
Merged

[Feature] Support torch ZeroRedundancyOptimizer #551

merged 25 commits into from
Oct 27, 2022

Commits on Sep 27, 2022

  1. [Feature] Support torch ZeRORedundancyOptimizer 

    Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Hakjin Lee <nijkah@gmail.com>
    @nijkah @KKIEEK
    nijkah and KKIEEK committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    d466fb8 View commit details
    Browse the repository at this point in the history

  2. lint

    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    d957bdc View commit details
    Browse the repository at this point in the history

  3. Fix saving optimizer state_dict

    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    67bcec8 View commit details
    Browse the repository at this point in the history

  4. Fix handling import error

    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    da39cd2 View commit details
    Browse the repository at this point in the history

  5. Add test case

    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    a408f69 View commit details
    Browse the repository at this point in the history

  6. fix UT

    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    dd64538 View commit details
    Browse the repository at this point in the history

  7. Revert "fix UT" 

    This reverts commit dd64538.
    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    48806af View commit details
    Browse the repository at this point in the history

  8. fix handling import in UT

    @nijkah
    nijkah committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    00ed3b3 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2022

  1. Fix saving zero checkpoint and delete redundant master_only

    @nijkah
    nijkah committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    dd5986c View commit details
    Browse the repository at this point in the history

  2. lint

    @nijkah
    nijkah committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    764133d View commit details
    Browse the repository at this point in the history

  3. test unittest

    @nijkah
    nijkah committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    f9a6dad View commit details
    Browse the repository at this point in the history

  4. Fix handling impor error

    @nijkah
    nijkah committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    1c1da2e View commit details
    Browse the repository at this point in the history

  5. Fix UT condition

    @nijkah
    nijkah committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    0275d08 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2022

  1. Edit docstrings

    @nijkah
    nijkah committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    831e5c7 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2022

  1. Fix typo

    @nijkah
    nijkah committed Oct 7, 2022
    Configuration menu
    Copy the full SHA
    543f34e View commit details
    Browse the repository at this point in the history

  2. Skip redundant procudure in checkpoint hook

    @nijkah
    nijkah committed Oct 7, 2022
    Configuration menu
    Copy the full SHA
    715f1a5 View commit details
    Browse the repository at this point in the history

  3. fix typo again

    @nijkah
    nijkah committed Oct 7, 2022
    Configuration menu
    Copy the full SHA
    4933933 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2022

  1. Merge remote-tracking branch 'origin/main' into zero_1_optimizer

    @nijkah
    nijkah committed Oct 8, 2022
    Configuration menu
    Copy the full SHA
    2b7417c View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2022

  1. Update mmengine/optim/optimizer/zero_optimizer.py 

    Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
    @nijkah @zhouzaida
    nijkah and zhouzaida committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    9d63ea6 View commit details
    Browse the repository at this point in the history

  2. Add api info

    @nijkah
    nijkah committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    e244e30 View commit details
    Browse the repository at this point in the history

  3. lint

    @nijkah
    nijkah committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    41dff5a View commit details
    Browse the repository at this point in the history

  4. Fix lint

    @nijkah
    nijkah committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    929cf06 View commit details
    Browse the repository at this point in the history

  5. Handling AmpOptimWrapper case

    @nijkah
    nijkah committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    d6d0f45 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2022

  1. handling overlap_with_ddp

    @nijkah
    nijkah committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    f0ac4cb View commit details
    Browse the repository at this point in the history

  2. Fix error

    @nijkah
    nijkah committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    adee57c View commit details
    Browse the repository at this point in the history