Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor to support PyTorch 2.0 and Lightning 2.0 #72

Merged
merged 79 commits into from
Apr 4, 2023
Merged

Refactor to support PyTorch 2.0 and Lightning 2.0 #72

merged 79 commits into from
Apr 4, 2023

Commits on Mar 22, 2023

  1. Initial attempt to refactor lightning code

    @hrukalive
    hrukalive committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    7acf94f View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Add hparams to yaml, successful checkpointing

    @hrukalive
    hrukalive committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    a0c2445 View commit details
    Browse the repository at this point in the history

  2. Fix batch sampler and lr_scheduler step freq

    @hrukalive
    hrukalive committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    20ae2f3 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Checkpointing done

    @hrukalive
    hrukalive committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    219b663 View commit details
    Browse the repository at this point in the history

  2. Use pl rankzero utils to discriminate main proc

    @hrukalive
    hrukalive committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    7819e0b View commit details
    Browse the repository at this point in the history

  3. use rank_zero_info

    @hrukalive
    hrukalive committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    311653a View commit details
    Browse the repository at this point in the history

  4. Clean indexed ds, add main proc check back to hparam

    @hrukalive
    hrukalive committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    9dda2eb View commit details
    Browse the repository at this point in the history

  5. remove h5py compression and ncols in binarizer tqdm

    @hrukalive
    hrukalive committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    b663b10 View commit details
    Browse the repository at this point in the history

  6. Format tqdm

    @hrukalive
    hrukalive committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    5652c43 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2023

  1. Fix bug in val_check_interval, hide v_num

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    ee67f81 View commit details
    Browse the repository at this point in the history

  2. Cleanup dataset codes, rename custom callbacks

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    7b2d23f View commit details
    Browse the repository at this point in the history

  3. Bump requirement torch and pl version

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    4798f68 View commit details
    Browse the repository at this point in the history

  4. binarizer joint aug bug fix

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    27753f6 View commit details
    Browse the repository at this point in the history

  5. revert torch version

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    1d7cd38 View commit details
    Browse the repository at this point in the history

  6. Remove py3.9 syntax

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    97a52db View commit details
    Browse the repository at this point in the history

  7. Add env for CUDNN API change, clean more codes

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    3ac11f4 View commit details
    Browse the repository at this point in the history

  8. Initial attempt to refactor lightning code

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    ae2946c View commit details
    Browse the repository at this point in the history

  9. Add hparams to yaml, successful checkpointing

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    6b15665 View commit details
    Browse the repository at this point in the history

  10. Fix batch sampler and lr_scheduler step freq

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    705265f View commit details
    Browse the repository at this point in the history

  11. Checkpointing done

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    6bc26ed View commit details
    Browse the repository at this point in the history

  12. Use pl rankzero utils to discriminate main proc

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    93e4627 View commit details
    Browse the repository at this point in the history

  13. use rank_zero_info

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    6bb4cae View commit details
    Browse the repository at this point in the history

  14. Clean indexed ds, add main proc check back to hparam

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    1dd369d View commit details
    Browse the repository at this point in the history

  15. remove h5py compression and ncols in binarizer tqdm

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    f17263a View commit details
    Browse the repository at this point in the history

  16. Format tqdm

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    49e6271 View commit details
    Browse the repository at this point in the history

  17. Fix bug in val_check_interval, hide v_num

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    5eb3d74 View commit details
    Browse the repository at this point in the history

  18. Cleanup dataset codes, rename custom callbacks

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    b2aa789 View commit details
    Browse the repository at this point in the history

  19. Bump requirement torch and pl version

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    bb3c637 View commit details
    Browse the repository at this point in the history

  20. binarizer joint aug bug fix

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    a39a9fa View commit details
    Browse the repository at this point in the history

  21. revert torch version

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    f745a6e View commit details
    Browse the repository at this point in the history

  22. Remove py3.9 syntax

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    7dae5aa View commit details
    Browse the repository at this point in the history

  23. Add env for CUDNN API change, clean more codes

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    2bbc42b View commit details
    Browse the repository at this point in the history

  24. Solve merge conflict

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    e8430a7 View commit details
    Browse the repository at this point in the history

  25. commit to pl rank_zero util

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    287d31c View commit details
    Browse the repository at this point in the history

  26. Resolve merged changes

    @hrukalive
    hrukalive committed Mar 25, 2023
    Configuration menu
    Copy the full SHA
    7f983d9 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2023

  1. Auto strategy choose, gloo backend by default

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    0543914 View commit details
    Browse the repository at this point in the history

  2. Fix for reviews

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    1a2f2c9 View commit details
    Browse the repository at this point in the history

  3. Temporary disable lock in indexed dataset builder

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    736013a View commit details
    Browse the repository at this point in the history

  4. Default nccl backend

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    b648b74 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'refactor-v2' into refactor-pl

    @hrukalive
    hrukalive authored Mar 26, 2023
    Configuration menu
    Copy the full SHA
    a818b8b View commit details
    Browse the repository at this point in the history

  6. Indexed dataset builder ext to .data

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    1977f53 View commit details
    Browse the repository at this point in the history

  7. Revert back some small changes for diff

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    c1ab92a View commit details
    Browse the repository at this point in the history

  8. Convert type to builtin

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    8888fe7 View commit details
    Browse the repository at this point in the history

  9. patch potential device mismatch for hifigan

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    b7dbe55 View commit details
    Browse the repository at this point in the history

  10. Fix for reviews

    @hrukalive
    hrukalive committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    a25cfff View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. Merge branch 'refactor-v2' into refactor-pl

    @yqzhishen
    yqzhishen authored Mar 27, 2023
    Configuration menu
    Copy the full SHA
    e632dda View commit details
    Browse the repository at this point in the history

  2. Fix checkpointing

    @hrukalive
    hrukalive committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    dbb6c05 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. Default PL configs to base.yaml

    @hrukalive
    hrukalive committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    0cc0fd6 View commit details
    Browse the repository at this point in the history

  2. Fix validation dataloader

    @hrukalive
    hrukalive committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    5222dca View commit details
    Browse the repository at this point in the history

  3. Show num params once

    @hrukalive
    hrukalive committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    c2ab411 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. Support csv in multi speaker preparation

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    a3ec41c View commit details
    Browse the repository at this point in the history

  2. Multispeaker compatible with old txt

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    27411c8 View commit details
    Browse the repository at this point in the history

  3. auto strategy fix for auto

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    b0f1712 View commit details
    Browse the repository at this point in the history

  4. Not logging grad norm

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    406279d View commit details
    Browse the repository at this point in the history

  5. Show lr in prog bar

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    254a9a0 View commit details
    Browse the repository at this point in the history

  6. Remove dependency on lightning during deployment

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    048b459 View commit details
    Browse the repository at this point in the history

  7. Guard the sampler shuffle grid size

    @hrukalive
    hrukalive committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    fc43aff View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. More meaningful grid size

    @hrukalive
    hrukalive committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    49331dc View commit details
    Browse the repository at this point in the history

  2. Separate log of lr on prog bar

    @hrukalive
    hrukalive committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    b1222e1 View commit details
    Browse the repository at this point in the history

  3. Prevent step in prog bar scientific notation

    @hrukalive
    hrukalive committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    e065812 View commit details
    Browse the repository at this point in the history

  4. Prevent distributed sampler padding

    @hrukalive
    hrukalive committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    312c810 View commit details
    Browse the repository at this point in the history

  5. Bump dependencies and simplify requirements

    @yqzhishen
    yqzhishen committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    331d1a2 View commit details
    Browse the repository at this point in the history

  6. Downgrade librosa version

    @yqzhishen
    yqzhishen committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    8aaaacd View commit details
    Browse the repository at this point in the history

  7. Merge pull request #1 from yqzhishen/simplify-deps 

    Bump dependencies and simplify requirements
    @hrukalive
    hrukalive authored Mar 30, 2023
    Configuration menu
    Copy the full SHA
    aaf1f98 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'refactor-pl' of https://github.com/hrukalive/DiffSinger … 

    …into refactor-pl
    @hrukalive
    hrukalive committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    4690210 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Correct validation logging, sampler revamp, fix hparam print bug

    @hrukalive
    hrukalive committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    77e9a04 View commit details
    Browse the repository at this point in the history

  2. Batch shuffle order and fix bf16 type in vocoder

    @hrukalive
    hrukalive committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    5f64a41 View commit details
    Browse the repository at this point in the history

  3. Fix h5py pickle on windows

    @hrukalive
    hrukalive committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    947f841 View commit details
    Browse the repository at this point in the history

  4. Make sure validation is in fp32

    @hrukalive
    hrukalive committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    78c279c View commit details
    Browse the repository at this point in the history

  5. Remove unnecessary cast to float in vocoder

    @hrukalive
    hrukalive committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    77e1d3a View commit details
    Browse the repository at this point in the history

  6. Metric manually to device

    @hrukalive
    hrukalive committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    78b2298 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2023

  1. Sampler padding and default not shuffle batch

    @hrukalive
    hrukalive committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    5c0263e View commit details
    Browse the repository at this point in the history

  2. Verbose checkpointing

    @hrukalive
    hrukalive committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    3c51a83 View commit details
    Browse the repository at this point in the history

  3. Fix permanent checkpointing

    @hrukalive
    hrukalive committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    6851b7f View commit details
    Browse the repository at this point in the history

  4. Remove printing

    @hrukalive
    hrukalive committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    9d2fdac View commit details
    Browse the repository at this point in the history

  5. Fix checkpoint top-k config change behavior

    @hrukalive
    hrukalive committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    441c622 View commit details
    Browse the repository at this point in the history

  6. Various fix for checkpointing

    @hrukalive
    hrukalive committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    d457ace View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. Permanent checkpointing

    @hrukalive
    hrukalive committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    76ef3c6 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. Fixes for lightning 2.0

    @hrukalive
    hrukalive committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    b76cfcc View commit details
    Browse the repository at this point in the history