Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Module-level Adapters, Save-Restore and tests #4114

Merged
merged 34 commits into from
May 17, 2022
Merged

Add Module-level Adapters, Save-Restore and tests #4114

merged 34 commits into from
May 17, 2022

Commits on May 17, 2022

  1. First draft of model level tests and support for multiple types adapt… 

    …ers in same model

Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    fcc767a View commit details
    Browse the repository at this point in the history

  2. Add save restore tests for adapters 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    345e8da View commit details
    Browse the repository at this point in the history

  3. Add save restore tests for adapters 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    8e0457e View commit details
    Browse the repository at this point in the history

  4. Add adapter only save and restore 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    a378133 View commit details
    Browse the repository at this point in the history

  5. Update base adapter config 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    775c72a View commit details
    Browse the repository at this point in the history

  6. Add tests 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    19b7702 View commit details
    Browse the repository at this point in the history

  7. Fix collection of get enabled adapters, limiting to each module's scope 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    001979e View commit details
    Browse the repository at this point in the history

  8. Update docs and add support for resolution of module adapter names 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    f73948d View commit details
    Browse the repository at this point in the history

  9. Update ASR adapters to only support module adapters 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    0ed76c2 View commit details
    Browse the repository at this point in the history

  10. Add state dict match test 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    51429a0 View commit details
    Browse the repository at this point in the history

  11. Fix name resolution for set_enabled_adapters 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    49c465b View commit details
    Browse the repository at this point in the history

  12. Correct case where name is none for set adapter 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    9282c5e View commit details
    Browse the repository at this point in the history

  13. Correct case where there are no adapters to save 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    b37cb10 View commit details
    Browse the repository at this point in the history

  14. Update config for training 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    6abada1 View commit details
    Browse the repository at this point in the history

  15. Force update to internal config upon get or set 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    b45da66 View commit details
    Browse the repository at this point in the history

  16. Add spec augment update support to adapters 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    5160410 View commit details
    Browse the repository at this point in the history

  17. Correct config update 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    1e260ab View commit details
    Browse the repository at this point in the history

  18. Add dropout support to linear adapters 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    33c25d3 View commit details
    Browse the repository at this point in the history

  19. Add type to config 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    f415b8a View commit details
    Browse the repository at this point in the history

  20. Add stochastic depth regularization to adapter merge strategy and rel… 

    …ated tests

Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    d2292ac View commit details
    Browse the repository at this point in the history

  21. Add support for dynamic strategy change 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    33eb4a3 View commit details
    Browse the repository at this point in the history

  22. Add support for dynamic strategy change 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    3fb1654 View commit details
    Browse the repository at this point in the history

  23. Add more tests 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    3a235d2 View commit details
    Browse the repository at this point in the history

  24. Add more tests 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    c956167 View commit details
    Browse the repository at this point in the history

  25. Remove logging of adapter name 

    Signed-off-by: smajumdar <titu1994@gmail.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    c5a38b7 View commit details
    Browse the repository at this point in the history

  26. Update changes for reviews 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    a6cd5ba View commit details
    Browse the repository at this point in the history

  27. Refactor the utility methods 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    aa6935b View commit details
    Browse the repository at this point in the history

  28. Refactor the utility methods 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    ca0f543 View commit details
    Browse the repository at this point in the history

  29. Fixed configs for optim and spec augment 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    834d0f6 View commit details
    Browse the repository at this point in the history

  30. Fixed configs for optim and spec augment 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    16f4d62 View commit details
    Browse the repository at this point in the history

  31. Rename method to subclassable private 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    d857c92 View commit details
    Browse the repository at this point in the history

  32. Add support for adapter module names to be pre-specified in config 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    c00ad25 View commit details
    Browse the repository at this point in the history

  33. Fix imports 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    8b0d6a8 View commit details
    Browse the repository at this point in the history

  34. Fix typos 

    Signed-off-by: smajumdar <smajumdar@nvidia.com>
    @titu1994
    titu1994 committed May 17, 2022
    Configuration menu
    Copy the full SHA
    a624f32 View commit details
    Browse the repository at this point in the history