Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Curriculum learning support #132

Merged
merged 20 commits into from
Oct 10, 2021
Merged

Curriculum learning support #132

merged 20 commits into from
Oct 10, 2021

Commits on Oct 7, 2021

  1. CL initial commit

    @conglongli
    conglongli committed Oct 7, 2021
    Configuration menu
    Copy the full SHA
    99d2b37 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2021

  1. CL+PP support

    @conglongli
    conglongli committed Oct 8, 2021
    Configuration menu
    Copy the full SHA
    4c9c4a3 View commit details
    Browse the repository at this point in the history

  2. update

    @conglongli
    conglongli committed Oct 8, 2021
    Configuration menu
    Copy the full SHA
    82a3198 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2021

  1. Apply suggestions from code review 

    Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
    @conglongli @stas00
    conglongli and stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    21e91b9 View commit details
    Browse the repository at this point in the history

  2. apply code review comments

    @conglongli
    conglongli committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    6010a3d View commit details
    Browse the repository at this point in the history

  3. make it easier to read large numbers

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    405c7a6 View commit details
    Browse the repository at this point in the history

  4. add a cl test

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    a90d30e View commit details
    Browse the repository at this point in the history

  5. apply review comments

    @conglongli
    conglongli committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    fb04d2b View commit details
    Browse the repository at this point in the history

  6. Update examples/curriculum_learning/README.md 

    Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
    @conglongli @stas00
    conglongli and stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    8e4a466 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' of https://github.com/conglongli/Megatron-DeepSpe… 

    …ed-1 into conglongli/main
    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    3ed7075 View commit details
    Browse the repository at this point in the history

  8. update

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    d86a4f4 View commit details
    Browse the repository at this point in the history

  9. fix

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    e5a335d View commit details
    Browse the repository at this point in the history

  10. new requirement

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    0c4073b View commit details
    Browse the repository at this point in the history

  11. Update megatron/learning_rates.py 

    Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
    @conglongli @stas00
    conglongli and stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    d25fa9e View commit details
    Browse the repository at this point in the history

  12. Update megatron/learning_rates.py 

    Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
    @conglongli @stas00
    conglongli and stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    7cd53dc View commit details
    Browse the repository at this point in the history

  13. fix samples and tokens - thank you Conglong

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    5a492b3 View commit details
    Browse the repository at this point in the history

  14. fix truncation

    @conglongli
    conglongli committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    8ca1db7 View commit details
    Browse the repository at this point in the history

  15. switch to deepspeed@master

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    d7301a1 View commit details
    Browse the repository at this point in the history

  16. extend the doc

    @stas00
    stas00 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    dbf8abd View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2021

  1. Trigger CI

    @stas00
    stas00 committed Oct 10, 2021
    Configuration menu
    Copy the full SHA
    b7fd67e View commit details
    Browse the repository at this point in the history