Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Set sequence_parallel strategy true in default. #846

Merged
merged 7 commits into from
Oct 25, 2022
Merged

Set sequence_parallel strategy true in default. #846

merged 7 commits into from
Oct 25, 2022

Commits on Sep 28, 2022

  1. Add introduction for sequence_parallel in README.

    @GhostScreaming
    GhostScreaming committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    cfa48d9 View commit details
    Browse the repository at this point in the history

  2. Add introduction for sequence_parallel in README.

    @GhostScreaming
    GhostScreaming committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    3a15387 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/FleetX into… 

    … develop
    @GhostScreaming
    GhostScreaming committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    b83e8fe View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2022

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/FleetX into… 

    … develop
    @GhostScreaming
    GhostScreaming committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    1ce6488 View commit details
    Browse the repository at this point in the history

  2. Add pretrain_gpt_1.3B_mp8.yaml. Sequence parallel strategey is True in 

    default. When mp_degree == 1, it will be turned off automatically.
    @GhostScreaming
    GhostScreaming committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    4c6fed8 View commit details
    Browse the repository at this point in the history

  3. Polish code.

    @GhostScreaming
    GhostScreaming committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    19215ec View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' into default_sequence_parallel

    @ForFishes
    ForFishes committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    e46ef2f View commit details
    Browse the repository at this point in the history