Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AutoParallel] Add testcase for sequence parallel in dygraph mode. #59841

Merged
merged 29 commits into from Dec 9, 2023
Merged

[AutoParallel] Add testcase for sequence parallel in dygraph mode. #59841

merged 29 commits into from Dec 9, 2023

Conversation

GhostScreaming
Copy link
Contributor

@GhostScreaming GhostScreaming commented Dec 8, 2023 •
edited

PR types

Others

PR changes

Others

Description

Pcard-73145

Add testcase for sequence parallel in dygraph mode. Based on PR 59822.

GhostScreaming and others added 22 commits December 6, 2023 20:14
@GhostScreaming
[AutoParallel] Fix problems of sequence parallel in dynamic mode.
c185964
@GhostScreaming
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
d302229 
… fix_backward_reshard
@GhostScreaming
Polish code.
f4cb01f
@GhostScreaming
Remove TODO in transpose.cc
81d2199
@GhostScreaming
Polish code.
74e8033
@GhostScreaming
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
41cdd55 
… fix_backward_reshard
@GhostScreaming
Remove useless modification.
4de6ed7
@GhostScreaming
Polish code.
e79197e
@GhostScreaming
Polish code.
f647ef3
@GhostScreaming
Remove useless modification.
5a1cf9f
@GhostScreaming
Allow partial status flow
c8caf0c
@wuhuachaocoding
add 3D auto_parallel test.
6b90d53
@GhostScreaming
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
4ae381b 
… fix_backward_reshard
@GhostScreaming
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
2ccb14e 
… fix_backward_reshard
@wuhuachaocoding
add 3d test and fix reshard bug.
06410aa
@GhostScreaming
Merge commit 'refs/pull/59726/head' of https://github.com/PaddlePaddl…
1180c9d 
…e/Paddle into test_sp
@GhostScreaming
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
2893385 
… test_sp
@GhostScreaming
Add sequence parallel for llama.
d6c38d9
@GhostScreaming
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
522de43 
… test_sp
@GhostScreaming
Polish code according to review comments.
1e46ace
@GhostScreaming
Fix bug of backward set in_grad dist_attr.
732230b
@GhostScreaming
[AutoParalel] Add testcase for sequence parallel in dygraph mode.
2633d56
@paddle-bot Paddle-bot
Copy link

paddle-bot bot commented Dec 8, 2023

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

zhiqiu
zhiqiu approved these changes Dec 9, 2023
View reviewed changes
Copy link
Contributor

@zhiqiu zhiqiu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhiqiu zhiqiu merged commit 434f970 into PaddlePaddle:develop Dec 9, 2023
28 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zhiqiu zhiqiu zhiqiu approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@GhostScreaming @zhiqiu @wuhuachaocoding