Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fx] update split module pass and add customized policy #1373

Merged

Conversation

YuliangLiu0306
Copy link
Contributor

This PR mainly do two things:

  1. Update split module pass: In past split module pass, it treats partitions as a DAG, but we need treat them as a single direction linked list in pipeline parallel. The difference is if a output from partition 0 is an input argument of partition 3, the DAG will not transfer it to partition 1 and partition 2. However, in single direction linked list, we need to do so.
  2. Add customized split policy: The customized policy will make the performance test easier for us.

YuliangLiu0306 and others added 30 commits April 13, 2022 17:30
@FrankLeeeee FrankLeeeee merged commit 52bc2dc into hpcaitech:main Jul 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants