Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support model-parallel inference #238

Closed
zhuohan123 opened this issue Dec 6, 2021 · 0 comments
Closed

Support model-parallel inference #238

zhuohan123 opened this issue Dec 6, 2021 · 0 comments
Assignees
@zhuohan123
Labels
enhancement New feature

Comments

@zhuohan123
Copy link
Member

This is a TODO item after the paper deadline.
Currently, our framework only works when the program follows a "forward, backward, and apply" pattern. We should also support model parallel inference since otherwise, the trained model will not be able to used in practice
@zhuohan123 zhuohan123 added the enhancement New feature label Dec 6, 2021
@zhuohan123 zhuohan123 self-assigned this Jan 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zhuohan123 zhuohan123

Labels
enhancement New feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@merrymercy @zhuohan123