New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

What is the difference between this project and autotp of deepspeed? #72

Closed

frankxyy opened this issue Apr 27, 2023 · 1 comment

frankxyy commented Apr 27, 2023

It seems that in deepspeed there is an auto tensor parallel scheme to use.

Owner

BlackSamorez commented Apr 29, 2023

tensor_parallel has a few distinct features compared to deepspeed:

It works with any PyTorch model out of the box. From what I've seen, deepspeed Automatic Tensor Parallelism only works for a selection of Hugging Face models.
It works in an interactive environment in a Jupyter Notebook. Deepspeed doesn't.
It supports training. I haven't been able to find whether deepspeed Automatic Tensor Parallelism does.

BlackSamorez closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment