Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PatrickStar's Performance in Models Like GANs #228

Open
openRiemann opened this issue Nov 16, 2021 · 2 comments
Open

PatrickStar's Performance in Models Like GANs #228

openRiemann opened this issue Nov 16, 2021 · 2 comments

Comments

@openRiemann
Copy link

Hi! I am a newbie in this field. DeepSpeed provides a tutorial on GAN (https://www.deepspeed.ai/tutorials/gan/). I am curious about PatrickStar's performance in models like GANs or other CV models. I really hope that PatrickStar can make my poor GPU accommodate a large-scale GAN.

@zhuzilin
Copy link
Collaborator

zhuzilin commented Nov 16, 2021

Thank you for your interest in our project!

So far we are focusing on NLP pretrain models and haven't test on CV models yet. PatrickStar should work on CV models if you are using adam optimizer. Feel free to give it a try and report the bugs if there are any :)

@openRiemann
Copy link
Author

Thank you for your interest in our project!

So far we are focusing on NLP pretrain models and haven't test on CV models yet. PatrickStar should work on CV models if you are using adam optimizer. Feel free to give it a try and report the bugs if there are any :)

thanks for help !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants