New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How much VRAM is needed for this? #1

Open

Echo411 opened this issue Jul 5, 2023 · 0 comments

Echo411 commented Jul 5, 2023

Hi there! Just want to quickly congratulate all the effort done in this project!

Could you share some information on what setup you used for the training of the transformer model?

how many gpu / for how long
how many steps
what batch size

It would be helpful to have these information to better understand the cost of training models.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment