Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minimum GPU VRAM for training #29

Open
ares123-CN opened this issue Apr 27, 2023 · 2 comments
Open

Minimum GPU VRAM for training #29

ares123-CN opened this issue Apr 27, 2023 · 2 comments

Comments

@ares123-CN
Copy link

Amazing job, I wonder the minimum GPU VRAM for training, image size is 512 and batch size is one or two

@zhangpzh
Copy link

24G I guess, since I run a RTX TITAN 24G with bsz=1, it is full. OOM occurs after setting bsz>=2. By the way, I notice in the paper the authors use V100 (32G as is known to all) for training, but the config states that the bsz is 4. It puzzels me.

@PuKuang
Copy link

PuKuang commented Mar 30, 2024

24G I guess, since I run a RTX TITAN 24G with bsz=1, it is full. OOM occurs after setting bsz>=2. By the way, I notice in the paper the authors use V100 (32G as is known to all) for training, but the config states that the bsz is 4. It puzzels me.

你好,请问你用24G 的GPU训练的时候有调整其他模型参数吗?我训练的时候32G都不够用,batch size已经是1了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants