Skip to content
This repository has been archived by the owner on Jun 15, 2023. It is now read-only.

Training Time #4

Closed
AmingWu opened this issue Jun 18, 2019 · 2 comments
Closed

Training Time #4

AmingWu opened this issue Jun 18, 2019 · 2 comments

Comments

@AmingWu
Copy link

AmingWu commented Jun 18, 2019

Hello,
How long does your mode need to train with a single GPU?

@LuoweiZhou
Copy link
Contributor

@AmingWu we apply multi-GPU training for all the experiments due to the large amount of data we have. We have released our code on GVD and you can follow the Quick Start to run single-GPU experiments (you might want to set the batch size to the maximum your GPU memory can fit).

@LuoweiZhou
Copy link
Contributor

@AmingWu This might be a late reply but the single-GPU training from here takes about 30min per epoch (including language eval) and 20hr for 40 epochs on a TITAN Xp GPU.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants