Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Are there exiting any tricks to accelerate the training process? #37

Open
mo666666 opened this issue Feb 20, 2023 · 0 comments
Open

Are there exiting any tricks to accelerate the training process? #37

mo666666 opened this issue Feb 20, 2023 · 0 comments

Comments

@mo666666
Copy link

I try to perform the experiments on 8A100 GPUs. However, as I observed, the utilities of GPUs are quite low (<20%). Therefore, I am quite curious about whether tricks exist to further accelerate the training process.
henryaddison added a commit to henryaddison/mlde that referenced this issue Mar 17, 2023
@henryaddison
Merge pull request yang-song#37 from henryaddison/xfm-experiments
239b8d1 
Xfm experiments
henryaddison added a commit to henryaddison/mlde that referenced this issue Mar 21, 2023
@henryaddison
Merge pull request yang-song#37 from henryaddison/xfm-experiments
9368faa 
Xfm experiments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mo666666