Skip to content

[Test] Add default initialization test#54

Merged
comaniac merged 5 commits intoawslabs:mainfrom
chhzh123:test_init
Feb 13, 2023
Merged

[Test] Add default initialization test#54
comaniac merged 5 commits intoawslabs:mainfrom
chhzh123:test_init

Conversation

@chhzh123
Copy link
Contributor

Description

This PR adds a test of initialization to make sure the init_weight bypass works in slapo.build. Also, GPU memory usage is measured to ensure init_empty_weights does not introduce extra memory overheads.

Checklist

  • PR's title starts with a category (e.g. [Bugfix], [Model], [Tutorial], etc)
  • Changes are complete (i.e. I finished coding on this PR)
  • All changes have test coverage
  • Code is well-documented

@chhzh123 chhzh123 requested a review from comaniac February 12, 2023 21:16
@chhzh123 chhzh123 mentioned this pull request Feb 12, 2023
15 tasks
Copy link
Contributor

@comaniac comaniac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@comaniac comaniac merged commit 2f89806 into awslabs:main Feb 13, 2023
@comaniac
Copy link
Contributor

Thanks @chhzh123

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants