Skip to content
This repository was archived by the owner on Aug 7, 2024. It is now read-only.

Conversation

@vkuzo
Copy link
Contributor

@vkuzo vkuzo commented Jul 24, 2024

Stack from ghstack (oldest at bottom):

Summary:

Makes the following functions public:

  • convert_to_float8_training and all of its configuration
  • linear_requires_sync
  • sync_float8_amax_and_scale_history
  • precompute_float8_dynamic_scale_for_fsdp

Everything else is private. The fbsource counterpart of this PR will
remove usage of private APIs.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D60195666

Summary:

Makes the following functions public:
* convert_to_float8_training and all of its configuration
* linear_requires_sync
* sync_float8_amax_and_scale_history
* precompute_float8_dynamic_scale_for_fsdp

Everything else is private. The fbsource counterpart of this PR will
remove usage of private APIs.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 24, 2024
vkuzo added a commit that referenced this pull request Jul 24, 2024
Summary:

Makes the following functions public:
* convert_to_float8_training and all of its configuration
* linear_requires_sync
* sync_float8_amax_and_scale_history
* precompute_float8_dynamic_scale_for_fsdp

Everything else is private. The fbsource counterpart of this PR will
remove usage of private APIs.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 923035b
Pull Request resolved: #330
@vkuzo
Copy link
Contributor Author

vkuzo commented Jul 24, 2024

@vkuzo has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in a6cef5a.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Merged

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants