Skip to content

Extend AMP selection choices #4116

@danieltudosiu

Description

@danieltudosiu

Is your feature request related to a problem? Please describe.
AMP creates instability during training

Describe the solution you'd like
Extend the AMP dtype selection as HuggingFace suggests here.

Metadata

Metadata

Assignees

Type

No type

Projects

Relationships

None yet

Development

No branches or pull requests

Issue actions