Skip to content

RuntimeError: torch._scaled_mm is only supported on devices with compute capability >= 9.0) #118703

@vgoklani

Description

@vgoklani

🚀 The feature, motivation and pitch

Possible to add support for the NVIDIA Ada Lovelace cards, which have a compute capability of 8.9?

NVIDIA's TransformerEngine works, so the feature is supported in the hardware.

Thanks!

@drisspg

Alternatives

No response

Additional context

No response

cc @yanbing-j @vkuzo @albanD @kadeng

Metadata

Metadata

Assignees

Labels

module: floatx (formerly float8)For torch.float8_e5m2 and torch.float8_e4m3 and other sub 8-bit float typestriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions