Skip to content

[AutoDeploy] New row+col sharder #4320

@lucaslie

Description

@lucaslie

Develop a new row+col+all_reduce sharder that deploys a more rigorous pattern matcher rather than a heuristic. The goal is to maximize robustness over coverage, i.e., this is an optional performance gain where it's okay to miss out on patterns where we may go wrong.

The row+col sharder does not correctly trace the graph and instead just iterates over nodes and makes a heuristic check to run row+col sharding

Metadata

Metadata

Labels

AutoDeploy<NV> AutoDeploy Backend

Type

Projects

Status

In review

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions