Skip to content

[Relay] Allow partial virtual device annotations.#12107

Merged
AndrewZhaoLuo merged 2 commits intoapache:mainfrom
mbs-octoml:mbs-device-annotations
Jul 15, 2022
Merged

[Relay] Allow partial virtual device annotations.#12107
AndrewZhaoLuo merged 2 commits intoapache:mainfrom
mbs-octoml:mbs-device-annotations

Conversation

@mbs-octoml
Copy link
Contributor

Previously CompilationConfig::CanonicalVirtualDevice required
the argument virtual device to contain a device type. However
now that virtual devices may contain memory scopes that's
unnecessarily strict.

With this change it is possible to write virtual device
annotations with just memory scopes, and let PlanDevices
flow those constraints along with the usual device constraints.

Previously CompilationConfig::CanonicalVirtualDevice required
the argument virtual device to contain a device type. However
now that virtual devices may contain memory scopes that's
unnecessarily strict.

With this change it is possible to write virtual device
annotations with just memory scopes, and let PlanDevices
flow those constraints along with the usual device constraints.
@AndrewZhaoLuo AndrewZhaoLuo merged commit 0d70f69 into apache:main Jul 15, 2022
xinetzone pushed a commit to daobook/tvm that referenced this pull request Nov 25, 2022
* [Relay] Allow partial virtual device annotations.

Previously CompilationConfig::CanonicalVirtualDevice required
the argument virtual device to contain a device type. However
now that virtual devices may contain memory scopes that's
unnecessarily strict.

With this change it is possible to write virtual device
annotations with just memory scopes, and let PlanDevices
flow those constraints along with the usual device constraints.

* - Make sure CanonicalVirtualDevice reuses FullyUnconstrained
mikeseven pushed a commit to mikeseven/tvm that referenced this pull request Sep 27, 2023
* [Relay] Allow partial virtual device annotations.

Previously CompilationConfig::CanonicalVirtualDevice required
the argument virtual device to contain a device type. However
now that virtual devices may contain memory scopes that's
unnecessarily strict.

With this change it is possible to write virtual device
annotations with just memory scopes, and let PlanDevices
flow those constraints along with the usual device constraints.

* - Make sure CanonicalVirtualDevice reuses FullyUnconstrained
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants