Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Tracking Issue] Support RPC-based execution with AoT Executor #10076

Open
areusch opened this issue Jan 26, 2022 · 0 comments
Open

[Tracking Issue] Support RPC-based execution with AoT Executor #10076

areusch opened this issue Jan 26, 2022 · 0 comments
Labels
core:rpc executor:aot runtime components of AOT flow. src/runtime/aot_executor, src/runtime/crt/aot_executor
Projects
microTVM

Comments

@areusch
Copy link
Contributor

areusch commented Jan 26, 2022

Right now it's not possible to use the AoT executor on micro over the RPC channel. This issue tracks support for that.

There are a couple pieces here:

  1. Exporting the shape and dtype of parameters so that it can be consumed either from metadata.json or by the runtime.
  2. Writing PackedFunc wrappers around the AoT Executor, similar to Add Module-Based Model Runtime Interface for AOT (support C++ runtime) #9697 (but for C runtime).
@areusch areusch added this to Q1 2022 in microTVM Jan 26, 2022
@alanmacd alanmacd mentioned this issue Apr 18, 2022
Merged
@areusch areusch moved this from Q1 2022 to Q2 2022 in microTVM Apr 20, 2022
@areusch areusch added the needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it label Oct 19, 2022
@driazati driazati added executor:aot runtime components of AOT flow. src/runtime/aot_executor, src/runtime/crt/aot_executor core:rpc and removed needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it labels Oct 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
core:rpc executor:aot runtime components of AOT flow. src/runtime/aot_executor, src/runtime/crt/aot_executor
Projects
microTVM
Q2 2022
Milestone
No milestone
Development

No branches or pull requests
2 participants
@areusch @driazati