Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add cache for Onnxruntime Compiled Programs #3056

Open
2 tasks done
TedThemistokleous opened this issue May 8, 2024 · 1 comment · May be fixed by microsoft/onnxruntime#20643
Open
2 tasks done

Add cache for Onnxruntime Compiled Programs #3056

TedThemistokleous opened this issue May 8, 2024 · 1 comment · May be fixed by microsoft/onnxruntime#20643
Assignees
@TedThemistokleous
Labels
onnxruntime PR changes interaction between MIGraphX and Onnxruntime

Comments

@TedThemistokleous
Copy link
Collaborator

TedThemistokleous commented May 8, 2024 •
edited

Add support to save and load pre compiled MIGraphX graph to From the MIGraphX EP to speed up time to inference.

  • Save our precompiled graphs
  • Load in precompiled graphs

We do a similar sort of thing for int8 and the calibration table cache for our static calibration functionality
@TedThemistokleous TedThemistokleous self-assigned this May 8, 2024
@TedThemistokleous TedThemistokleous linked a pull request May 10, 2024 that will close this issue
[MIGraphX EP] Add migraphx ep save load compiles microsoft/onnxruntime#20643
Draft
@TedThemistokleous TedThemistokleous added the onnxruntime PR changes interaction between MIGraphX and Onnxruntime label May 11, 2024
@TedThemistokleous
Copy link
Collaborator Author

Can leverage the MIGraphX API for this. Got changes into Onnxruntime draft PR need to test before I flip to full PR and be a squeaky wheel. Target for 6.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@TedThemistokleous TedThemistokleous

Labels
onnxruntime PR changes interaction between MIGraphX and Onnxruntime
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[MIGraphX EP] Add migraphx ep save load compiles TedThemistokleous/onnxruntime
1 participant
@TedThemistokleous