Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support arbitrary options for execution providers #217

Open
gedoensmax opened this issue Nov 16, 2023 · 0 comments
Open

Support arbitrary options for execution providers #217

gedoensmax opened this issue Nov 16, 2023 · 0 comments

Comments

@gedoensmax
Copy link
Contributor

Is your feature request related to a problem? Please describe.

This will solve many more requests for extending the option catalogue available. It should also reduce maintenance overhead for options in the future.

Describe the solution you'd like

I believe one could exchange the parameter parsing here: https://github.com/triton-inference-server/onnxruntime_backend/blob/main/src/onnxruntime.cc#L456-L523
To something more flexible like the onnxruntime_perf_test is doing:
https://github.com/microsoft/onnxruntime/blob/ed89ca573a83e5adcf86a8e2cae912b6eeb9a335/onnxruntime/test/perftest/ort_test_session.cc#L132-L160

Issues that should be solved by this are: #168, #166 #194

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant