Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Custom Pipelines #201

Open
sam-h-bean opened this issue May 27, 2022 · 0 comments
Open

Support Custom Pipelines #201

sam-h-bean opened this issue May 27, 2022 · 0 comments

Comments

@sam-h-bean
Copy link
Contributor

I would like to create a custom pipeline as seen here that can leverage a quantized model. I don't see the capability to extend some sort of OrtPipeline class in the same way using optimum. I have a need for a custom pipeline because of a cross encoding task which requires some custom code but I also want to leverage the awesome speedups I get from quantizing my model 😢

Let me know if this is currently possible or if this feature has already been requested

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant