You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to create a custom pipeline as seen here that can leverage a quantized model. I don't see the capability to extend some sort of OrtPipeline class in the same way using optimum. I have a need for a custom pipeline because of a cross encoding task which requires some custom code but I also want to leverage the awesome speedups I get from quantizing my model 😢
Let me know if this is currently possible or if this feature has already been requested
The text was updated successfully, but these errors were encountered:
I would like to create a custom pipeline as seen here that can leverage a quantized model. I don't see the capability to extend some sort of
OrtPipeline
class in the same way using optimum. I have a need for a custom pipeline because of a cross encoding task which requires some custom code but I also want to leverage the awesome speedups I get from quantizing my model 😢Let me know if this is currently possible or if this feature has already been requested
The text was updated successfully, but these errors were encountered: