Replies: 2 comments 1 reply
-
|
good question! TGI has now OpenAI support, can it be used that way? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Yes, it uses Outlines under the hood! |
Beta Was this translation helpful? Give feedback.
-
|
I am coming back to this @rlouf since now the core has been written in Rust. Is it possible to use outlines outside the TGI by somehow connecting to it or its OpenAI compatible endpoint? The one that comes under the hood is pretty limited and not flexible. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi how do i use external HuggingFace TGI as model?
Beta Was this translation helpful? Give feedback.
All reactions