-
Notifications
You must be signed in to change notification settings - Fork 176
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Outlines integration #43
Comments
@rlouf We actually tried to import rather than copy the code. We met some dependency issues before, but we are happy to resolve the issues. @hnyls2002 Could you put your error messages here? |
Happy to help! |
Glad to work with you! I tried to import outlines a few weeks ago when your version was 0.0.22. The dependency error is
This is because nest_asyncio is not compatible with our dependencies. When I looked into your repo today, I was delighted that you made nest_asyncio an optional dependency. Great to see this! I will import your library into ours in a short time. |
By the way, we just implemented simple regex for constraint decoding; later, we also want to support more complex constraint decoding, such as CFGs. I am happy to see you outlines did a great job in this field! |
@rlouf Hi, I have made But when I set
Do you have any idea how to solve this? |
We will likely need to wait until vllm-project/vllm#2468 is merged on the vLLM side, which will relax the pydantic version. |
It should soon be ok, vLLM merged vllm-project/vllm#2531 that drops dependency on Pydantic v1. |
vLLM released 0.3.0 which bumps the Pydantic version to >= 2.0. We'll cut a new release in Outlines today or tomorrow. |
This package looks awesome! I was wondering why you decided to copy Outlines' code instead of importing the FSMs directly from outlines? There are several improvements on the performance of guided generation in the pipeline and you will be missing out on those. By importing you get better as we get better :)
The text was updated successfully, but these errors were encountered: