-
Notifications
You must be signed in to change notification settings - Fork 64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
bug: Mistral streaming mode raise a NPE if content JSON field is missing #489
Comments
@langchain4j is this a known issue on the library side? |
@geoand I can't reproduce the missing Handling of missing |
if I can add my opinion, for me the issue is here: Line 82 in 9e6f759
If the And then a NPE is thrown. |
@philippart-s would you like to provide a PR with the proposed fix? |
If you agree with my proposal, I'd love to 😉 |
Go right ahead :) |
I'm not sure if it's the same problem, but I also use Mistral 7b locally, and the problem is each time it finishes token streaming, it returns this error to me. When i inspect with Postman it seems to me that the last token has no content in it (to indicate that it's done) but somehow the code continues to pass in the onNext block which causes this IllegalArgumentException instead of entering the onComplete block. For the streaming code, I literally copied paste the one from the example. |
Have you tried with 0.12.1? |
That is the version of which one ? |
Of |
Ok thanks I'll try it out and I'll let you know if the problem persists |
🙏🏼 |
Hi,
I use Mistral 7b model self deployed and I have the following error in streaming mode:
this seems to be due to the fact that the first JSON response line has not a
content
field:Perhaps it should be fine to test the presence of the
content
field?The text was updated successfully, but these errors were encountered: