Race condition

[djmango]

Just gonna submit a PR for this real quick adding a conditional

[djmango]

I think its a race condition

[djmango]

Or maybe sending in an empty array + content causes this? going to just stop sending empty arrays lol but something to consider

[eastriverlee]

okay i should consider switching main logic to actor. thank you for reporting.

[djmango]

    ###Instructions###

    Provide exactly two words for a title for the above chat. YOU WILL BE PENALIZED for any additional words, print exactly two words

For some reason this prompt causes a crash - this is the cause of the Int32 crash i posted above

[eastriverlee]

if you give me the model, the seed, and the template you've used, it will be easier for me to check later. can you provide me those details?

[eastriverlee]

give me any minimal reproducible case if you can please.

[djmango]

Running mistral-7b-instruct-v0.2.Q4_K_M.gguf - not sure about seed, how could that be determined? It replicates every time running that string on .respond (using the .mistral template)