chat with mistral nemo return empty message

[nguyenhoangthuan99]

Problem
When import any mistral-nemo model, chat always return empty message from assistant

The root cause is the prompt template is generated improperly.
The current generated prompt template is

[INST] {system_message}\n{prompt} [/INST]

The correct prompt template should be

[INST] {system_message}\n[INST] {prompt} [/INST]

Solution

Update the render chat template logic to handle this case

After update chat template renderer, can chat with Mistral nemo successfully

Related issue janhq/models#19

[gabrielle-ong]

QA - Mistral nemo works for Mac, Ubuntu
✅ Mac

✅ Ubuntu

✅ Windows