Generates irrelevant / too much conversation?

[sarperdag]

Sometimes, when I simple just type "hi" as an input. The response is a whole conversation generated between human and the assistant. I only want assistant's responses to be generated. Why might this be happening?

[shahrukhx01]

@sarperdag It seems you are starting another conversation in the existing session. In that case, you can just explicitly initiate a new chat session by not sending the conversation_id, and in the response you'd receive a new conversation_id for the new session. Then the subsequent messages can be sent to the new session. You can also get rid of the older sessions in the following way:

memory_manager.remove_conversation(Memory(conversation_id="1"))

[sarperdag]

Thanks but I think I wasn't able to explain the problem clearly. Here's a screenshot of what's happening. The conversation id is 1, I'm just starting the conversation, redis db is totally empty, and I'm getting this as the response.

[shahrukhx01]

@sarperdag, it seems like it this problem is occurring since you appended an additional prompt template and we already have a fixed prompt template. If you'd like to change the prompt template to yours you can do so by modifying the get_prompt utility function. Please do let us know if this resolves this behavior.

[sarperdag]

Nope, I'm modifying the prompt template under the get_prompt function. There is no additional prompt I'm appending. The issue occurs randomly, like 20% of the time. Not always.

[shahrukhx01]

@sarperdag I suspect this could be occurring due to how the prompt is formulated, maybe rephrasing it somehow might help it.