请问有messages为什么还要带conversation history？

[van1129]

在向大模型发送messages请求的时候，会带有历史聊天记录，为什么还需要在prompt里带上conversation history呢？

[ZuzooVn]

@van1129 LLMs function in a stateless manner, meaning they don't have built-in mechanisms to retain information across interactions. Each query is processed independently, without considering the context of previous exchanges.

In the case of the OpenAI ChatGPT GUI/ Poe GUI, there is a truncation algorithm running in the background. It attempts to determine the relevant information from previous messages that should be included as a prompt for the new chat.

However, when using the OpenAI GPT API, implementing contextual conversation from scratch is necessary. This means managing and passing the conversation history explicitly to maintain context between messages.