-
Notifications
You must be signed in to change notification settings - Fork 6
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
I would consider adding an api llm_chat_system_context(text as TEXT) that sets the first message in the history with the system role and can be modified as desired. This system's message is usually reported at the beginning of the conversation and instruct the model on how to act. The context (system's message) can change during the conversation.
Perhaps the same function without parameters or another function returns the set text.
The system context is saved as the first message in the history and is replaced if it changes. A new chat resets all messages, including the context.
What do you think?
Ref: https://huggingface.co/docs/transformers/main/en/chat_templating
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request