Skip to content

chat with system role message #16

@danielebriggi

Description

@danielebriggi

I would consider adding an api llm_chat_system_context(text as TEXT) that sets the first message in the history with the system role and can be modified as desired. This system's message is usually reported at the beginning of the conversation and instruct the model on how to act. The context (system's message) can change during the conversation.
Perhaps the same function without parameters or another function returns the set text.
The system context is saved as the first message in the history and is replaced if it changes. A new chat resets all messages, including the context.

What do you think?

Ref: https://huggingface.co/docs/transformers/main/en/chat_templating

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions