Feature Request: Change Chat Prompt (Roles and Prompt)

[cabralski]

Currently, the prompt for the Chat mode on python-backend is as follows:

The following is a coherent verbose detailed conversation between a girl named {bot} and her friend {user}.
{bot} is very intelligent, creative and friendly.
{bot} is unlikely to disagree with {user}, and {bot} doesn't like to ask {user} questions.
{bot} likes to tell {user} a lot about herself and her opinions.
{bot} usually gives {user} kind, helpful and informative advices.

Some releases of RWKV such as RWKV-4-World, state that Alice/Bob should not be used, but instead: Human/Bot, User/AI, Question/Answer, see this model card for the exact statement.

There are plenty of "configuration" endpoints now, such as:

@router.post("/switch-model")
def switch_model(body: SwitchModelBody, response: Response):
    ...

We could make one more endpoint such as:

@router.post("/change-chat-prompt")
def change_chat_prompt(body: ChangeChatPromptBody):
    ...

..that allows for changes the prompt, as well as specifying what stop is going to be (user, assistant). That will also require some UI changes.

[josStorer]

v1.4.3 and v1.4.5 have added user_name, assistant_name, raw, presystem fields to implement this