Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: per-chat and/or per-model system prompt #619

Open
lainedfles opened this issue Feb 2, 2024 · 5 comments
Open

feat: per-chat and/or per-model system prompt #619

lainedfles opened this issue Feb 2, 2024 · 5 comments

Comments

@lainedfles
Copy link
Contributor

lainedfles commented Feb 2, 2024

Describe the solution you'd like
Enable unique system prompt per-chat and/or per-model. This will allow for flexibility when working with multiple models.

@lainedfles lainedfles changed the title Per-chat and/or per-model system prompt feat: per-chat and/or per-model system prompt Feb 2, 2024
@jukofyork
Copy link

Yeah, per-model settings would be good too:

  • Coding models need a really small temperature and a repeat penalty of just a fraction over 1.0 to work properly.
  • Story generation models need a much higher temperature and repeat penalty.
  • General purpose models need something in between.

@OneAtDrt
Copy link

OneAtDrt commented Feb 4, 2024

I vote for per chat system prompt, either loaded from library or setup in the chat window when creating the new message to have the ability to select the role - system.

@jcdiv47
Copy link

jcdiv47 commented Mar 19, 2024

I was wondering if it could be like the Modelfiles but the prompt version of it, i.e., one could import/export/create/discover all sorts of pre-set prompts and/or parametes setting. In the meantime, just like the llm model selection for each chat, there could be an entry where prompts could be selected for different chats as well.

@minhhungit
Copy link

ChatTemplate or ChatProfile is good name I guess

@tjbck
Copy link
Contributor

tjbck commented May 25, 2024

Per model config has been added to our dev branch!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants