Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is your chat template for huggingface chat ui? #8

Open
houghtonweihu opened this issue Feb 14, 2024 · 1 comment
Open

What is your chat template for huggingface chat ui? #8

houghtonweihu opened this issue Feb 14, 2024 · 1 comment

Comments

@houghtonweihu
Copy link

I saw that openchat has this chat template for Huggingface chat ui:

{
"name": "openchat/openchat-3.5-0106",
"displayName": "openchat/openchat-3.5-0106",
"description": "OpenChat 3.5 is the #1 model on MT-Bench, with only 7B parameters.",
"websiteUrl": "https://huggingface.co/openchat/openchat-3.5-0106",
"preprompt": "",
"chatPromptTemplate" : "{{#each messages}}{{#ifUser}}GPT4 Correct User: {{#if @FIRST}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}}{{content}}<|end_of_turn|>GPT4 Correct Assistant:{{/ifUser}}{{#ifAssistant}}{{content}}<|end_of_turn|>{{/ifAssistant}}{{/each}}",
"parameters": {
"temperature": 0.6,
"top_p": 0.95,
"repetition_penalty": 1.2,
"top_k": 50,
"truncate": 6016,
"max_new_tokens": 2048,
"stop": ["<|end_of_turn|>"]
},
"promptExamples": [
{
"title": "Write an email from bullet list",
"prompt": "As a restaurant owner, write a professional email to the supplier to get these products every week: \n\n- Wine (x10)\n- Eggs (x24)\n- Bread (x12)"
}, {
"title": "Code a snake game",
"prompt": "Code a basic snake game in python, give explanations for each step."
}, {
"title": "Assist in a task",
"prompt": "How do I make a delicious lemon cheesecake?"
}
]
}

=====================================================
What is the chat template for DeepSeek-Math for Huggingface chat ui?

@houghtonweihu houghtonweihu changed the title What is your template for huggingface chat ui? What is your chat template for huggingface chat ui? Feb 14, 2024
@houghtonweihu
Copy link
Author

Sorry, I do not know why there is a line in my message above. The chat templates for different models on Huggingface can be seen in this file below:

https://github.com/huggingface/chat-ui/blob/main/.env.template

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant