Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

webSearchQueryPromptTemplate default requires legacy tokens #504

Closed
nsarrazin opened this issue Oct 11, 2023 · 0 comments · Fixed by #503
Closed

webSearchQueryPromptTemplate default requires legacy tokens #504

nsarrazin opened this issue Oct 11, 2023 · 0 comments · Fixed by #503
Labels
back This issue is related to the Svelte backend or the DB tools

Comments

@nsarrazin
Copy link
Collaborator

Our model generates the query prompt using webSearchQueryPromptRender however it's not specified for our models so we revert to the default. The default however requires special tokens to be specified.

The intent was to move away from having to specify userMessageToken assistantMessageToken etc. because it's less flexible than the chatPromptTemplate.

Would it be possible to format the prompt for generating a query as a conversation instead? That way we can reuse chatPromptTemplate for formatting and deprecate webSearchQueryPromptTemplate
@nsarrazin nsarrazin added back This issue is related to the Svelte backend or the DB tools labels Oct 11, 2023
@nsarrazin nsarrazin mentioned this issue Oct 11, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
back This issue is related to the Svelte backend or the DB tools
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update websearch prompting & summary prompting huggingface/chat-ui
1 participant
@nsarrazin