Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keep descriptive outputs #14

Merged
merged 1 commit into from
Apr 21, 2023
Merged

Keep descriptive outputs #14

merged 1 commit into from
Apr 21, 2023

Conversation

rlancemartin
Copy link
Collaborator

answerScore and retrievalScore descriptive outputs can be kept as collapsible columns in the table.

They will be verbose if grade_prompt != "Fast".

You can see the templates here.

GRADE_DOCS_PROMPT will ask the model to explain itself:

template = """ 
    Given the question: \n
    {query}
    Decide if the following retreived context is relevant: \n
    {result}
    Answer in the following format: \n
    "Context is relevant: True or False." \n 
    And explain why it supports or does not support the correct answer: {answer}"""

GRADE_DOCS_PROMPT = PromptTemplate(input_variables=["query", "result", "answer"], template=template)

@vercel
Copy link

vercel bot commented Apr 20, 2023

@barniker is attempting to deploy a commit to the evaluator Team on Vercel.

To accomplish this, @barniker needs to request access to the Team.

Afterwards, an owner of the Team is required to accept their membership request.

If you're already a member of the respective Vercel Team, make sure that your Personal Vercel Account is connected to your GitHub account.

@benisgold benisgold merged commit 1b5a1d7 into main Apr 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants