Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reworking the prompt #93

Merged
merged 2 commits into from
Apr 13, 2024
Merged

Reworking the prompt #93

merged 2 commits into from
Apr 13, 2024

Conversation

shiffman
Copy link
Member

Adding biographical information and trying to provide better context for the context?

@kfahn22
Copy link

kfahn22 commented Apr 13, 2024

I don't think the biographical info is necessary. There is a Wikipedia page with most of this info, so the model will most likely already know it. Also, I would tell the model not to use the quotes verbatim. (I created a bot on HuggingFace and added quotes as context and this was a issue.)

@supercrafter100
Copy link
Collaborator

OpenAI suggests using the quotes in their documentation for providing examples. During previous tests using them it didn't seem to even include them in the response so I'm guessing the model (gpt-4, llama) knows not to include them? I guess it can't hurt having it in the system prompt though.

@shiffman
Copy link
Member Author

I don't think the biographical info is necessary. There is a Wikipedia page with most of this info, so the model will most likely already know it. Also, I would tell the model not to use the quotes verbatim. (I created a bot on HuggingFace and added quotes as context and this was a issue.)

It's not necessary but it's helpful and useful in my experience! I've run simple tests asking information about things like my bio or Nature of Code with and without additional context and the responses are more reliable and focus on the proper references and info with the additional information and context!

@kfahn22
Copy link

kfahn22 commented Apr 13, 2024 via email

@shiffman shiffman merged commit ade924b into main Apr 13, 2024
@dipamsen dipamsen deleted the prompt-engineering branch April 16, 2024 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants