Add node to use OpenAI's GPT-3 for QA #2605
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tholor
changed the title
|
Hey @tholor this would be super-cool to have in master! Shall we take over or you think you'll be able to keep working in this? I'll merge master in here in the meantime to get the new CI working here too. |
|
@ZanSara Would be amazing if you could take over! |
# Conflicts: # haystack/json-schemas/haystack-pipeline-master.schema.json
|
As the |
julian-risch
requested changes
Jul 8, 2022
|
|
||
| def _build_prompt(self, query: str, documents: List[Document]) -> Tuple[str, List[Document]]: | ||
| """ | ||
| Builds the prompt for the GPT-3 model in order for ir to generate an answer. |
|
|
||
| class OpenAIAnswerGenerator(BaseGenerator): | ||
| """ | ||
| Uses the GPT-3 models from the OpenAI API to generate answers based on supplied documents (e.g. from any retriever in Haystack). |
There was a problem hiding this comment.
The docstring should mention that there is an API key needed and should also link to a web page with a description how to get an API key.
There was a problem hiding this comment.
Added this to the doc strings.
Krak91
pushed a commit
to Krak91/haystack
that referenced
this pull request
Jul 26, 2022
* first draft of openai node for QA * Update Documentation & Code Style * fix mypy. add node to inits * Update Documentation & Code Style * fix linter * Adapt OpenAIGenerator to completions endpoint * Update Documentation & Code Style * Fix pylint * Fix doc strings * Make use of temperature * Make use of api key in tests * Adapt doc strings Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: ZanSara <sarazanzo94@gmail.com> Co-authored-by: bogdankostic <bogdankostic@web.de>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Proposed changes:
Integrating OpenAI's GPT-3 model via their API.
The node can take documents as input and generates
top_kanswers by calling the remote API from OpenAI.Users will need to signup at OpenAI and supply their
api_keyto the node.Example:
Limitations:
OpenAI's API doesn't return scores for the answers
Open tasks:
predict_batch()(implemented inBaseGenerator)Status (please check what you already did):
closes: #2344