feat(vertex_ai): Support task type and title in embeddings models #149
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The embeddings API now support a "task type" parameter to define the kind of task the embedding will be used for to help the model produce better quality embeddings. - RETRIEVAL_QUERY: Specifies the given text is a query in a search/retrieval setting. - RETRIEVAL_DOCUMENT: Specifies the given text is a document in a search/retrieval setting. - SEMANTIC_SIMILARITY: Specifies the given text will be used for Semantic Textual Similarity (STS). - CLASSIFICATION: Specifies that the embeddings will be used for classification. - CLUSTERING: Specifies that the embeddings will be used for clustering. For RETRIEVAL_DOCUMENT task, a "title" parameter can also be attached. These two new parameters are only supported in models released in or after August 2023. Docs: https://cloud.google.com/vertex-ai/docs/generative-ai/embeddings/get-text-embeddings#api_changes_to_models_released_in_or_after_august_2023
davidmigloz
added
t:enhancement
KennethKnudsen97
pushed a commit
to KennethKnudsen97/langchain_dart
that referenced
this pull request
Sep 29, 2023
…vidmigloz#149) The embeddings API now support a "task type" parameter to define the kind of task the embedding will be used for to help the model produce better quality embeddings. - RETRIEVAL_QUERY: Specifies the given text is a query in a search/retrieval setting. - RETRIEVAL_DOCUMENT: Specifies the given text is a document in a search/retrieval setting. - SEMANTIC_SIMILARITY: Specifies the given text will be used for Semantic Textual Similarity (STS). - CLASSIFICATION: Specifies that the embeddings will be used for classification. - CLUSTERING: Specifies that the embeddings will be used for clustering. For RETRIEVAL_DOCUMENT task, a "title" parameter can also be attached. These two new parameters are only supported in models released in or after August 2023. Docs: https://cloud.google.com/vertex-ai/docs/generative-ai/embeddings/get-text-embeddings#api_changes_to_models_released_in_or_after_august_2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The embeddings API now support a "task type" parameter to define the kind of task the embedding will be used for to help the model produce better quality embeddings.
For RETRIEVAL_DOCUMENT task, a "title" parameter can also be attached.
These two new parameters are only supported in models released in or after August 2023.
Docs:
https://cloud.google.com/vertex-ai/docs/generative-ai/embeddings/get-text-embeddings#api_changes_to_models_released_in_or_after_august_2023