Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add GenerateEmbeddings task #427

Merged
merged 8 commits into from
Mar 18, 2024
Merged

Add GenerateEmbeddings task #427

merged 8 commits into from
Mar 18, 2024

Conversation

gabrielmbmb
Copy link
Member

Description

This PR adds a new GenerateEmbeddings task, which uses an LLM and its get_last_hidden_states function to generate an embedding of the input text or conversation.

@gabrielmbmb gabrielmbmb self-assigned this Mar 18, 2024
@gabrielmbmb gabrielmbmb added the enhancement New feature or request label Mar 18, 2024
@gabrielmbmb gabrielmbmb added this to the 1.0.0 milestone Mar 18, 2024
@gabrielmbmb gabrielmbmb linked an issue Mar 18, 2024 that may be closed by this pull request
Add GenerateEmbeddings task #395
Closed
@gabrielmbmb gabrielmbmb marked this pull request as ready for review March 18, 2024 08:46
gabrielmbmb and others added 2 commits March 18, 2024 11:50
@gabrielmbmb @alvarobartt
Apply suggestions from code review
5b92a55 
Co-authored-by: Alvaro Bartolome <alvaro@argilla.io>
@gabrielmbmb
Add is_openai_format check
e27b1e8
@gabrielmbmb gabrielmbmb merged commit b14d4e8 into core-refactor Mar 18, 2024
4 checks passed
@gabrielmbmb gabrielmbmb deleted the generate_embeddings branch March 18, 2024 11:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@alvarobartt alvarobartt alvarobartt requested changes

Assignees

@gabrielmbmb gabrielmbmb

Labels
enhancement New feature or request
Projects
None yet
Milestone
1.0.0
Development

Successfully merging this pull request may close these issues.

Add GenerateEmbeddings task
2 participants
@gabrielmbmb @alvarobartt