Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom and finetuned embedding computation #48

Open
jhoetter opened this issue Jul 25, 2022 · 0 comments
Open

Custom and finetuned embedding computation #48

jhoetter opened this issue Jul 25, 2022 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@jhoetter
Copy link
Member

jhoetter commented Jul 25, 2022

Is your feature request related to a problem? Please describe.
The creation of embeddings can range from straight-forward to super customized. Similar to labeling functions, the creation of embeddings should have a flexible interface.

Describe the solution you'd like
Provide a programmatic interface for embedding calculation to enable users to build custom embeddings, and to fine-tune the models with labeled data. For instance (roughly):

from embedders.classification.contextual import TransformerSentenceEmbedder
def classification_word_a_cat_word_b_distilbert(record):
    embedder = TransformerSentenceEmbedder("distilbert-base-cased")
    return embedder.fit_transform(record["word_a_cat_word_b"], record["is_oxymoron"])

Describe alternatives you've considered
see issue #24, which is an option to upload custom embeddings.

Additional context
related to issue #24 - but this is related to in-app actions

@jhoetter jhoetter added the enhancement New feature or request label Jul 25, 2022
@jhoetter jhoetter self-assigned this Jul 25, 2022
@jhoetter jhoetter moved this from Backlog to 2022 in Roadmap Kern AI refinery Aug 3, 2022
@FelixKirsch FelixKirsch self-assigned this Aug 10, 2022
@jhoetter jhoetter moved this from 2022 to Next cycle in Roadmap Kern AI refinery Aug 16, 2022
@jhoetter jhoetter moved this from Next cycle to 2022 in Roadmap Kern AI refinery Sep 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

2 participants