Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Optional] Provide TFAutoModels for different head types #18

Open
MarkusSagen opened this issue Mar 14, 2022 · 0 comments
Open

[Optional] Provide TFAutoModels for different head types #18

MarkusSagen opened this issue Mar 14, 2022 · 0 comments
Labels
enhancement New feature or request feature request New feature or functionality wanted good first issue Good for newcomers

Comments

@MarkusSagen
Copy link
Collaborator

MarkusSagen commented Mar 14, 2022

When creating a TF Resuable SavedModel, it would be great to use to some extent be able to not need to create your own custom model for every model head

The basic example covers currently covers tokenizer and a base MLM model.
It would be great if to provide a TFTAutoModelForSequenceClassification, that creates a reusable saved model for with tokenizer and model. This could then be extended to every transformer head

Can be done without major changes

  • "TFAutoModel"
  • "TFAutoModelForMultipleChoice"
  • "TFAutoModelForSequenceClassification"
  • "TFAutoModelForPreTraining"
  • "TFAutoModelForTokenClassification"
  • "TFAutoModelWithLMHead"

Require Different changing Tokenizer masking?

  • "TFAutoModelForCausalLM"
  • "TFAutoModelForMaskedLM"
  • "TFAutoModelForSeq2SeqLM"

Require tokenizer to except multiple inputs

  • "TFAutoModelForQuestionAnswering"
  • "TFAutoModelForTableQuestionAnswering"
@MarkusSagen MarkusSagen added enhancement New feature or request good first issue Good for newcomers feature request New feature or functionality wanted labels Mar 14, 2022
@MarkusSagen MarkusSagen changed the title [Optional] Provide TFAutoModels for different classification heads [Optional] Provide TFAutoModels for different head types Mar 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature request New feature or functionality wanted good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant