Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a an extras/contrib package #347

Open
danieldk opened this issue Oct 3, 2023 · 0 comments
Open

Add a an extras/contrib package #347

danieldk opened this issue Oct 3, 2023 · 0 comments
Labels
type/maintenance Type: Maintenance
Milestone

Comments

@danieldk
Copy link
Collaborator

danieldk commented Oct 3, 2023

Some models deviate so much from standard transformer encoder/decoders (e.g. DeBERTa and Falcon old architecture) that we probably should not support them in mainline Curated Transformers to avoid cluttering the abstractions too much (it's curated after all). Though it would still be nice to provide official support for these models. Consider an add-on package for these models.

Probably requires #346.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/maintenance Type: Maintenance
Projects
None yet
Development

No branches or pull requests

1 participant