Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add EuroBert Model To Config #36817

Open
2 tasks done
zynos opened this issue Mar 19, 2025 · 1 comment
Open
2 tasks done

Add EuroBert Model To Config #36817

zynos opened this issue Mar 19, 2025 · 1 comment

Comments

@zynos
Copy link

zynos commented Mar 19, 2025

Model description

I would like to have the EuroBert model added to the config (configuration_auto.py) :)
Especially the 210M version:
https://huggingface.co/EuroBERT

This would probably solve an issue in Flair:
flairNLP/flair#3630

  File "C:\Users\nick\PycharmProjects\flair\.venv\Lib\site-packages\flair\embeddings\transformer.py", line 1350, in from_params
    config_class = CONFIG_MAPPING[model_type]
                   ~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "C:\Users\nick\PycharmProjects\flair\.venv\Lib\site-packages\transformers\models\auto\configuration_auto.py", line 794, in __getitem__
    raise KeyError(key)
KeyError: 'eurobert'

Open source status

  • The model implementation is available
  • The model weights are available

Provide useful links for the implementation

@tomaarsen

@Rocketknight1
Copy link
Member

Hi @zynos, Eurobert is a custom code model! This means the model code is contained in the model repos, not in transformers. The issue in flairNLP is likely because they aren't loading the tokenizer/model/config with trust_remote_code=True.

If loading remote code repos is impossible, then you'd need to make a full PR to transformers to add the eurobert code as a new model class.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants