Loading the model from huggingface is broken.

[tuv-benedikt-mayer]

When executing the basic:

from gliner import GLiNER

model = GLiNER.from_pretrained("urchade/gliner_medium-v2.1")

only with the latest version v0.2.23, not with v0.2.22, it throws this error:

Traceback (most recent call last):
  File "/home/my-username/workspace/IDAS/backend/analytics/services/gliner_endpoint/download_gliner_model.py", line 9, in <module>
    model = GLiNER.from_pretrained("urchade/gliner_medium-v2.1")
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/my-username/.cache/uv/environments-v2/download-gliner-model-c0b76d7f0d4a21f1/lib/python3.11/site-packages/gliner/model.py", line 2800, in from_pretrained
    return gliner_class.from_pretrained(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/my-username/.cache/uv/environments-v2/download-gliner-model-c0b76d7f0d4a21f1/lib/python3.11/site-packages/gliner/model.py", line 629, in from_pretrained
    state_dict = cls._load_state_dict(model_file, map_location)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/my-username/.cache/uv/environments-v2/download-gliner-model-c0b76d7f0d4a21f1/lib/python3.11/site-packages/gliner/model.py", line 359, in _load_state_dict
    for key in f:
TypeError: 'builtins.safe_open' object is not iterable

This seems to be related to:
huggingface/transformers#40318

Are there ways to use GLiNER via torch as mentioned in that issue?

[urchade]

seems like updating transformers causes this

Can you look into this issue ? @Ingvarstep

[urchade]

fixed in #309

[tuv-jan-hery]

@urchade It seems this issue persists ("the other way around") for gliner >v0.2.22 despite the fix as the huggingface model urchade/gliner_medium-v2.1 has changed apparently in some way.

from gliner import GLiNER
model = GLiNER.from_pretrained("urchade/gliner_medium-v2.1")

results in:

ERROR:src.main:Failed to load GLiNER model at startup: 'list' object has no attribute 'keys'

The error is not thrown when using v0.2.22.

[Ingvarstep]

@urchade It seems this issue persists ("the other way around") for gliner >v0.2.22 despite the fix as the huggingface model urchade/gliner_medium-v2.1 has changed apparently in some way.

from gliner import GLiNER
model = GLiNER.from_pretrained("urchade/gliner_medium-v2.1")

results in:

ERROR:src.main:Failed to load GLiNER model at startup: 'list' object has no attribute 'keys'

The error is not thrown when using v0.2.22.

I wasn't able to reproduce the issue for v.0.2.24. Could you also share which transformers and which torch version you are using?

[tuv-jan-hery]

Thanks for the prompt response @Ingvarstep!
In our project, the following versions were used when the error was thrown:

gliner=0.2.24
torch==2.9.1
    # via gliner
transformers==4.57.3
    # via gliner