Skip to content

Upgrade Sentence Transformers and Transformers #801

Merged
davidkyle merged 5 commits intoelastic:mainfrom
davidkyle:st-upgrade
Jul 23, 2025
Merged

Upgrade Sentence Transformers and Transformers #801
davidkyle merged 5 commits intoelastic:mainfrom
davidkyle:st-upgrade

Conversation

@davidkyle
Copy link
Copy Markdown
Member

@davidkyle davidkyle commented Jul 21, 2025

Sentence Transformers v5 adds support for sparse embedding models. v5 is now necessary for importing sparse models such as https://huggingface.co/naver/splade-v3-distilbert, without the upgrade the import fails with a ModuleNotFoundError

# Get the latest eland
docker pull docker.elastic.co/eland/eland:9.0.1

docker run -it --rm --network host docker.elastic.co/eland/eland:9.0.1 \
    eland_import_hub_model \
      --url 'http://host.docker.internal:9200/' \
      -u elastic-admin -p elastic-password \
      --hub-model-id 'naver/splade-v3-distilbert' \
      --task-type text_expansion --insecure

ModuleNotFoundError: No module named 'sentence_transformers.sparse_encoder'

A test has been added to cover this failure.

The previous requirements for Sentence Transformers was >=2.1.0,<=2.7.0 making the change to v5 a big leap but versions 3, 4, 5 have all been released in the last 12 months.

The version of Transformers is also updated to the latest release.

@davidkyle davidkyle added enhancement New feature or request topic:NLP Issue or PR about NLP model support and eland_import_hub_model labels Jul 21, 2025
Copy link
Copy Markdown
Member

@pquentin pquentin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM.

@davidkyle davidkyle merged commit bebb9d5 into elastic:main Jul 23, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request topic:NLP Issue or PR about NLP model support and eland_import_hub_model

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants