-
Notifications
You must be signed in to change notification settings - Fork 111
Closed
Description
Hi! Thanks for the great repo. I'm trying to distill a model2vec model from a relatively small sentence transformer, but it's taking several hours on GPU. Do you have any advice on optimizing this?
from model2vec.distill import distill
m2v_model = distill("MY MODEL", pca_dims=256)
m2v_model.save_pretrained("m2v_model")
Metadata
Metadata
Assignees
Labels
No labels