Exception while saving model

[agurianov]

I use the example and got this error:
TypeError: cannot pickle 'onnxruntime.capi.onnxruntime_pybind11_state.InferenceSession' object

[andremacola]

More info about this: microsoft/onnxruntime#10097 and microsoft/onnxruntime#800 (comment)

[andremacola]

I have a dataset with more than 100.000 sentences and labels. Using without pickle is impossible.

However creating the pickle file is time consuming but then it is very quick to raise the api (fastapi) and the response is very fast after being stored in memory.

Using 0.4.2 for now

[davidberenstein1957]

https://github.com/Pandora-Intelligence/fast-sentence-transformers/releases/tag/0.3.3

[davidberenstein1957]

Thanks! @andremacola

[davidberenstein1957]

This will be added to a new release during the coming weekend.