-
Notifications
You must be signed in to change notification settings - Fork 828
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Trying to load bert vocab would result in unpickling error #249
Comments
So i noticed that I'm loading a text vocab file which is not supported? |
Using a custom handler solved the issue but I would love to know how to get it running with the predefined handlers |
@wassimseif custom handlers are not present for all types of models. If you look at https://github.com/pytorch/serve/tree/master/examples, you will find some examples. Over time, we will keep increasing the number of default handlers. Here is the current list of supported default handlers: |
If we're going to treat this as a bug (and not a limitation of the built-in handler), we'll need to figure a way to detect whether we're dealing with a parameter file serialized with |
@wassimseif For |
what is the benchmark of torchserve for bert? |
Hey @wassimseif - how did you setup your zschrc profile? it looks amazing! |
Hey @vgoklani Oh-My-Zsh + A LOT of configurations & long restless nights |
This will be addressed via #302. |
BERT models are already part of TorchServe examples. Closing. |
Hey,
I was trying to serve a finetuned bert model. in the logs of torchserve I noticed that the workers are not being loaded.
The exception I got is
The vocab file I used is this one
Also i noticed that even trying
torch.load('vocab.txt')
would throw the same error. Am i missing something with how to load the vocab ?Thank you
The text was updated successfully, but these errors were encountered: