Add examples for HuggingFace models

[adityabindal]

Create examples or tutorials to show how to deploy HuggingFace PyTorch models with TorchServe

[MFreidank]

I put together a blog post to showcase how to write custom handler code for a simple huggingface BERT sentence classifier:
https://medium.com/@freidankm_39840/deploy-huggingface-s-bert-to-production-with-pytorch-serve-27b068026d18

Let me know if I can be of any help in putting together an example or some documentation around this topic.

[chauhang]

Added by PR #302

[ehutt]

Hi - I wrote a custom model handler for serving a Hugging Face transformers T5 model for text generation. I did not find any existing examples that worked due to some slight differences between T5 and other transformers in the library. Where would be the best place to contribute this model handler example? Thanks and apologies if this is not the right place for this question.

[ekaterinatretyak]

@ehutt

Hi - I wrote a custom model handler for serving a Hugging Face transformers T5 model for text generation. I did not find any existing examples that worked due to some slight differences between T5 and other transformers in the library. Where would be the best place to contribute this model handler example? Thanks and apologies if this is not the right place for this question.

Hi,
Could you kindly share you code for serving a hugging face T5 model?

[ndvbd]

ehutt

Ehutt, Can you share the code here?