Add NeuronModel classes for inference on nlp tasks#45
Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. |
philschmid
left a comment
There was a problem hiding this comment.
Thats an awesome but big PR! Didn't went into detail on all of the code changes.
Can we add a documentation Page for similar to https://huggingface.co/docs/optimum/onnxruntime/usage_guides/models as a guide and
the classes as reference: https://huggingface.co/docs/optimum/onnxruntime/package_reference/modeling_ort
@philschmid I will add the doc in a separate PR as this one is huge enough. |
|
Issue opened for logging performance problems that we found in this PR: #90 |
|
The suggestions are addressed, gently ping you for a final check then I am gonna to merge it. @michaelbenayoun |
michaelbenayoun
left a comment
There was a problem hiding this comment.
LGTM!
Huge work @JingyaHuang
|
Congrats 👯♀️ @JingyaHuang |
NeuronModelbase class architecture.NeuronModelForXXXsubclasses for tasks:feature-extraction,fill-mask,multiple-choice,question-answering,text-classification,token-classification.Upcoming
test_modeling.py)NeuronModel(s)