New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Patch] Add loss for ORT inference #152
Conversation
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. |
This line is why the doc build is currently failing: https://github.com/huggingface/optimum/pull/152/files#diff-3e928ce0b52f617b86cd0df9399c6bbb5804d6269c6a04b486613eb929449256R25 Until now we never actually imported
The error arises because The solution is to refactor the doc build so that we build |
FYI @JingyaHuang if you want to test that the docs build locally you can run:
You'll need a Linux machine for this since one cannot install |
This PR looks great ! |
What does this PR do?
OnnxConfig
bywrap_onnx_config_for_loss
to obtain the loss while usingORTTrainer
under the modeinference_with_ort=True
.deepspeed
for ONNX Runtime training. (Tested with ZeRO stage 2, full availability under progress)ORTTrainer
.