Tags: microsoft/Olive
Tags
Copy of #1862 (#1864) ## Copy of #1862: gate optimum[openvino] version to <=1.24 ## Checklist before requesting a review - [ ] Add unit tests for this change. - [ ] Make sure all tests can pass. - [ ] Update documents if necessary. - [ ] Lint and apply fixes to your code by running `lintrunner -a` - [ ] Is this a user-facing change? If yes, give a description of this change to be included in the release notes. - [ ] Is this PR including examples changes? If yes, please remember to update [example documentation](https://github.com/microsoft/Olive/blob/main/docs/source/examples.md) in a follow-up PR. ## (Optional) Issue link --------- Co-authored-by: Kaunain <kaunain.ahmed@intel.com>
Fix resave_model bug (#1723) ## Describe your changes `resave_model` has a bug where the model after saving had zero length since the `raw_data` field was still present with `b""` and it unintentionally triggered this code path in `onnx.save_model` https://github.com/onnx/onnx/blob/1854a08c9daab2666b1dc0096afe3930659fcff1/onnx/external_data_helper.py#L326. Fixed by clearing `raw_data` field after the external data file is renamed. ## Checklist before requesting a review - [x] Add unit tests for this change. - [x] Make sure all tests can pass. - [ ] Update documents if necessary. - [ ] Lint and apply fixes to your code by running `lintrunner -a` - [ ] Is this a user-facing change? If yes, give a description of this change to be included in the release notes. - [ ] Is this PR including examples changes? If yes, please remember to update [example documentation](https://github.com/microsoft/Olive/blob/main/docs/source/examples.md) in a follow-up PR. ## (Optional) Issue link Fixes #1722
🏪 Support opversion conversion for models with external data (#1322) ## Describe your changes ## Checklist before requesting a review - [ ] Add unit tests for this change. - [ ] Make sure all tests can pass. - [ ] Update documents if necessary. - [ ] Lint and apply fixes to your code by running `lintrunner -a` - [ ] Is this a user-facing change? If yes, give a description of this change to be included in the release notes. - [ ] Is this PR including examples changes? If yes, please remember to update [example documentation](https://github.com/microsoft/Olive/blob/main/docs/source/examples.md) in a follow-up PR. ## (Optional) Issue link
🌜 Qnn Mixed precision init_overrides processing (#1234) ## Describe your changes - Added a new pass of Qnn Mixed precision overrides. This pass preprocesses the model for mixed precision quantization by resolving constraints that each operator has when being converted to QNN operator. Constraints refer to situations where certain tensor cannot be quantized to 16 bits standalone but rather neighbouring tensors as well in order to have valid operators - Update onnx quantization to let it accept the init_overrides config from last model output which is enabled only for qnn config preparation. ## Checklist before requesting a review - [ ] Add unit tests for this change. - [ ] Make sure all tests can pass. - [ ] Update documents if necessary. - [ ] Lint and apply fixes to your code by running `lintrunner -a` - [ ] Is this a user-facing change? If yes, give a description of this change to be included in the release notes. - [ ] Is this PR including examples changes? If yes, please remember to update [example documentation](https://github.com/microsoft/Olive/blob/main/docs/source/examples.md) in a follow-up PR. ## (Optional) Issue link
PreviousNext