Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix input names for quantize/dequantize ONNX backend tests #6122

Merged

Conversation

adrianlizarraga
Copy link
Contributor

@adrianlizarraga adrianlizarraga commented May 2, 2024

Description

#6123
The input pb files for the following ONNX backend node tests have incorrect names that do not match the ONNX model:

  • test_dequantizelinear_uint4
  • test_dequantizelinear_int4
  • test_quantizelinear_e4m3fn
  • test_quantizelinear_e5m2
  • test_quantizelinear_uint4
  • test_quantizelinear_int4

Motivation and Context

The mismatch in input names causes issues when running these backend tests via ONNX Runtime.

Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
Copy link

codecov bot commented May 3, 2024

Codecov Report

Attention: Patch coverage is 0% with 4 lines in your changes are missing coverage. Please review.

Project coverage is 57.04%. Comparing base (83194ed) to head (74d8226).
Report is 25 commits behind head on main.

Files Patch % Lines
onnx/backend/test/case/node/dequantizelinear.py 0.00% 2 Missing ⚠️
onnx/backend/test/case/node/quantizelinear.py 0.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6122      +/-   ##
==========================================
+ Coverage   56.95%   57.04%   +0.08%     
==========================================
  Files         506      506              
  Lines       30467    30935     +468     
  Branches     4592     4592              
==========================================
+ Hits        17353    17646     +293     
- Misses      12285    12463     +178     
+ Partials      829      826       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@xadupre xadupre added this pull request to the merge queue May 3, 2024
Merged via the queue into onnx:main with commit 3bddb4d May 3, 2024
38 checks passed
@adrianlizarraga adrianlizarraga deleted the adrianl/fix-backend-test-q-dq-input-names branch May 3, 2024 16:29
@adrianlizarraga
Copy link
Contributor Author

@xadupre @gramalingam Would it be possible to cherry-pick this PR for 1.16.1? It would allow onnxruntime to run the int4 q/dq node tests.

@gramalingam
Copy link
Contributor

@cjvolzka : would it be possible to include this PR for the patch-release?

@cjvolzka cjvolzka added this to the 1.16.1 milestone May 3, 2024
cjvolzka pushed a commit that referenced this pull request May 3, 2024
### Description
#6123
The input pb files for the following ONNX backend node tests have
incorrect names that do not match the ONNX model:
- test_dequantizelinear_uint4
- test_dequantizelinear_int4
- test_quantizelinear_e4m3fn
- test_quantizelinear_e5m2
- test_quantizelinear_uint4
- test_quantizelinear_int4

### Motivation and Context
The mismatch in input names causes issues when running these backend
tests via ONNX Runtime.

---------

Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
(cherry picked from commit 3bddb4d)
cjvolzka pushed a commit that referenced this pull request May 3, 2024
### Description
#6123
The input pb files for the following ONNX backend node tests have
incorrect names that do not match the ONNX model:
- test_dequantizelinear_uint4
- test_dequantizelinear_int4
- test_quantizelinear_e4m3fn
- test_quantizelinear_e5m2
- test_quantizelinear_uint4
- test_quantizelinear_int4

### Motivation and Context
The mismatch in input names causes issues when running these backend
tests via ONNX Runtime.

---------

Signed-off-by: Adrian Lizarraga <adlizarraga@microsoft.com>
(cherry picked from commit 3bddb4d)
@cjvolzka
Copy link
Contributor

cjvolzka commented May 3, 2024

@gramalingam Sure. I added this to the existing 1.16.1 cherry-pick PR.

isdanni pushed a commit to isdanni/onnx that referenced this pull request May 6, 2024
### Description
onnx#6123
The input pb files for the following ONNX backend node tests have
incorrect names that do not match the ONNX model:
- test_dequantizelinear_uint4
- test_dequantizelinear_int4
- test_quantizelinear_e4m3fn
- test_quantizelinear_e5m2
- test_quantizelinear_uint4
- test_quantizelinear_int4

### Motivation and Context
The mismatch in input names causes issues when running these backend
tests via ONNX Runtime.

---------

Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
Signed-off-by: isdanni <leedanni@gmail.com>
@cjvolzka cjvolzka mentioned this pull request May 9, 2024
cjvolzka added a commit that referenced this pull request May 9, 2024
### Description
Check-pick commits from `main` into `rel-1.16.1` branch

### Motivation and Context
Fix 1.16.0 issues and enabled 1.16.1 builds by cherry-picking the
following PRs from `main` into the `1.16.1` branch

* Fixes since 1.16.0 release
    * #6049
    * #6048
    * #6080
    * #6122

* Update CI and Build to enable 1.16.1 builds
    * #6106
    * #6129
    * #6075
    * #6117

---------

Co-authored-by: liqun Fu <liqfu@microsoft.com>
Co-authored-by: G. Ramalingam <grama@microsoft.com>
Co-authored-by: Matthieu Darbois <mayeut@users.noreply.github.com>
Co-authored-by: Adrian Lizarraga <adlizarraga@microsoft.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
gramalingam pushed a commit to gramalingam/onnx that referenced this pull request Jun 6, 2024
### Description
onnx#6123
The input pb files for the following ONNX backend node tests have
incorrect names that do not match the ONNX model:
- test_dequantizelinear_uint4
- test_dequantizelinear_int4
- test_quantizelinear_e4m3fn
- test_quantizelinear_e5m2
- test_quantizelinear_uint4
- test_quantizelinear_int4

### Motivation and Context
The mismatch in input names causes issues when running these backend
tests via ONNX Runtime.

---------

Signed-off-by: adrianlizarraga <adlizarraga@microsoft.com>
Signed-off-by: Ganesan Ramalingam <grama@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

None yet

4 participants