Skip to content

[WebNN EP] Update WebNN unit test list#19103

Merged
guschmue merged 1 commit intomicrosoft:mainfrom
zesongw:update_unit_test
Jan 12, 2024
Merged

[WebNN EP] Update WebNN unit test list#19103
guschmue merged 1 commit intomicrosoft:mainfrom
zesongw:update_unit_test

Conversation

@zesongw
Copy link
Contributor

@zesongw zesongw commented Jan 12, 2024

Update WebNN test list in suite-test-list.jsonc so all test cases are passed behind WebNN CPU backend on Chrome Stable (Although some cases may fall back to CPU EP).
Enable int64 support for WebNN in unit tests.

@zesongw
Copy link
Contributor Author

zesongw commented Jan 12, 2024

@fdwr, @guschmue, PTAL, thanks!

@guschmue
Copy link
Contributor

/azp run ONNX Runtime Web CI Pipeline

@guschmue
Copy link
Contributor

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@guschmue
Copy link
Contributor

/azp run Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines could not run because the pipeline triggers exclude this branch/path.

@guschmue guschmue added the ep:WebNN WebNN execution provider label Jan 12, 2024
@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@guschmue guschmue merged commit 3eec159 into microsoft:main Jan 12, 2024
mszhanyi pushed a commit that referenced this pull request Jan 15, 2024
Update WebNN test list in suite-test-list.jsonc so all test cases are
passed behind WebNN CPU backend on Chrome Stable (Although some cases
may fall back to CPU EP).
Enable int64 support for WebNN in unit tests.
@fdwr
Copy link
Contributor

fdwr commented Jan 19, 2024

I'm curious why some of these fail (since it seems these cases would be supported now);

  • test_gemm_default_scalar_bias
  • test_layer_normalization_4d_axis_negative_3_expanded
  • test_layer_normalization_4d_axis_negative_4_expanded

Glad to see so many cases enabled.

@zesongw
Copy link
Contributor Author

zesongw commented Jan 19, 2024

  • test_gemm_default_scalar_bias

CPU backend cannot broadcast the scalar to valid tensor in gemm.

  • test_layer_normalization_4d_axis_negative_3_expanded
  • test_layer_normalization_4d_axis_negative_4_expanded

They have constofshape nodes.

siweic0 pushed a commit to siweic0/onnxruntime-web that referenced this pull request May 9, 2024
Update WebNN test list in suite-test-list.jsonc so all test cases are
passed behind WebNN CPU backend on Chrome Stable (Although some cases
may fall back to CPU EP).
Enable int64 support for WebNN in unit tests.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ep:WebNN WebNN execution provider

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants