Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Arm Compute Library Execution Provider #22032

Merged
merged 4 commits into from
Sep 13, 2024
Merged

Update Arm Compute Library Execution Provider #22032

merged 4 commits into from
Sep 13, 2024

Conversation

MichaelTylerArm
Copy link
Contributor

Description

This PR makes the following updates to the Arm Compute Library execution provider:

  • Target Arm Compute Library 24.07
  • Add support for the following operators:
    • Conv (FP16)
    • NhwcConv
    • QLinearConv
    • MatMul
    • FusedMatMul
    • MatMulIntegerToFloat
  • Optimize memory usage and performance
  • Expose the enable_fast_math setting
  • Use the main runtime thread pool

Motivation and Context

These updates improve performance and memory usage, and enable use of a more recent version of Arm Compute Library.

@microsoft-github-policy-service agree company="Arm Ltd"

@MichaelTylerArm
Update ACL execution provider
2b7ccf3 
Change-Id: Ie1518441dd8d9dc09119cb8ef383ca9ded93445d
Signed-off-by: Michael Tyler <michael.tyler@arm.com>
@MichaelTylerArm
Merge branch 'main' into acl_v24.07
5c4a971 
Change-Id: I8048be912f6bcf3de7e591edb32b055f7e20baf9
@MichaelTylerArm
Copy link
Contributor Author

@microsoft-github-policy-service agree company="Arm Ltd"

@jywu-msft
Copy link
Member

thanks!

@MichaelTylerArm
Apply linter
d343867 
Change-Id: I3941c6f68d7a76e5a0df1c5eb35f4dc2207d2bbd
@MichaelTylerArm
Copy link
Contributor Author

@jywu-msft It looks like the workflows require maintainer approval, would you be able to retrigger them please?

@jywu-msft
Copy link
Member

@jywu-msft It looks like the workflows require maintainer approval, would you be able to retrigger them please?

thanks. will do.

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,Windows x64 QNN CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 7 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 5 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

@MichaelTylerArm
Apply Spotless
1abd62d 
Change-Id: I835794b0e5b2d7d0fe4f60e8af3e9bf3c822f0ae
@MichaelTylerArm
Copy link
Contributor Author

@jywu-msft Thanks for your help, please can you retrigger again?

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,Windows x64 QNN CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 7 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 5 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

jywu-msft
jywu-msft approved these changes Sep 13, 2024
View reviewed changes
Copy link
Member

@jywu-msft jywu-msft left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution!

@jywu-msft jywu-msft merged commit 904b850 into microsoft:main Sep 13, 2024
71 checks passed
@jywu-msft jywu-msft mentioned this pull request Sep 24, 2024
Open
@MichaelTylerArm MichaelTylerArm mentioned this pull request Sep 26, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jywu-msft jywu-msft jywu-msft approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@MichaelTylerArm @jywu-msft