Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Build] ONNX Runtime Support for Cortex-M33 and Cortex-M7 #23822

Open
brainchip-india opened this issue Feb 26, 2025 · 2 comments
Open

[Build] ONNX Runtime Support for Cortex-M33 and Cortex-M7 #23822

brainchip-india opened this issue Feb 26, 2025 · 2 comments
Labels
contributions welcome external contributions welcome

Comments

@brainchip-india
Copy link

Describe the issue

I successfully ran ONNX Runtime on Cortex-A55 for a basic matrix multiplication example by directly downloading the AArch64 ONNX Runtime library.

However, I want to try it on low-level microcontrollers, so I followed the official ONNX Runtime build guide to generate an ONNX Runtime library for ARM Cortex-M33 and Cortex-M7. I am unsure if running ONNX Runtime on Cortex-M series microcontrollers is feasible.

Since Cortex-M33 is part of the ARMv8-M family, does ONNX Runtime officially support it? If not, are there any recommended lightweight alternatives for running ONNX models on Cortex-M33/M7?

I would appreciate any insights or guidance on this

Urgency

No response

Target platform

M33 and M7

Build script

I followed the official ONNX Runtime build guide to generate an ONNX Runtime library for ARM Cortex-M33

Error / output

Couldn't able to build

Visual Studio Version

No response

GCC / Compiler Version

No response

@brainchip-india brainchip-india added the build build issues; typically submitted using template label Feb 26, 2025
@snnn
Copy link
Member

snnn commented Feb 27, 2025

Sorry, we haven't tried.

@snnn snnn added contributions welcome external contributions welcome and removed build build issues; typically submitted using template labels Feb 27, 2025
@skottmckay
Copy link
Contributor

Additionally I don't believe we have any ARMv8-M kernels so even if you could build and the model ran it would most likely be slow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributions welcome external contributions welcome
Projects
None yet
Development

No branches or pull requests

3 participants