Skip to content

[MLAS] Plan to add RISC-V Vector (RVV) support to MLAS #24596

@qiujiandong

Description

@qiujiandong

Hi ONNX Runtime team,

First of all, thank you for the excellent work on ONNX Runtime — it’s a powerful and well-engineered framework.

I’m an engineer from Nuclei System Technology, and I’m currently working on extending MLAS to support the RISC-V Vector (RVV) extension.

Here is a brief overview of my development plan:

  • The implementation will follow the RVV v0.12.0 specification.

  • I will use the GCC trunk toolchain, which includes support for RVV.

  • I will ensure that the onnxruntime_mlas_test suite passes successfully with the changes.

  • I will evaluate performance using onnxruntime_mlas_benchmark, and aim to achieve measurable improvements with RVV optimization enabled.

  • I also plan to contribute documentation describing the implementation and usage.

  • The development is currently ongoing on my branch. Once it's ready, I will open a pull request for review.

  • Additionally, I’ve initiated a separate discussion on NaN propagation related to MLAS behavior. I would appreciate it if anyone interested could take a look and share their thoughts.

If there are any guidelines, preferences, or prerequisites for contributing to MLAS, I’d appreciate any advice you can provide in advance. I'm happy to iterate on the implementation to align with the project's expectations.

Metadata

Metadata

Assignees

No one assigned

    Labels

    performanceissues related to performance regressionsstaleissues that have not been addressed in a while; categorized by a bot

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions