Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ARM support #221

Closed
guillaumekln opened this issue Jun 29, 2020 · 8 comments · Fixed by #355
Closed

ARM support #221

guillaumekln opened this issue Jun 29, 2020 · 8 comments · Fixed by #355
Labels
build Build related issues or changes cpu Issues related to CPU execution enhancement New feature or request

Comments

@guillaumekln
Copy link
Collaborator

guillaumekln commented Jun 29, 2020 •
edited
Loading

It would be nice to provide an efficient execution on ARM. This architecture is widespread on mobile devices and will be used for future Apple Mac CPUs. AWS also provides instances based on ARM.

To do:

  1. Figure out what is required to cross-compile to ARM.
  2. Look into the ARM Compute Library which has GEMM primitives optimized for ARM NEON.
  3. Add ARM NEON vectorization for CPU kernels, and update automatic ISA dispatch accordingly.
@guillaumekln guillaumekln added enhancement New feature or request build Build related issues or changes cpu Issues related to CPU execution labels Jun 29, 2020
@iamweiweishi
Copy link

Any plan on this?

@guillaumekln
Copy link
Collaborator Author

I don't plan to work on that at the moment. Are you willing to contribute?

@LukaRistic009
Copy link

Hello
should i fix these issues?

@guillaumekln
Copy link
Collaborator Author

You could look at this if you are interested. Any comments, research, or experiments that you can share are appreciated.

@keichi
Copy link
Contributor

keichi commented Dec 22, 2020

Hi, can I work on this? I have a fork that runs on Apple M1 using NEON and vecLib.

@guillaumekln
Copy link
Collaborator Author

Sure. I don't think anyone else is actively working on this.

@keichi keichi mentioned this issue Dec 28, 2020
Merged
@harishankar-gopalan
Copy link

Hi, from which version is support for MAC M1 available ?

@guillaumekln
Copy link
Collaborator Author

Let's discuss Mac M1 support in the issue #724.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
build Build related issues or changes cpu Issues related to CPU execution enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Support ARM 64-bit architecture keichi/CTranslate2
5 participants
@keichi @harishankar-gopalan @guillaumekln @iamweiweishi @LukaRistic009