Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wheel support for linux aarch64 #2994

Open
odidev opened this issue Nov 2, 2020 · 4 comments
Open

Wheel support for linux aarch64 #2994

odidev opened this issue Nov 2, 2020 · 4 comments
Labels
feature Issue described a new feature impact MEDIUM Big annoyance for affected users reach LOW Affects only niche use-case users

Comments

@odidev
Copy link

odidev commented Nov 2, 2020

Summary
Installing gensim on aarch64 via pip using command "pip3 install gensim" tries to build wheel from source code.

Problem description
gensim doesn't have wheel for aarch64 on PyPI repository. So, while installing gensim via pip on aarch64, pip builds wheel for same resulting in it takes more time to install gensim. Making wheel available for aarch64 will benefit aarch64 users by minimizing gensim installation time.

Expected Output
Pip should be able to download gensim wheel from PyPI repository rather than building it from source code.

@gensim-team, please let me know if I can help you building wheel/uploading to PyPI repository. I am curious to make gensim wheel available for aarch64. It will be a great opportunity for me to work with you.

@piskvorky piskvorky added impact MEDIUM Big annoyance for affected users reach LOW Affects only niche use-case users feature Issue described a new feature labels Nov 2, 2020
@piskvorky
Copy link
Owner

piskvorky commented Nov 2, 2020

Sure, that'd be great. The main obstacle is that none of us work with that platform, and building wheels reliably and automatically (as part of CI) is tricky.

If you're up for it, please study https://github.com/RaRe-Technologies/gensim/wiki/Developer-page and let us know if you think adding wheels for aarch64 is possible.

@gojomo
Copy link
Collaborator

gojomo commented Nov 3, 2020

But the pip install still works, just a little slower, right?

I would suggest that we only add support for a new architecture if our existing CI machines can auto-build it. (And, if Gensim's actual PyPI packages/wheels aren't being collected directly from CI machines for upload to PyPI, that would also be a good step in the direction of reliability/assurance/reproducibility of builds.)

@piskvorky
Copy link
Owner

piskvorky commented Nov 3, 2020

Of course, manual builds are out of the question.

@nikaro
Copy link
Contributor

nikaro commented Jan 16, 2023

It looks like people uses qemu and cibuildwheel for that (cf. example).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Issue described a new feature impact MEDIUM Big annoyance for affected users reach LOW Affects only niche use-case users
Projects
None yet
Development

No branches or pull requests

4 participants