Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python][Docs] Document how to use Ninja to build pyarrow with PYARROW_CMAKE_GENERATOR #36410

Open
jorisvandenbossche opened this issue Jun 30, 2023 · 1 comment

Comments

@jorisvandenbossche
Copy link
Member

Using ninja instead of the default cmake generator can be quite beneficial (you get some form of cached / incremental build, although not perfect), but we don't really document this at https://arrow.apache.org/docs/dev/developers/python.html

export PYARROW_CMAKE_GENERATOR=Ninja
@jorisvandenbossche
Copy link
Member Author

After using this a while, I have to say this is quite broken. Half of the time, it doesn't properly reinstall the extension modules that it should (based on which files were changed. For example, I edit _dataset.pyx, it recompiles a bunch (some subset) of cython files, and in the end sometimes prints -- Up-to-date: /home/joris/scipy/repos/arrow/python/pyarrow/./_dataset.cpython-310-x86_64-linux-gnu.so, while it obviously was not, and should have reinstalled it)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant