-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Python] Python does not find the DLLs correctly on Windows #32999
Comments
Antoine Pitrou / @pitrou: |
I've only ever seen this be necessary for prioritizing conda-DLLs over stuff in C:/System32 (e.g. openssl), but AFAIU the efforts of Isuru and other people in core is to make this variable obsolete (by having things work correctly by default). I think newer CPython versions by conda-forge might not even have it anymore. Which version of Python is this failing with, and what libraries are missing? |
Alenka Frim / @AlenkaF: It is failing with Python 3.8 and 3.9. I haven't tried with version 3.10 locally but can do so later today. Could the issue be that Arrow DLLs and Arrow Python (PyArrow C++) DLL are in a different location?
|
Yes, it sounds like the new location of the Arrow Python DLL is not taken into account (curious that it's still found with the ENABLE-stuff). In any case, from the POV of conda-forge (i.e. when we get around to packaging the next released version), this would probably get installed somewhere in |
Joris Van den Bossche / @jorisvandenbossche: And for inplace builds, the libarrow_python.dll now no longer lives in the conda env prefix (where Arrow C++ build artifacts end up), but inside the arrow/python/pyarrow directory. See https://github.com/conda-forge/python-feedstock/pull/481/files#diff-f43d77242cb37d5edf48db1155b6a2ef37972c418918229ea1d00a56c2b961ee for more details (the {{Add-CondaEcosystemModifyDllSearchPath.patch} file) and the comment at conda-forge/python-feedstock#481 (comment) for some additional context and discussion. Isuru indeed changed this for Python 3.10 (as far as I understand, this env variable should no longer be set by default starting with Python 3.10, but if it's the default for 3.8/3.9, I don't really understand why we have to set it explicitly here ...). |
Joris Van den Bossche / @jorisvandenbossche:
|
Alenka Frim / @AlenkaF:
|
Joris Van den Bossche / @jorisvandenbossche: |
It seems that after the Python refactoring PR #13311 (ARROW-16340) Python is unable to find
arrow_python
even though the library it is imported into the correct directory.Currently this issue is fixed with setting an additional environment variable:
We need to investigate further why this error is happening after the refactoring and make sure Python is able to find the libraries on Windows without the additional env vars being specified.
Reporter: Alenka Frim / @AlenkaF
Assignee: Alenka Frim / @AlenkaF
Related issues:
PRs and other links:
Note: This issue was originally created as ARROW-17771. Please see the migration documentation for further details.
The text was updated successfully, but these errors were encountered: