`os.add_dll_directory` "The filename or extension is too long"

[sgbaird]

Steps to reproduce the problem.

pip install vickers_hardness # depends on `shapely` via `uncertainty_toolbox`

from vickers_hardness.vickers_hardness_ import VickersHardness

> [WinError 206] The filename or extension is too long: 'C:\\Users\\sterg\\Miniconda3\\envs\\crabnet\\lib\\site-packages\\Shapely.libs'
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\os.py]()", line 1105, in add_dll_directory
>     cookie = nt._add_dll_directory(path)
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\site-packages\shapely\__init__.py]()", line 14, in _delvewheel_init_patch_0_0_18
>     os.add_dll_directory(libs_dir)
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\site-packages\shapely\__init__.py]()", line 30, in <module>
>     _delvewheel_init_patch_0_0_18()
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\site-packages\uncertainty_toolbox\metrics_calibration.py]()", line 10, in <module>
>     from shapely.geometry import Polygon, LineString
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\site-packages\uncertainty_toolbox\metrics.py]()", line 9, in <module>
>     from uncertainty_toolbox.metrics_calibration import (
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\site-packages\uncertainty_toolbox\__init__.py]()", line 9, in <module>
>     from .metrics import (
>   File "[C:\Users\sterg\miniconda3\envs\crabnet\Lib\site-packages\vickers_hardness\vickers_hardness_.py]()", line 12, in <module>
>     import uncertainty_toolbox as uct
>   File "[C:\Users\sterg\Documents\GitHub\sparks-baird\CrabNet\crabnet\examples\extend_features_compare.py]()", line 24, in <module>
>     from vickers_hardness.vickers_hardness_ import VickersHardness

Operating system

Windows 11 Home (21H2)

Shapely version and provenance

Shapely==1.8.1.post1

Other

Related: https://stackoverflow.com/questions/10724642/windowserror-error-206-the-filename-or-extension-is-too-long-after-running

Pretty sure I have long paths enabled in Windows, and the path it mentioned doesn't seem that long.

[mwtoews]

What version of Python? Was shapely installed via pip (via dependency), or was it installed in the miniconda environment?

[sgbaird]

@mwtoews 3.9.7 I believe, and installed via pip inside of a miniconda environment

[sgbaird]

@mwtoews sorry, realized I didn't actually answer your second question. shapely was installed via a pip dependency.

Note how uncertainty_toolbox is commented out: https://github.com/sparks-baird/VickersHardnessPrediction/blob/master/requirements.txt

uncertainty_toolbox depends on shapely via: https://github.com/uncertainty-toolbox/uncertainty-toolbox/blob/master/requirements/requirements.txt

For convenience, the line from uncertainty_toolbox requirements.txt is:

shapely>=1.6.4.post2

I'm now at the point where I want to incorporate a number of uncertainty_toolbox features, rather than just one equation that was easy to isolate and extract. So this makes it a bit blocking for me.

[mwtoews]

I'm unable to reproduce this issue on Windows 10, using Python 3.9 from a Visual Studio installer, and also using a hybrid miniforge/pip method. Note that if you are using a conda-style environment, try installing shapely using (e.g.) conda install shapely. You may need to (e.g.) pip uninstall shapely before. Mixing conda and pip packages with binary wheels might have unexpected things.

[spursbob]

Stumbled upon this reported issue after a quick Google search when someone else mentioned the same error to me for something completely unrelated to shapely.

I reproduced the error by running the following:

import os
for _ in range(50000):
    print(_)
    os.add_dll_directory("c:\\temp")

It errored out after row 4095. "c:\temp" is 8 characters. Times that by 4095. 32,760 is just about to hit the Windows max environment variable length. I would speculate, given your path length, your import has executed over 190 times in a single Python session.