Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Newer versions (> 1.2.0) do not work with Intel OpenMP installed #230

Closed
DManowitz opened this issue Nov 16, 2022 · 15 comments
Closed

Newer versions (> 1.2.0) do not work with Intel OpenMP installed #230

DManowitz opened this issue Nov 16, 2022 · 15 comments
Assignees
Labels
bug Something isn't working

Comments

@DManowitz
Copy link

On conda-forge, I see that all versions of geowombat > 1.2.0 require llvm-openmp. This causes a problem if intel-openmp is installed in an environment. Would it be possible to make versions of geowombat (since at least 2.0.3, since I'm stuck at gdal 3.5.0) that either don't require llvm-openmp or use intel-openmp instead?

@jgrss
Copy link
Owner

jgrss commented Nov 23, 2022

Thanks for raising this @DManowitz. Is this issue related to what you are seeing?

Any thoughts @mmann1123?

@DManowitz
Copy link
Author

DManowitz commented Nov 23, 2022

That other issue is a similar issue on MacOS. I'm on Windows, and there, llvm-openmp installs Library/bin/libiomp5md.dll, which completely clobbers the version of the file installed by intel-openmp (see this issue)

Also, I installed another package which required me to downgrade gdal to 3.4.3, so if you make this change as far back as 1.8.6, I'd appreciate it.

@mmann1123
Copy link
Collaborator

This is getting over my head. But I did find this discussion. There might be some argument for switching to the intel build for integration with pytorch

conda-forge/conda-forge.github.io#1597

@DManowitz
Copy link
Author

DManowitz commented Dec 7, 2022

How is OpenMP used in geowombat? I performed a test where I first installed geowombat over pytorch. I then got an error when I tried to import pytorch. However, I then force-removed both llvm-openmp and intel-openmp, and then reinstalled llvm-openmp first, followed by intel-openmp (so the conflicting file from intel-openmp would clobber the file from llvm-openmp), and I was able to get both pytorch and geowombat (and all of geowombat's top-level files) to import without errors.

@mmann1123
Copy link
Collaborator

Outside of pytorch it is only used to run resize in the radiometry module. If pytorch is moving to intel-openmp, I can't see a strong argument against using it instead of llvm. I defer to @jgrss, who may be in the throws of an intercontinental move.

@jgrss
Copy link
Owner

jgrss commented Dec 14, 2022

We should be able to remove OpenCV usage (can replace with numpy/scipy) from geowombat and get rid of the OpenMP dependency.

@jgrss jgrss added the bug Something isn't working label Dec 14, 2022
@jgrss jgrss mentioned this issue Dec 16, 2022
1 task
@jgrss
Copy link
Owner

jgrss commented Dec 16, 2022

@mmann1123 Can you remove OpenMP from the Conda install if you use #232?

@mmann1123
Copy link
Collaborator

@jgrss yes I will. Flying solo with sick kids. I'll put it in my list.

@mmann1123
Copy link
Collaborator

Conda is balking. Looks like you have a reference to opencv in the setup.cfg. I think it building some requirements from there?

setup.cfg opencv-python>=4.6.*

@jgrss
Copy link
Owner

jgrss commented Dec 19, 2022

I am not seeing OpenCV in the setup.cfg. However, I forgot to remove a reference to an OpenCV import in the surface reflectance module. Tests are re-running over at #232 on branch jgrss/openmp

@mmann1123
Copy link
Collaborator

Its under install_requires = as opencv-python>=4.6.*

@jgrss
Copy link
Owner

jgrss commented Dec 19, 2022

It's on the main branch but not on jgrss/openmp.

@jgrss
Copy link
Owner

jgrss commented Dec 19, 2022

@mmann1123 release v2.0.18 is available to test.

@mmann1123
Copy link
Collaborator

Ok this should be resolved. Just merged an update to the conda-forge feedstock. All tests passing. @jgrss @DManowitz

@jgrss
Copy link
Owner

jgrss commented Jan 31, 2023

I am going to close this, but feel free to reopen, @DManowitz, if the issue persists.

@jgrss jgrss closed this as completed Jan 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants