Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Let conda and pipenv be friends for geospatial packages #6

Merged
merged 4 commits into from
Dec 25, 2019

Conversation

weiji14
Copy link
Owner

@weiji14 weiji14 commented Oct 22, 2019

Improving conda and pipenv interoperability! Necessary for those hard to install geospatial packages like cartopy, and cuspatial (only available through conda).

In other words, running conda list should show pipenv installed packages, and running pip list should show Python packages installed by conda. This is possible with conda versions > 4.6 (conda/conda#7053) and pipenv since 2018 (pypa/pipenv#1469).

References:

TODO:

  • Let conda see pip packages (5bb5b23)
  • Let pipenv use conda site-packages (2b234ac)
  • Add geospatial packages:

Note to future self, may want to consider refactoring Dockerfile to be more space efficient through some ingenious use of the cache/multi-build stages.

@weiji14 weiji14 added the docker 🐳 Pull requests that update Docker code label Oct 22, 2019
@weiji14 weiji14 self-assigned this Oct 22, 2019
@ghost
Copy link

ghost commented Oct 22, 2019

DeepCode's analysis on #58fdcd found:

  • 0 critical issues. ⚠️ 0 warnings and 0 minor issues. ✔️ 0 issues were fixed.

💬 This comment has been generated by the DeepCode bot, installed by the owner of the repository. The DeepCode bot protects your repository by detecting and commenting on security vulnerabilities or other critical issues.


☺️ If you want to provide feedback on our bot, here is how to contact us.

Geographic visualizations for HoloViews! Repository at https://github.com/pyviz/geoviews. Note that we're installing some sub-dependencies from conda instead of pipenv here, and thereby compromising some hash-based reproducibility offered by the Pipfile.lock file because of the reason below.

Cartopy which geoviews depends on is a real pain to install via pipenv (trust me, I tried, see also SciTools/cartopy#738), so we'll maybe wait for 0.18.0 to come out and see if it gets fixed then, sigh. The problem I think, lies with Cartopy, Shapely and PyProj all having to link themselves to the PROJ and GEOS library somehow. At a minimum, it seems that installing just Shapely and PROJ using conda works, while we use pipenv to get the latest Cartopy from github alongside it's dependencies cython, pyepsg and pyproj (see SciTools/cartopy#738).
@weiji14 weiji14 changed the title Let conda and pipenv be friends Let conda and pipenv be friends for geoviews Oct 22, 2019
@weiji14 weiji14 added the dependencies Pull requests that update a dependency file label Oct 22, 2019
@weiji14 weiji14 changed the title Let conda and pipenv be friends for geoviews Let conda and pipenv be friends for geospatial packages Dec 25, 2019
CUDA-accelerated GIS and spatiotemporal algorithms! Also need to update proj from 6.2.0 to 6.2.1 to resolve dependency problems faced in https://github.com/weiji14/deepicedrain/runs/363415413.
weiji14 added a commit that referenced this pull request Dec 25, 2019
Closes #6 Let conda and pipenv be friends for geospatial packages.
@weiji14 weiji14 merged commit 58fdcdf into data/intake Dec 25, 2019
@weiji14 weiji14 deleted the conda_pip_interop branch December 25, 2019 22:47
weiji14 added a commit that referenced this pull request Dec 25, 2019
Closes #6 Let conda and pipenv be friends for geospatial packages.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file docker 🐳 Pull requests that update Docker code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant