New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add missing packages to Pangeo workspace #729
Comments
geopandas
to Pangeo workspace
@wildintellect If there are other packages we are missing, please document them here and we'll get them integrated as part of this ticket. |
Below is a list of other python packages that are part of the boreal biomass geoprocessing workflow that we've prototyped on MAAP. I would think that these should be part of the Pangeo env by default, since they could get use across many MAAP projects. These are derived from: which provides the packages that run our DPS jobs and our notebooks up until this point. Note: it is not clear to me whether the specific package versions listed in that yaml are required. For example, that latest version of Geopandas should probably be deployed on Pangeo (unless @wildintellect indicates otherwise) |
I think these packages will require careful install and testing due to sensitive dependencies: For example, when i ran this: I saw this: This issue, for use, is the highest priority - because we cannot assess our DPS results that we need to complete in July 2023 without it. One test (from my workspace) could look like this: |
@pahbs let me look into the |
@anilnatha can you dump a list of packages to compare against https://github.com/pangeo-data/pangeo-docker-images/blob/master/pangeo-notebook/environment.yml |
@wildintellect Can you clarify the source of what I should dump from? Is it the pangeo workspace so that we can glean insights of all the dependencies that are installed using its respective environment.yml? |
@anilnatha if you dump the MAAP Pangeo package list you can diff it against the Pangeo official environment.yml to see what is not currently included. |
For comparison, the VEDA lockfile of their Pangeo instances https://github.com/pangeo-data/pangeo-docker-images/blob/master/pangeo-notebook/conda-linux-64.lock |
@wildintellect Our current pangeo package list is here.
@pahbs Are there any key packages from this list that you think we should add to the MAAP pangeo environment.yml in our next release? |
@grallewellyn is there a reason we can't add all of them? we are trying to reach parity with Pangeo-notebook images so they are interchangeable (VEDA uses Pangeo-notebook) |
Yes, I made a ticket to add all packages from the diff list I sent above |
While discussing missing packages with @wildintellect , he shared that
geopandas
is missing and that we should start with adding this to our Pangeo workspace where we recently adding other packages that were missing.If all works well, we will later add it, and the other missing packages that were added to Pangeo, to our other workspaces.
NOTE (2023-12-4): Updated link to package reconciliation list.
The text was updated successfully, but these errors were encountered: