ESMValTool environment is incompatible with iris >= 3.3.0

[schlunma]

I noticed that our current ESMValTool environment still contains iris=3.2.1, even though v3.3.0 is available since September (tested locally and on GitHub Actions).

Pinning iris>=3.3.0 in the environment.yml file gives the following error during installation:

> mamba env update -n esm -f environment.yml
conda-forge/linux-64                                        Using cache
conda-forge/noarch                                          Using cache


Looking for: ['pip!=21.3', "python[version='>=3.8']", 'cartopy', "cdo[version='>=1.9.7']", 'cdsapi', 'cf-units', 'cftime', 'cmocean', 'cython', 'dask', 'ecmwf-api-client', 'eofs', 'esmpy', 'esmvalcore=2.7', 'fiona', 'fire', 'gdal', "iris[version='>=3.3.0']", 'iris-esmf-regrid', 'jinja2', 'joblib', 'lime', "mapgenerator[version='>=1.0.5']", "matplotlib-base[version='<3.6.0']", 'natsort', 'nc-time-axis', 'netcdf4', 'numpy', 'openpyxl', 'pandas', 'progressbar2', 'prov', 'psyplot', 'psy-maps', 'psy-reg', 'psy-simple', "pyproj[version='>=2.1']", 'python-cdo', 'python-dateutil', 'pyyaml', 'rasterio', 'requests', 'ruamel.yaml', 'scikit-image', 'scikit-learn', 'scipy', 'seaborn', 'seawater', 'shapely', "xarray[version='>=0.12.0']", 'xesmf==0.3.0', "xgboost[version='>1.6.1']", 'xlsxwriter', 'flake8', "pytest[version='>=3.9,!=6.0.0rc1,!=6.0.0']", 'pytest-cov', 'pytest-env', 'pytest-html!=2.1.0', "pytest-metadata[version='>=1.5.1']", 'pytest-xdist', "autodocsumm[version='>=0.2.2']", "sphinx[version='>=5']", 'sphinx_rtd_theme', 'codespell', 'docformatter', 'isort', 'pre-commit', 'prospector', 'pyroma', 'yamllint', 'yapf', 'ncl', 'cdo', 'imagemagick', 'nco', 'cdo', "r-base[version='>=3.5']", 'r-abind', "r-akima[version='<=0.6-2.3']", 'r-climdex.pcic', 'r-climprojdiags', 'r-docopt', 'r-dotcall64', 'r-functional', 'r-ggplot2', 'r-gridextra', 'r-lintr', 'r-logging', 'r-mapproj', 'r-maps', 'r-multiapply', 'r-ncdf4', 'r-ncdf4.helpers', 'r-pcict', 'r-plyr', 'r-rcolorbrewer', 'r-rcpp', 'r-s2dverification', 'r-snow', 'r-spei', 'r-styler', 'r-udunits2', 'r-yaml', 'r-git2r', 'r-lintr', 'r-styler', 'julia']


Could not solve for environment specs
Encountered problems while solving:
  - package iris-3.3.1-pyhd8ed1ab_0 requires cf-units >=3.1, but none of the providers can be installed

The environment can't be solved, aborting the operation

Since there are many cf-units version >=3.1, I guess the error is misleading here and the problem comes from another package conflict.

I tried the same with updating ESMValCore's environment, in this case iris=3.3.1 was loaded.

[valeriupredoi]

For reference, we are working on a bugfix release for esmvalcore=2.7.1 that will allow iris=3.4 in ESMValGroup/ESMValCore#1848 - we've got a couple roadblocks at the moment, but am sure we can fix that asap 🍺

[valeriupredoi]

we have now released esmvalcore=2.7.1 that takes in iris=3.4.0 so this should be fixed, I'll close it when I am assured the installation from the CI picks up the new version and there are no issues with it 👍

[valeriupredoi]

this has been solved with the new bugfix release v2.7.1 of esmvalcore, see the development install test - mind you, that particular one fails due to an issue with shapely, which is documented in #2965 - the conda package is still using the older iris due to the pin on cf-units though, but we can open a new issue for that 👍

[schlunma]

Thanks @valeriupredoi and @bouweandela for all your work on this release!! That's awesome, with this I can finally finish ESMValGroup/ESMValCore#1664 in January 🥳

[valeriupredoi]

our pleasure, Manu! Enjoy AGU and happy holidays, bud 🎄

[schlunma]

Thanks, happy holidays 🥳