Running "python -m pip check" in every Python package

[xhochy]

Now that we have automerge support and that the newer pip versions support pip check to check for a consistent environment, should we add this as a test to all Python packages?

I have added it to some packages and I see it failing quite often as downstream miss dependency updates when they do version updates.

Todos:

• write a migrator (ENH pip check migration regro/cf-scripts#787)
• write a check for the linter
• add test to skeleton
• add test to the default example recipe

[jakirkham]

@CJ-Wright @beckermr, what do you think?

Is there a way to automatically add this to recipes?

[ocefpaf]

Is there a way to automatically add this to recipes?

We need three things:

• a migrator for the existing recipes
• a lint check to ensure future recipes will have it
• a default test added in the skeleton (ping @marcelotrevisani)

[marcelotrevisani]

Now that we have automerge support and that the newer pip versions support pip check to check for a consistent environment, should we add this as a test to all Python packages?

I have added it to some packages and I see it failing quite often as downstream miss dependency updates when they do version updates.

Do you know since which version pip has this feature?

[xhochy]

One of the example where this recently popped up: conda-forge/watchdog-feedstock#14 (it broke conda-forge/dagster-feedstock#8)

[xhochy]

Now that we have automerge support and that the newer pip versions support pip check to check for a consistent environment, should we add this as a test to all Python packages?
I have added it to some packages and I see it failing quite often as downstream miss dependency updates when they do version updates.

Do you know since which version pip has this feature?

It was added in pip=9 https://pip.pypa.io/en/stable/news/#id286

[CJ-Wright]

I would structure this as a mini migratior so it can run piggy back on the main migratiors.

[scopatz]

This would be great to have, but only for packages that use pip

[xhochy]

This would be great to have, but only for packages that use pip

This check is also working for Python packages that are installed without pip. This checks the general Python environment for consistency on their declared dependencies, independent of their installer.

[scopatz]

@xhochy - I guess I am ignorant here, then. How does it work?

[xhochy]

It retrieves the current working_set from https://setuptools.readthedocs.io/en/latest/pkg_resources.html#workingset-objects and checks it for consistency. AFAIK this based on information in $CONDA_PREFIX/lib/pythonX.X/site-packages/*.dist-info/METADATA.

[djsutherland]

Related: regro/cf-scripts#519

[beckermr]

Alright, we have a piggybakc migrator going for this. It will slowly creep into the feedstocks.