pip debug: Add versions of vendored libraries to output

[NoahGorny]

Resolves #7794

@pradyunsg you can take a look :)

[xavfernandez]

@NoahGorny thanks for taking a look.

The goal is however not to print the values of vendor.txt but in the case of an unbundled pip to quickly find faulty versions (so including vendor.txt to compare the expected version vs installed version is still useful).

I think you should start by printing

pip/src/pip/_vendor/__init__.py

Line 17 in f6b5b40

DEBUNDLED = False

And something like:

+    print('Pip dependencies versions')
+    for module_name in (
+        "appdirs",
+        "cachecontrol",
+        "colorama",
+        "contextlib2",
+        "distlib",
+        "distro",
+        "html5lib",
+        "six",
+        "packaging",
+        "pep517",
+        "pkg_resources",
+        "progress",
+        "pytoml",
+        "retrying",
+        "requests",
+        "urllib3",
+    ):
+        __import__('pip._vendor.{}'.format(module_name), globals(), locals(), level=0)
+        module = getattr(_vendor, module_name)
+        print('   ', module_name, getattr(module, '__version__', 'undefined'))

(and devise a way to deal with libraries that do not include their versions)

Is it more clear ?

[NoahGorny]

I see, I'll work on it in the following days :)
Not sure what to do with unknown versions, but sure

[NoahGorny]

@xavfernandez I make some work, tell me what you think

• still need to add new tests for all cases (version mismatch, no version, etc...)
• currently if there is no version the command just cries (Unable to import actual module version, using vendor.txt specified version), not sure this is what you expect me to do in this situation

anyway, thanks alot for the feedback 😄

[xavfernandez]

not sure this is what you expect me to do in this situation

For debundled modules without __version__ attribute, I'd be tempted to check their module.__file__ attribute to find there location and their metadata:
Something like:

>>> pip._vendor.retrying.__file__
'/usr/lib/python3.8/site-packages/retrying.py'
>>> pkg_resources.WorkingSet([os.path.dirname(pip._vendor.retrying.__file__)]).find(pkg_resources.Requirement('retrying')).version
'1.3.3'

[NoahGorny]

what do think about this now @xavfernandez? I also added a simple test

[NoahGorny]

seems like os.path.dirname(getattr(module, '__file__')) is failing windows tests for some reason
I have no idea why though @xavfernandez

[NoahGorny]

@xavfernandez any updates? I think its pretty ready

[xavfernandez]

This is not far from ready and this would be nice to have in 20.1 :) cc @pradyunsg

[xavfernandez]

A with indent_log(): would be prettier IMHO:

vendored library versions:
  appdirs==1.4.3
  CacheControl==0.12.6
 ...

vs

vendored library versions:
appdirs==1.4.3
CacheControl==0.12.6

[NoahGorny]

I see, updated the code to include it- nice idea!

[xavfernandez]

One final nit, otherwise it looks ready 👍

[xavfernandez]

Thanks for your work @NoahGorny 👍

[NoahGorny]

Happy to help 😄
Thank you so much for your valuable feedback (s)!

[pradyunsg]

Thanks for the PR @NoahGorny! ^>^