Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ls fails with ResourceError: Failed to import resource: No module named ssl_match_hostname [ssladapter.py:<module>:21] #343

Open
yarikoptic opened this issue Jan 2, 2019 · 5 comments

Comments

@yarikoptic
Copy link
Member

smells like some incomplete versioned dependency within fabric/paramiko but yet to figure it out

$> pip install -e .                                         
Obtaining file:///home/yoh/proj/repronim/niceman
Requirement already satisfied: appdirs in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: attrs>=16.3.0 in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: humanize in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: mock in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: pyyaml in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: six>=1.9 in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: tqdm in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: fabric>=2.3.1 in ./venvs/dev/lib/python2.7/site-packages (from niceman==0.1.0)
Requirement already satisfied: cryptography>=1.5 in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: pytz in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: scp in ./venvs/dev/lib/python2.7/site-packages (from niceman==0.1.0)
Requirement already satisfied: pycrypto in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: pyOpenSSL==16.2.0 in ./venvs/dev/lib/python2.7/site-packages (from niceman==0.1.0)
Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (from niceman==0.1.0)
Requirement already satisfied: rpaths in ./venvs/dev/lib/python2.7/site-packages (from niceman==0.1.0)
Requirement already satisfied: reprozip in /home/yoh/proj/repronim/reprozip/reprozip (from niceman==0.1.0)
Requirement already satisfied: paramiko>=2.4 in /home/yoh/proj/misc/paramiko (from fabric>=2.3.1->niceman==0.1.0)
Requirement already satisfied: invoke<2.0,>=1.1 in ./venvs/dev/lib/python2.7/site-packages (from fabric>=2.3.1->niceman==0.1.0)
Requirement already satisfied: usagestats>=0.3 in /usr/lib/python2.7/dist-packages (from reprozip->niceman==0.1.0)
Requirement already satisfied: distro in /usr/lib/python2.7/dist-packages (from reprozip->niceman==0.1.0)
Requirement already satisfied: bcrypt>=3.1.3 in /usr/lib/python2.7/dist-packages (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0)
Requirement already satisfied: pynacl>=1.0.1 in /usr/lib/python2.7/dist-packages (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0)
Installing collected packages: niceman
  Found existing installation: niceman 0.1.0
    Uninstalling niceman-0.1.0:
      Successfully uninstalled niceman-0.1.0
  Running setup.py develop for niceman
Successfully installed niceman
(dev) 1 10374.....................................:Wed 02 Jan 2019 01:09:24 PM EST:.
(git)hopa:~/proj/repronim/niceman[master]git
$> niceman --dbg ls --refresh
RESOURCE NAME        TYPE                 ID                  STATUS    
-------------        ----                 --                  ------    
Traceback (most recent call last):
  File "/home/yoh/proj/repronim/niceman/venvs/dev/bin/niceman", line 11, in <module>
    load_entry_point('niceman', 'console_scripts', 'niceman')()
  File "/home/yoh/proj/repronim/niceman/niceman/cmdline/main.py", line 251, in main
    ret = cmdlineargs.func(cmdlineargs)
  File "/home/yoh/proj/repronim/niceman/niceman/interface/base.py", line 288, in call_from_parser
    return cls.__call__(**kwargs)
  File "/home/yoh/proj/repronim/niceman/niceman/interface/ls.py", line 69, in __call__
    resource = manager.get_resource(name, resref_type="name")
  File "/home/yoh/proj/repronim/niceman/niceman/resource/base.py", line 239, in get_resource
    return self.factory(self._get_resource_config(resref, resref_type))
  File "/home/yoh/proj/repronim/niceman/niceman/resource/base.py", line 149, in factory
    "Failed to import resource: {}".format(msg)
ResourceError: Failed to import resource: No module named ssl_match_hostname [ssladapter.py:<module>:21]
()
> /home/yoh/proj/repronim/niceman/niceman/resource/base.py(149)factory()
-> "Failed to import resource: {}".format(msg)
(Pdb) import fabric
(Pdb) print fabric.__version__
2.3.1
(Pdb) 

this is python2

@kyleam
Copy link
Contributor

kyleam commented Jan 2, 2019

That doesn't look like a fabric-related issue. The ssladapter module is from docker-py. Your instalation command doesn't seem to include the docker dependencies, so I'd guess it is taking dockerpy from your system site packages. What version of docker-py do you have there?

Not really related to the case you report, since it appears to be leakage into the virtual environment from your system, but I think we should make the docker-py requirement >=1.8.1 to get docker-py's 9da5493 (Use backports.ssl_match_hostname, 2016-04-08).

@yarikoptic
Copy link
Member Author

FWIW, tried in an "isolated" (no system site packages) virtualenv with the same effect

full protocol
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> virtualenv  venvs/dev-isolated 
Running virtualenv with interpreter /usr/bin/python2
New python executable in /home/yoh/proj/repronim/niceman/venvs/dev-isolated/bin/python2
Also creating executable in /home/yoh/proj/repronim/niceman/venvs/dev-isolated/bin/python
Installing setuptools, pkg_resources, pip, wheel...done.
1 12231.....................................:Mon 07 Jan 2019 11:50:26 AM EST:.
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> source venvs/dev-isolated/bin/activate
(dev-isolated) 1 12232.....................................:Mon 07 Jan 2019 11:50:30 AM EST:.
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> rehash
(dev-isolated) 1 12233.....................................:Mon 07 Jan 2019 11:50:32 AM EST:.
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> pip install -e .
Obtaining file:///home/yoh/proj/repronim/niceman
Collecting appdirs (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/56/eb/810e700ed1349edde4cbdc1b2a21e28cdf115f9faf263f6bbf8447c1abf3/appdirs-1.4.3-py2.py3-none-any.whl
Collecting attrs>=16.3.0 (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/3a/e1/5f9023cc983f1a628a8c2fd051ad19e76ff7b142a0faf329336f9a62a514/attrs-18.2.0-py2.py3-none-any.whl
Collecting humanize (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting mock (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl (56kB)
    100% |████████████████████████████████| 61kB 5.0MB/s 
Collecting pyyaml (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting six>=1.9 (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting tqdm (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/d1/f9/8cbd36ef8bf84c5281e4943eaa12fe34850a0e8204e44872d8ca0c0ec741/tqdm-4.29.0-py2.py3-none-any.whl (46kB)
    100% |████████████████████████████████| 51kB 11.8MB/s 
Collecting fabric>=2.3.1 (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/d9/e4/e6fa248c94ee5d45def54b609fcf70f39d0b7f7050f2d4405c5f156b5516/fabric-2.4.0-py2.py3-none-any.whl
Collecting cryptography>=1.5 (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/7f/ba/383b51cc26e3141c689ce988814385c7659f5ba01c4b5f2de38233010b5f/cryptography-2.4.2-cp27-cp27mu-manylinux1_x86_64.whl (2.1MB)
    100% |████████████████████████████████| 2.1MB 657kB/s 
Collecting pytz (from niceman==0.1.0)
  Downloading https://files.pythonhosted.org/packages/61/28/1d3920e4d1d50b19bc5d24398a7cd85cc7b9a75a490570d5a30c57622d34/pytz-2018.9-py2.py3-none-any.whl (510kB)
    100% |████████████████████████████████| 512kB 2.8MB/s 
Collecting scp (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/50/26/bbcf64af02ae5cdde70f10fcac1b955ed6aece5de459c43feeee4d417f20/scp-0.13.0-py2.py3-none-any.whl
Collecting pycrypto (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting pyOpenSSL==16.2.0 (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/ac/93/b4cd538d31adacd07f83013860db6b88d78755af1f3fefe68ec22d397e7b/pyOpenSSL-16.2.0-py2.py3-none-any.whl
Collecting requests (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl
Collecting rpaths (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/3b/fb/a0ebfe0091df57e66d4b4f28ef8c433b038104a16e51cc862f1d891387fc/rpaths-0.13-py2.py3-none-any.whl
Collecting jinja2 (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/7f/ff/ae64bacdfc95f27a016a7bed8e8686763ba4d277a78ca76f32659220a731/Jinja2-2.10-py2.py3-none-any.whl
Collecting reprozip (from niceman==0.1.0)
Collecting funcsigs>=1; python_version < "3.3" (from mock->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/f3/04/fddc1c2dd75b256eda4d360024692231a2c19a0c61ad7f4a162407c1ab58/pbr-5.1.1-py2.py3-none-any.whl (106kB)
    100% |████████████████████████████████| 112kB 6.3MB/s 
Collecting paramiko>=2.4 (from fabric>=2.3.1->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/cf/ae/94e70d49044ccc234bfdba20114fa947d7ba6eb68a2e452d89b920e62227/paramiko-2.4.2-py2.py3-none-any.whl (193kB)
    100% |████████████████████████████████| 194kB 4.7MB/s 
Collecting invoke<2.0,>=1.1 (from fabric>=2.3.1->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/a6/32/6ed0bace971c5310d923e7c4abf475451ef20fa22c458138dd1aad664044/invoke-1.2.0-py2-none-any.whl
Collecting cffi!=1.11.3,>=1.7 (from cryptography>=1.5->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/14/dd/3e7a1e1280e7d767bd3fa15791759c91ec19058ebe31217fe66f3e9a8c49/cffi-1.11.5-cp27-cp27mu-manylinux1_x86_64.whl (407kB)
    100% |████████████████████████████████| 409kB 3.1MB/s 
Collecting asn1crypto>=0.21.0 (from cryptography>=1.5->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/ea/cd/35485615f45f30a510576f1a56d1e0a7ad7bd8ab5ed7cdc600ef7cd06222/asn1crypto-0.24.0-py2.py3-none-any.whl (101kB)
    100% |████████████████████████████████| 102kB 6.7MB/s 
Collecting enum34; python_version < "3" (from cryptography>=1.5->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting idna>=2.1 (from cryptography>=1.5->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting ipaddress; python_version < "3" (from cryptography>=1.5->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/fc/d0/7fc3a811e011d4b388be48a0e381db8d990042df54aa4ef4599a31d39853/ipaddress-1.0.22-py2.py3-none-any.whl
Collecting urllib3<1.25,>=1.21.1 (from requests->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl
Collecting MarkupSafe>=0.23 (from jinja2->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/bc/3a/6bfd7b4b202fa33bdda8e4e3d3acc719f381fd730f9a0e7c5f34e845bd4d/MarkupSafe-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl
Collecting usagestats>=0.3 (from reprozip->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/82/85/1093d0e40ae247808079f13fd5d3df2316706f7d35245d8d8978bf35f28b/usagestats-0.7-py2.py3-none-any.whl
Collecting pynacl>=1.0.1 (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/b3/25/e605574f24948a8a53b497744e93f061eb1dbe7c44b6465fc1c172d591aa/PyNaCl-1.3.0-cp27-cp27mu-manylinux1_x86_64.whl (762kB)
    100% |████████████████████████████████| 768kB 1.8MB/s 
Collecting pyasn1>=0.1.7 (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl (73kB)
    100% |████████████████████████████████| 81kB 9.0MB/s 
Collecting bcrypt>=3.1.3 (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/94/1d/e0caa84ed34524ecf85a86f33ae7588da6b5877ee9e7c279113e29e29b1d/bcrypt-3.1.5-cp27-cp27mu-manylinux1_x86_64.whl (59kB)
    100% |████████████████████████████████| 61kB 9.5MB/s 
Collecting pycparser (from cffi!=1.11.3,>=1.7->cryptography>=1.5->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Installing collected packages: appdirs, attrs, humanize, funcsigs, six, pbr, mock, pyyaml, tqdm, pycparser, cffi, asn1crypto, enum34, idna, ipaddress, cryptography, pynacl, pyasn1, bcrypt, paramiko, invoke, fabric, pytz, scp, pycrypto, pyOpenSSL, urllib3, chardet, certifi, requests, rpaths, MarkupSafe, jinja2, usagestats, reprozip, niceman
  Running setup.py develop for niceman
Successfully installed MarkupSafe-1.1.0 appdirs-1.4.3 asn1crypto-0.24.0 attrs-18.2.0 bcrypt-3.1.5 certifi-2018.11.29 cffi-1.11.5 chardet-3.0.4 cryptography-2.4.2 enum34-1.1.6 fabric-2.4.0 funcsigs-1.0.2 humanize-0.5.1 idna-2.8 invoke-1.2.0 ipaddress-1.0.22 jinja2-2.10 mock-2.0.0 niceman paramiko-2.4.2 pbr-5.1.1 pyOpenSSL-16.2.0 pyasn1-0.4.5 pycparser-2.19 pycrypto-2.6.1 pynacl-1.3.0 pytz-2018.9 pyyaml-3.13 reprozip-1.0.14 requests-2.21.0 rpaths-0.13 scp-0.13.0 six-1.12.0 tqdm-4.29.0 urllib3-1.24.1 usagestats-0.7
pip install -e .  5.13s user 0.77s system 80% cpu 7.348 total
(dev-isolated) 1 12234.....................................:Mon 07 Jan 2019 11:50:43 AM EST:.
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> niceman ls                             
RESOURCE NAME        TYPE                 ID                  STATUS    
-------------        ----                 --                  ------    
2019-01-07 11:50:52,421 [ERROR  ] Failed to import resource: No module named docker [docker_container.py:<module>:12] [base.py:factory:149] (ResourceError) 
(dev-isolated) 1 12235 ->1.....................................:Mon 07 Jan 2019 11:50:52 AM EST:.
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> which niceman
/home/yoh/proj/repronim/niceman/venvs/dev-isolated/bin/niceman

@yarikoptic
Copy link
Member Author

ha ha - it needed .[full] installation. Here I also have --upgrade flag but first I did it (not shown here). So it is a matter of a bit too loose dependencies specification (possibly in docker-py as @kyleam suggsted):

log
$> pip install -e '.[full]' --upgrade 
Obtaining file:///home/yoh/proj/repronim/niceman
Requirement already satisfied, skipping upgrade: appdirs in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (1.4.3)
Requirement already satisfied, skipping upgrade: attrs>=16.3.0 in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (18.2.0)
Requirement already satisfied, skipping upgrade: humanize in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (0.5.1)
Requirement already satisfied, skipping upgrade: mock in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2.0.0)
Requirement already satisfied, skipping upgrade: pyyaml in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (3.13)
Requirement already satisfied, skipping upgrade: six>=1.9 in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (1.12.0)
Requirement already satisfied, skipping upgrade: tqdm in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (4.29.0)
Requirement already satisfied, skipping upgrade: fabric>=2.3.1 in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2.4.0)
Requirement already satisfied, skipping upgrade: cryptography>=1.5 in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2.4.2)
Requirement already satisfied, skipping upgrade: pytz in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2018.9)
Requirement already satisfied, skipping upgrade: scp in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (0.13.0)
Requirement already satisfied, skipping upgrade: pycrypto in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2.6.1)
Requirement already satisfied, skipping upgrade: pyOpenSSL==16.2.0 in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (16.2.0)
Requirement already satisfied, skipping upgrade: requests in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2.21.0)
Requirement already satisfied, skipping upgrade: rpaths in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (0.13)
Requirement already satisfied, skipping upgrade: jinja2 in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (2.10)
Requirement already satisfied, skipping upgrade: reprozip in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (1.0.14)
Collecting pytest>=3.3.0 (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/95/6a/4122affe57eb3857874ef959a73f362e51b23812b96c92e073b16e1effd0/pytest-4.1.0-py2.py3-none-any.whl (215kB)
    100% |████████████████████████████████| 225kB 3.7MB/s 
Collecting boto3 (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/c4/d4/638389536f6d220b3932205298d0cbbc16a34a5aa3f9bf95e33fa0315423/boto3-1.9.74-py2.py3-none-any.whl (128kB)
    100% |████████████████████████████████| 133kB 5.4MB/s 
Collecting rdflib (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting docker-py>=0.3.2 (from niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/23/c7/1fd6d4d620809fe2f323869d719e2dd0086c939b67021303a9ec40f5a05b/docker_py-1.10.6-py2.py3-none-any.whl
Collecting dockerpty (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting python-debian (from niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/72/bf/3b9d427268e2195aa35b44e0550a385c07a217a75db3d05c1d4130a435bd/python_debian-0.1.33-py2-none-any.whl (64kB)
    100% |████████████████████████████████| 71kB 7.4MB/s 
Requirement already satisfied, skipping upgrade: chardet in ./venvs/dev-isolated/lib/python2.7/site-packages (from niceman==0.1.0) (3.0.4)
Requirement already satisfied, skipping upgrade: funcsigs>=1; python_version < "3.3" in ./venvs/dev-isolated/lib/python2.7/site-packages (from mock->niceman==0.1.0) (1.0.2)
Requirement already satisfied, skipping upgrade: pbr>=0.11 in ./venvs/dev-isolated/lib/python2.7/site-packages (from mock->niceman==0.1.0) (5.1.1)
Requirement already satisfied, skipping upgrade: paramiko>=2.4 in ./venvs/dev-isolated/lib/python2.7/site-packages (from fabric>=2.3.1->niceman==0.1.0) (2.4.2)
Requirement already satisfied, skipping upgrade: invoke<2.0,>=1.1 in ./venvs/dev-isolated/lib/python2.7/site-packages (from fabric>=2.3.1->niceman==0.1.0) (1.2.0)
Requirement already satisfied, skipping upgrade: cffi!=1.11.3,>=1.7 in ./venvs/dev-isolated/lib/python2.7/site-packages (from cryptography>=1.5->niceman==0.1.0) (1.11.5)
Requirement already satisfied, skipping upgrade: asn1crypto>=0.21.0 in ./venvs/dev-isolated/lib/python2.7/site-packages (from cryptography>=1.5->niceman==0.1.0) (0.24.0)
Requirement already satisfied, skipping upgrade: enum34; python_version < "3" in ./venvs/dev-isolated/lib/python2.7/site-packages (from cryptography>=1.5->niceman==0.1.0) (1.1.6)
Requirement already satisfied, skipping upgrade: idna>=2.1 in ./venvs/dev-isolated/lib/python2.7/site-packages (from cryptography>=1.5->niceman==0.1.0) (2.8)
Requirement already satisfied, skipping upgrade: ipaddress; python_version < "3" in ./venvs/dev-isolated/lib/python2.7/site-packages (from cryptography>=1.5->niceman==0.1.0) (1.0.22)
Requirement already satisfied, skipping upgrade: urllib3<1.25,>=1.21.1 in ./venvs/dev-isolated/lib/python2.7/site-packages (from requests->niceman==0.1.0) (1.24.1)
Requirement already satisfied, skipping upgrade: certifi>=2017.4.17 in ./venvs/dev-isolated/lib/python2.7/site-packages (from requests->niceman==0.1.0) (2018.11.29)
Requirement already satisfied, skipping upgrade: MarkupSafe>=0.23 in ./venvs/dev-isolated/lib/python2.7/site-packages (from jinja2->niceman==0.1.0) (1.1.0)
Requirement already satisfied, skipping upgrade: usagestats>=0.3 in ./venvs/dev-isolated/lib/python2.7/site-packages (from reprozip->niceman==0.1.0) (0.7)
Collecting atomicwrites>=1.0 (from pytest>=3.3.0->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/3a/9a/9d878f8d885706e2530402de6417141129a943802c084238914fa6798d97/atomicwrites-1.2.1-py2.py3-none-any.whl
Collecting pathlib2>=2.2.0; python_version < "3.6" (from pytest>=3.3.0->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/2a/46/c696dcf1c7aad917b39b875acdc5451975e3a9b4890dca8329983201c97a/pathlib2-2.3.3-py2.py3-none-any.whl
Requirement already satisfied, skipping upgrade: setuptools in ./venvs/dev-isolated/lib/python2.7/site-packages (from pytest>=3.3.0->niceman==0.1.0) (40.6.3)
Collecting py>=1.5.0 (from pytest>=3.3.0->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/3e/c7/3da685ef117d42ac8d71af525208759742dd235f8094221fdaafcd3dba8f/py-1.7.0-py2.py3-none-any.whl (83kB)
    100% |████████████████████████████████| 92kB 3.4MB/s 
Collecting pluggy>=0.7 (from pytest>=3.3.0->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/1c/e7/017c262070af41fe251401cb0d0e1b7c38f656da634cd0c15604f1f30864/pluggy-0.8.0-py2.py3-none-any.whl
Collecting more-itertools>=4.0.0 (from pytest>=3.3.0->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/2f/9d/dcfe59e213093695f108508af1214cf9cd95cc5489e46877ec5cb56369e5/more_itertools-5.0.0-py2-none-any.whl (52kB)
    100% |████████████████████████████████| 61kB 9.8MB/s 
Collecting jmespath<1.0.0,>=0.7.1 (from boto3->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/b7/31/05c8d001f7f87f0f07289a5fc0fc3832e9a57f2dbd4d3b0fee70e0d51365/jmespath-0.9.3-py2.py3-none-any.whl
Collecting botocore<1.13.0,>=1.12.74 (from boto3->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/4c/52/b5264c71ebfc037a1edb234beafc15f20c83cf53466fe094a77d34625008/botocore-1.12.74-py2.py3-none-any.whl (5.2MB)
    100% |████████████████████████████████| 5.2MB 282kB/s 
Collecting s3transfer<0.2.0,>=0.1.10 (from boto3->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/d7/14/2a0004d487464d120c9fb85313a75cd3d71a7506955be458eebfe19a6b1d/s3transfer-0.1.13-py2.py3-none-any.whl (59kB)
    100% |████████████████████████████████| 61kB 7.9MB/s 
Collecting pyparsing (from rdflib->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/71/e8/6777f6624681c8b9701a8a0a5654f3eb56919a01a78e12bf3c73f5a3c714/pyparsing-2.3.0-py2.py3-none-any.whl
Collecting isodate (from rdflib->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB)
    100% |████████████████████████████████| 51kB 6.0MB/s 
Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py>=0.3.2->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting websocket-client>=0.32.0 (from docker-py>=0.3.2->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/26/2d/f749a5c82f6192d77ed061a38e02001afcba55fe8477336d26a950ab17ce/websocket_client-0.54.0-py2.py3-none-any.whl (200kB)
    100% |████████████████████████████████| 204kB 5.2MB/s 
Collecting docker-pycreds>=0.2.1 (from docker-py>=0.3.2->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/f5/e8/f6bd1eee09314e7e6dee49cbe2c5e22314ccdb38db16c9fc72d2fa80d054/docker_pycreds-0.4.0-py2.py3-none-any.whl
Requirement already satisfied, skipping upgrade: pynacl>=1.0.1 in ./venvs/dev-isolated/lib/python2.7/site-packages (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0) (1.3.0)
Requirement already satisfied, skipping upgrade: pyasn1>=0.1.7 in ./venvs/dev-isolated/lib/python2.7/site-packages (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0) (0.4.5)
Requirement already satisfied, skipping upgrade: bcrypt>=3.1.3 in ./venvs/dev-isolated/lib/python2.7/site-packages (from paramiko>=2.4->fabric>=2.3.1->niceman==0.1.0) (3.1.5)
Requirement already satisfied, skipping upgrade: pycparser in ./venvs/dev-isolated/lib/python2.7/site-packages (from cffi!=1.11.3,>=1.7->cryptography>=1.5->niceman==0.1.0) (2.19)
Collecting scandir; python_version < "3.5" (from pathlib2>=2.2.0; python_version < "3.6"->pytest>=3.3.0->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
Collecting docutils>=0.10 (from botocore<1.13.0,>=1.12.74->boto3->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/50/09/c53398e0005b11f7ffb27b7aa720c617aba53be4fb4f4f3f06b9b5c60f28/docutils-0.14-py2-none-any.whl (543kB)
    100% |████████████████████████████████| 552kB 2.1MB/s 
Collecting python-dateutil<3.0.0,>=2.1; python_version >= "2.7" (from botocore<1.13.0,>=1.12.74->boto3->niceman==0.1.0)
  Using cached https://files.pythonhosted.org/packages/74/68/d87d9b36af36f44254a8d512cbfc48369103a3b9e474be9bdfe536abfc45/python_dateutil-2.7.5-py2.py3-none-any.whl
Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" (from s3transfer<0.2.0,>=0.1.10->boto3->niceman==0.1.0)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: atomicwrites, scandir, pathlib2, py, pluggy, more-itertools, pytest, jmespath, docutils, python-dateutil, botocore, futures, s3transfer, boto3, pyparsing, isodate, rdflib, backports.ssl-match-hostname, websocket-client, docker-pycreds, docker-py, dockerpty, python-debian, niceman
  Found existing installation: niceman 0.1.0
    Not uninstalling niceman at /home/yoh/proj/repronim/niceman, outside environment /home/yoh/proj/repronim/niceman/venvs/dev-isolated
    Can't uninstall 'niceman'. No files were found to uninstall.
  Running setup.py develop for niceman
Successfully installed atomicwrites-1.2.1 backports.ssl-match-hostname-3.5.0.1 boto3-1.9.74 botocore-1.12.74 docker-py-1.10.6 docker-pycreds-0.4.0 dockerpty-0.4.1 docutils-0.14 futures-3.2.0 isodate-0.6.0 jmespath-0.9.3 more-itertools-5.0.0 niceman pathlib2-2.3.3 pluggy-0.8.0 py-1.7.0 pyparsing-2.3.0 pytest-4.1.0 python-dateutil-2.7.5 python-debian-0.1.33 rdflib-4.2.2 s3transfer-0.1.13 scandir-1.9.0 websocket-client-0.54.0
pip install -e '.[full]' --upgrade  5.14s user 0.80s system 84% cpu 6.990 total
(dev-isolated) 1 12239.....................................:Mon 07 Jan 2019 11:53:01 AM EST:.
(git)hopa:~/proj/repronim/niceman[nf-run]git
$> niceman ls                        
RESOURCE NAME        TYPE                 ID                  STATUS    
-------------        ----                 --                  ------    
debian-testing-conda docker-container     e41aa8f26a77ec2dacd running   
discovery            ssh                  88a9e369-7780-489e- N/A       
localshell           shell                thebest             available 
my-nitrc             aws-ec2              i-0a75e1cc6adfe2158 running   
smaug                ssh                  8b253827-9133-4a3b- N/A       
smaug-test           ssh                  16412f12-8d99-48e7- N/A       
test                 docker-container     c6f0d0afcdc48a93c10 running   

@kyleam
Copy link
Contributor

kyleam commented Jan 7, 2019

FWIW, tried in an "isolated" (no system site packages) virtualenv with the same effect

I'm confused by that because I don't think the ssladapter module should be visible. I see this error:

$ virtualenv ~/src/python/venvs/niceman-343
$ source ~/src/python/venvs/niceman-343/bin/activate
$ pip install -e ~/src/python/niceman
$ niceman ls
RESOURCE NAME        TYPE                 ID                  STATUS    
-------------        ----                 --                  ------    
2019-01-07 12:13:24,721 [ERROR  ] Failed to import resource: No module named docker [docker_container.py:<module>:12] [base.py:factory:149] (ResourceError)

which matches my expectations.

@yarikoptic
Copy link
Member Author

FWIW -- here is two niceman traces: http://www.onerussian.com/tmp/niceman-traces-1.tgz
one from .[full] and another one from .
@chaselgrove - it is a nice real use-case sample for the diff functionality

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants