invoke devenv throws "Not Found for url: http+docker://localhost/v1.41/images/redisfab/redis-py:6.2.6-buster/json"

[santosh]

Version:
redis-py: 4.0 branch
redis: is invoke devenv suppose to pull docker images?

Platform:
OS: Amazon Linux 2
Python: 3.7.10

Description:

I'm trying to setup dev environment by following contribution guidelines.

When I do invoke devenv, I see this:

Error: No such container: master
Error: No such container: replica
Error: No such container: sentinel_1
Error: No such container: sentinel_2
Error: No such container: sentinel_3
Error: No such container: redismod
Error: No such container: lots-of-pythons
devenv installed: astor==0.8.1,attrs==21.2.0,backports.entry-points-selectable==1.1.1,black==21.11b1,certifi==2021.10.8,charset-normalizer==2.0.8,click==8.0.3,coverage==6.2,distlib==0.3.3,docker==5.0.3,filelock==3.4.0,flake8==4.0.1,flynt==0.69,idna==3.3,importlib-metadata==4.2.0,iniconfig==1.1.1,invoke==1.6.0,isort==5.10.1,mccabe==0.6.1,mypy-extensions==0.4.3,packaging==21.3,pathspec==0.9.0,platformdirs==2.4.0,pluggy==1.0.0,py==1.11.0,pycodestyle==2.8.0,pyflakes==2.4.0,pyparsing==3.0.6,pytest==6.2.5,pytest-cov==3.0.0,pytest-timeout==2.0.1,regex==2021.11.10,requests==2.26.0,six==1.16.0,toml==0.10.2,tomli==1.2.2,tox==3.24.4,tox-docker==3.1.0,typed-ast==1.5.0,typing_extensions==4.0.1,ujson==4.3.0,urllib3==1.26.7,virtualenv==20.10.0,vulture==2.3,websocket-client==1.2.1,zipp==3.6.0
devenv docker: pull 'redisfab/redis-py:6.2.6-buster' (from 'master')
___________________________________ summary ____________________________________
  devenv: commands succeeded
  congratulations :)
Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/redisfab/redis-py:6.2.6-buster/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 256, in tox_runtest_pre
    docker.images.get(image)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/images.py", line 314, in get
    return self.prepare_model(self.client.api.inspect_image(name))
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/image.py", line 252, in inspect_image
    self._get(self._url("/images/{0}/json", image)), True
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/redisfab/redis-py:6.2.6-buster/json: Not Found ("no such image: redisfab/redis-py:6.2.6-buster: No such image: redisfab/redis-py:6.2.6-buster")

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/redisfab/redis-py:6.2.6-buster/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 203, in cleanup
    yield
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 197, in runcommand
    return self.subcommand_test()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 225, in subcommand_test
    run_sequential(self.config, self.venv_dict)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/commands/run/sequential.py", line 22, in run_sequential
    runtestenv(venv, config)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/commands/run/sequential.py", line 73, in runtestenv
    config.pluginmanager.hook.tox_runtest_pre(venv=venv)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 260, in tox_runtest_pre
    docker.images.pull(name, tag=tag or None)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/images.py", line 454, in pull
    repository, tag, '@' if tag.startswith('sha256:') else ':'
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/images.py", line 314, in get
    return self.prepare_model(self.client.api.inspect_image(name))
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/image.py", line 252, in inspect_image
    self._get(self._url("/images/{0}/json", image)), True
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/redisfab/redis-py:6.2.6-buster/json: Not Found ("no such image: redisfab/redis-py:6.2.6-buster: No such image: redisfab/redis-py:6.2.6-buster")

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/bin/tox", line 8, in <module>
    sys.exit(cmdline())
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 44, in cmdline
    main(args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 69, in main
    exit_code = session.runcommand()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 197, in runcommand
    return self.subcommand_test()
  File "/usr/lib64/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 205, in cleanup
    self.hook.tox_cleanup(session=self)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 370, in tox_cleanup
    stop_containers(venv)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 381, in stop_containers
    for container_name, container in envconfig._docker_containers.items():
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/config/__init__.py", line 1042, in __getattribute__
    rv = object.__getattribute__(self, name)
AttributeError: 'TestenvConfig' object has no attribute '_docker_containers'

How to setup dev environment correctly?

[chayim]

Hi @santosh what version of docker are you running (docker --version)? Testing on Docker version 20.10.9, build c2ea9bc90b and the latest master branch everything pulls accordingly. It looks like a docker burp - which I see from time to time, and I can't reproduce this.

However, I just pushed up a PR to lock the pythons docker to latst - as in some versions of docker this could be an issue.

I validated by blowing away all of my docker images via docker image prune --all --force and then running invoke devenv. Please let me know if you have issues - using the change linked in the PR.

[chayim]

Reopened pending feedback. But the PR merged to master should address and close this.

[santosh]

I forgot to mention the docker version. It's version 20.10.7, build f0df350 on Amazon Linux 2.

Thanks you for the quick response. The invoke devenv succeeds.

But invoke tests fails with similar error. Below is the traceback:

$ invoke tests
Starting Redis tests
GLOB sdist-make: /efs/repos/redis-py/setup.py
standalone-plain inst-nodeps: /efs/repos/redis-py/.tox/.tmp/package/2/redis-4.1.0rc2.zip
standalone-plain installed: astor==0.8.1,attrs==21.2.0,backports.entry-points-selectable==1.1.1,black==21.11b1,certifi==2021.10.8,charset-normalizer==2.0.8,click==8.0.3,coverage==6.2,Deprecated==1.2.3,distlib==0.3.3,docker==5.0.3,filelock==3.4.0,flake8==4.0.1,flynt==0.69,idna==3.3,importlib-metadata==4.2.0,iniconfig==1.1.1,invoke==1.6.0,isort==5.10.1,mccabe==0.6.1,mypy-extensions==0.4.3,packaging==21.3,pathspec==0.9.0,platformdirs==2.4.0,pluggy==1.0.0,py==1.11.0,pycodestyle==2.8.0,pyflakes==2.4.0,pyparsing==3.0.6,pytest==6.2.5,pytest-cov==3.0.0,pytest-timeout==2.0.1,redis @ file:///efs/repos/redis-py/.tox/.tmp/package/2/redis-4.1.0rc2.zip,regex==2021.11.10,requests==2.26.0,six==1.16.0,toml==0.10.2,tomli==1.2.2,tox==3.24.4,tox-docker==3.1.0,typed-ast==1.5.0,typing_extensions==4.0.1,ujson==4.3.0,urllib3==1.26.7,virtualenv==20.10.0,vulture==2.3,websocket-client==1.2.1,wrapt==1.13.3,zipp==3.6.0
standalone-plain docker: run 'redisfab/redis-py:6.2.6-buster' (from 'master')
___________________________________ summary ____________________________________
  standalone-plain: commands succeeded
ERROR:   standalone-hiredis: undefined
ERROR:   cluster-plain: undefined
ERROR:   cluster-hiredis: undefined
Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 409 Client Error: Conflict for url: http+docker://localhost/v1.41/containers/create?name=master

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 203, in cleanup
    yield
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 197, in runcommand
    return self.subcommand_test()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 225, in subcommand_test
    run_sequential(self.config, self.venv_dict)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/commands/run/sequential.py", line 22, in run_sequential
    runtestenv(venv, config)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/commands/run/sequential.py", line 73, in runtestenv
    config.pluginmanager.hook.tox_runtest_pre(venv=venv)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 313, in tox_runtest_pre
    mounts=container_config.get("mounts", []),
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/containers.py", line 820, in run
    detach=detach, **kwargs)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/containers.py", line 878, in create
    resp = self.client.api.create_container(**create_kwargs)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/container.py", line 428, in create_container
    return self.create_container_from_config(config, name)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/container.py", line 439, in create_container_from_config
    return self._result(res, True)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 409 Client Error for http+docker://localhost/v1.41/containers/create?name=master: Conflict ("Conflict. The container name "/master" is already in use by container "f222eff92d408480ad9bef2e0385572db501faf7e1ce7d926cdb8371b233e8c8". You have to remove (or rename) that container to be able to reuse that name.")

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/bin/tox", line 8, in <module>
    sys.exit(cmdline())
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 44, in cmdline
    main(args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 69, in main
    exit_code = session.runcommand()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 197, in runcommand
    return self.subcommand_test()
  File "/usr/lib64/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 205, in cleanup
    self.hook.tox_cleanup(session=self)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 370, in tox_cleanup
    stop_containers(venv)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 381, in stop_containers
    for container_name, container in envconfig._docker_containers.items():
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/config/__init__.py", line 1042, in __getattribute__
    rv = object.__getattribute__(self, name)
AttributeError: 'TestenvConfig' object has no attribute '_docker_containers'

[chayim]

Can you do me a favour and remove all your docker images, as well as restarting the docker daemon? I can't reproduce this unfortunately :(

[chayim]

Taking this a step further, can you also run invoke clean? It may be that you have dockers in a strange state - so please do so prior to removing the docker images and restarting the daemon.

I just ran invoke tests on my new amzn2 machine with the same versions of docker. I should also mention that I ensured I ran python3, given that we're python3.6+ only.

[santosh]

Okay, so I:

• Cleaned all the containers as well as images from docker's cache. docker rm $(docker ps -aq) && docker rmi $(docker images -q)
• Ran invoke clean
• Restarted docker daemon. sudo systemctl restart docker.service
• Ran invoke devenv
• Ran invoke tests

And I can confirm the same error. i.e.:

docker.errors.APIError: 409 Client Error for http+docker://localhost/v1.41/containers/create?name=master: Conflict ("Conflict. The container name "/master" is already in use by container "7d307947a8620c75207c35f1af8f5ac48fb6293ae7ee1df145d2c027696f2fa4". You have to remove (or rename) that container to be able to reuse that name.")

---

I also confirm that I'm in a venv. Python version for which is 3.7.10.

[santosh]

I just spun up a new instance for testing.

Ran invoke devenv (with latest updates you made).

I get the same error before the fix you made.

[chayim]

docker.errors.APIError: 409 Client Error for http+docker://localhost/v1.41/containers/create?name=master: Conflict ("Conflict. The container name "/master" is already in use by container "7d307947a8620c75207c35f1af8f5ac48fb6293ae7ee1df145d2c027696f2fa4". You have to remove (or rename) that container to be able to reuse that name.")

This points to needing an invoke clean first, as there are still containers with the name name. I ended up taking a fresh workload, doing an install of docker (straight, from yum, as is), and adding my user ec2-user to the docker group. Then I logged out and back in. I cloned the repo, and then ran invoke tests.

Could this be a permissions error? Does the user you're using have the requisite permissions to run docker commands?

[santosh]

I'm inside the docker group:

$ invoke clean
master
replica
sentinel_1
sentinel_2
sentinel_3
redismod
lots-of-pythons
redis_cluster
(.venv) ec2-user at ip-10-2-1-250 in /efs/repos/redis-py (master)
$ groups
ec2-user adm wheel systemd-journal docker
(.venv) ec2-user at ip-10-2-1-250 in /efs/repos/redis-py (master)
$ invoke devenv
Error: No such container: master
Error: No such container: replica
Error: No such container: sentinel_1
Error: No such container: sentinel_2
Error: No such container: sentinel_3
Error: No such container: redismod
Error: No such container: lots-of-pythons
Error: No such container: redis_cluster
devenv installed: astor==0.8.1,attrs==21.2.0,backports.entry-points-selectable==1.1.1,black==21.11b1,certifi==2021.10.8,charset-normalizer==2.0.8,click==8.0.3,coverage==6.2,distlib==0.3.3,docker==5.0.3,filelock==3.4.0,flake8==4.0.1,flynt==0.69,idna==3.3,importlib-metadata==4.2.0,iniconfig==1.1.1,invoke==1.6.0,isort==5.10.1,mccabe==0.6.1,mypy-extensions==0.4.3,packaging==21.3,pathspec==0.9.0,platformdirs==2.4.0,pluggy==1.0.0,py==1.11.0,pycodestyle==2.8.0,pyflakes==2.4.0,pyparsing==3.0.6,pytest==6.2.5,pytest-cov==3.0.0,pytest-timeout==2.0.1,regex==2021.11.10,requests==2.26.0,six==1.16.0,toml==0.10.2,tomli==1.2.2,tox==3.24.4,tox-docker==3.1.0,typed-ast==1.5.0,typing_extensions==4.0.1,ujson==4.3.0,urllib3==1.26.7,virtualenv==20.10.0,vulture==2.3,websocket-client==1.2.1,zipp==3.6.0
devenv docker: run 'redisfab/redis-py:6.2.6-buster' (from 'master')
devenv docker: run 'redisfab/redis-py:6.2.6-buster' (from 'replica')
devenv docker: run 'redisfab/redis-py-sentinel:6.2.6-buster' (from 'sentinel_1')
devenv docker: run 'redisfab/redis-py-sentinel:6.2.6-buster' (from 'sentinel_2')
devenv docker: run 'redisfab/redis-py-sentinel:6.2.6-buster' (from 'sentinel_3')
devenv docker: run 'redisfab/redis-py-cluster:6.2.6-buster' (from 'redis_cluster')
devenv docker: run 'redislabs/redismod:edge' (from 'redismod')
devenv docker: run 'redisfab/lots-of-pythons:latest' (from 'lots-of-pythons')
devenv run-test-pre: PYTHONHASHSEED='4073091618'
devenv run-test: commands[0] | /usr/bin/echo

devenv docker: leave 'b02e777c21' (from 'master') running
devenv docker: leave '9170b5aa3c' (from 'replica') running
devenv docker: leave '496914ea2a' (from 'sentinel_1') running
devenv docker: leave '838f7fed9d' (from 'sentinel_2') running
devenv docker: leave 'c6d75fbc6c' (from 'sentinel_3') running
devenv docker: leave '0bd489dc1f' (from 'redis_cluster') running
devenv docker: leave 'd8770422bc' (from 'redismod') running
devenv docker: leave '21c4670bfd' (from 'lots-of-pythons') running
___________________________________ summary ____________________________________
  devenv: commands succeeded
  congratulations :)
(.venv) ec2-user at ip-10-2-1-250 in /efs/repos/redis-py (master)
$ invoke tests
Starting Redis tests
GLOB sdist-make: /efs/repos/redis-py/setup.py
standalone-plain inst-nodeps: /efs/repos/redis-py/.tox/.tmp/package/5/redis-4.1.0rc2.zip
standalone-plain installed: astor==0.8.1,attrs==21.2.0,backports.entry-points-selectable==1.1.1,black==21.11b1,certifi==2021.10.8,charset-normalizer==2.0.8,click==8.0.3,coverage==6.2,Deprecated==1.2.3,distlib==0.3.3,docker==5.0.3,filelock==3.4.0,flake8==4.0.1,flynt==0.69,idna==3.3,importlib-metadata==4.2.0,iniconfig==1.1.1,invoke==1.6.0,isort==5.10.1,mccabe==0.6.1,mypy-extensions==0.4.3,packaging==21.3,pathspec==0.9.0,platformdirs==2.4.0,pluggy==1.0.0,py==1.11.0,pycodestyle==2.8.0,pyflakes==2.4.0,pyparsing==3.0.6,pytest==6.2.5,pytest-cov==3.0.0,pytest-timeout==2.0.1,redis @ file:///efs/repos/redis-py/.tox/.tmp/package/5/redis-4.1.0rc2.zip,regex==2021.11.10,requests==2.26.0,six==1.16.0,toml==0.10.2,tomli==1.2.2,tox==3.24.4,tox-docker==3.1.0,typed-ast==1.5.0,typing_extensions==4.0.1,ujson==4.3.0,urllib3==1.26.7,virtualenv==20.10.0,vulture==2.3,websocket-client==1.2.1,wrapt==1.13.3,zipp==3.6.0
standalone-plain docker: run 'redisfab/redis-py:6.2.6-buster' (from 'master')
___________________________________ summary ____________________________________
  standalone-plain: commands succeeded
ERROR:   standalone-hiredis: undefined
ERROR:   cluster-plain: undefined
ERROR:   cluster-hiredis: undefined
Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 409 Client Error: Conflict for url: http+docker://localhost/v1.41/containers/create?name=master

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 203, in cleanup
    yield
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 197, in runcommand
    return self.subcommand_test()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 225, in subcommand_test
    run_sequential(self.config, self.venv_dict)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/commands/run/sequential.py", line 22, in run_sequential
    runtestenv(venv, config)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/commands/run/sequential.py", line 73, in runtestenv
    config.pluginmanager.hook.tox_runtest_pre(venv=venv)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 313, in tox_runtest_pre
    mounts=container_config.get("mounts", []),
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/containers.py", line 820, in run
    detach=detach, **kwargs)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/models/containers.py", line 878, in create
    resp = self.client.api.create_container(**create_kwargs)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/container.py", line 428, in create_container
    return self.create_container_from_config(config, name)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/container.py", line 439, in create_container_from_config
    return self._result(res, True)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 409 Client Error for http+docker://localhost/v1.41/containers/create?name=master: Conflict ("Conflict. The container name "/master" is already in use by container "b02e777c21ec87efc891a0fc5c7bd2ad1e7330768a1ee47a44a5a7b3385d9bc9". You have to remove (or rename) that container to be able to reuse that name.")

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/efs/repos/redis-py/.venv/bin/tox", line 8, in <module>
    sys.exit(cmdline())
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 44, in cmdline
    main(args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 69, in main
    exit_code = session.runcommand()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 197, in runcommand
    return self.subcommand_test()
  File "/usr/lib64/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/session/__init__.py", line 205, in cleanup
    self.hook.tox_cleanup(session=self)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 370, in tox_cleanup
    stop_containers(venv)
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox_docker/__init__.py", line 381, in stop_containers
    for container_name, container in envconfig._docker_containers.items():
  File "/efs/repos/redis-py/.venv/lib64/python3.7/site-packages/tox/config/__init__.py", line 1042, in __getattribute__
    rv = object.__getattribute__(self, name)
AttributeError: 'TestenvConfig' object has no attribute '_docker_containers'

[chayim]

@santosh From your debug output it would appear that you have another docker running named master - even though the invoke clean should have cleaned that out. It would appear to be environmental.

I've just validated on two clean machines, and unfortunately can't reproduce this. After your invoke clean can you provide me the output of docker ps? I'm trying to understand why you have a docker running named master based on the outputs above.