ceph-ansible in docker, radosgw installed only on one host

[fxpester]

ubuntu 16.04
ceph-ansible in docker
default site-docker.yml

logs: https://pastebin.com/mLSTRdK8

hosts file:

 [mons]
1.1.1.5
1.1.1.7
1.1.1.6
 [osds]
1.1.1.5
1.1.1.7
1.1.1.6
 [rgws]
1.1.1.5
1.1.1.7
1.1.1.6
 [clients]
1.1.1.5
1.1.1.7
1.1.1.6

apt history on sucsess hosts:

Start-Date: 2017-07-21  15:44:13
Commandline: /usr/bin/apt-get -y -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold install ceph -t xenial
Install: libradosstriper1:amd64 (11.2.0-1xenial, automatic), libsnappy1v5:amd64 (1.1.3-2, automatic), ceph-common:amd64 (11.2.0-1xenial, automatic), liblttng-ust0:amd64 (2.7.1-1, automatic), python-blinker:amd64 (1.3.dfsg2-1build1, automatic), javascript-common:amd64 (11, automatic), libnss3-nssdb:amd64 (2:3.28.4-0ubuntu0.16.04.2, automatic), ceph-mds:amd64 (11.2.0-1xenial, automatic), ceph-mgr:amd64 (11.2.0-1xenial, automatic), ceph-mon:amd64 (11.2.0-1xenial, automatic), python-markupsafe:amd64 (0.23-2build2, automatic), ceph-osd:amd64 (11.2.0-1xenial, automatic), binutils:amd64 (2.26.1-1ubuntu1~16.04.3, automatic), libcephfs2:amd64 (11.2.0-1xenial, automatic), librbd1:amd64 (11.2.0-1xenial, automatic), libpython2.7:amd64 (2.7.12-1ubuntu0~16.04.1, automatic), libbabeltrace1:amd64 (1.3.2-1, automatic), libjs-jquery:amd64 (1.11.3+dfsg-4, automatic), libboost-python1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1, automatic), libaio1:amd64 (0.3.110-2, automatic), liburcu4:amd64 (0.9.1-3, automatic), ceph-base:amd64 (11.2.0-1xenial, automatic), python-pyinotify:amd64 (0.9.6-0fakesync1, automatic), librgw2:amd64 (11.2.0-1xenial, automatic), python-flask:amd64 (0.10.1-2build2, automatic), python-rados:amd64 (11.2.0-1xenial, automatic), libtcmalloc-minimal4:amd64 (2.4-0ubuntu5.16.04.1, automatic), python-itsdangerous:amd64 (0.24+dfsg1-1, automatic), python-jinja2:amd64 (2.8-1, automatic), ceph:amd64 (11.2.0-1xenial), python-cephfs:amd64 (11.2.0-1xenial, automatic), ceph-fuse:amd64 (11.2.0-1xenial, automatic), libgoogle-perftools4:amd64 (2.4-0ubuntu5.16.04.1, automatic), libleveldb1v5:amd64 (1.18-5, automatic), libunwind8:amd64 (1.1-4.1, automatic), liblttng-ust-ctl2:amd64 (2.7.1-1, automatic), libbabeltrace-ctf1:amd64 (1.3.2-1, automatic), libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.2, automatic), python-werkzeug:amd64 (0.10.4+dfsg1-1ubuntu1, automatic), librados2:amd64 (11.2.0-1xenial, automatic), libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1, automatic), python-rbd:amd64 (11.2.0-1xenial, automatic), python-rgw:amd64 (11.2.0-1xenial, automatic)
End-Date: 2017-07-21  15:44:47

Start-Date: 2017-07-21  15:44:52
Commandline: /usr/bin/apt-get -y -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold install radosgw
Install: radosgw:amd64 (11.2.0-1xenial), libfcgi0ldbl:amd64 (2.4.0-8.3, automatic)
End-Date: 2017-07-21  15:44:56

if i run apt install radosgw - it installs without problem

[fxpester]

how to reproduce:

root@ceph-on-ubuntu-tests-1:~# cat /etc/ansible/hosts
 [mons]
1.1.1.5
1.1.1.7
1.1.1.6
 [osds]
1.1.1.5
1.1.1.7
1.1.1.6
 [rgws]
1.1.1.5
1.1.1.7
1.1.1.6
 [clients]
1.1.1.5
1.1.1.7
1.1.1.6

---

git clone https://github.com/ceph/ceph-ansible/

cd ceph-ansible

cp site-docker.yml.sample site.yml
cp group_vars/all.yml.sample group_vars/all.yml
cp group_vars/mons.yml.sample group_vars/mons.yml
cp group_vars/osds.yml.sample group_vars/osds.yml


cat <<EOF2 >> group_vars/all.yml
ansible_dir: /root/ceph-ansible
ceph_origin: upstream
ceph_stable: true
containerized_deployment: true
containerized_deployment_with_kv: false
monitor_interface: $3
public_network: $1

monitor_secret: "{{ monitor_keyring.stdout }}"
fsid: "{{ cluster_uuid.stdout }}"
generate_fsid: true

EOF2

cat <<EOF3 >> group_vars/osds.yml
devices:
  - $2
EOF3


ansible-playbook -v site.yml

results:

failed: [1.1.1.5 -> 1.1.1.7] (item=1.1.1.7) => {"failed": true, "item": "1.1.1.7", "msg": "Could not find the requested service ceph-radosgw@rgw.ceph-on-ubuntu-tests-1: host"}

PLAY RECAP ******************************************************************************************************************************************************************************************
1.1.1.5                    : ok=149  changed=32   unreachable=0    failed=1
1.1.1.6                    : ok=140  changed=29   unreachable=0    failed=0
1.1.1.7                    : ok=59   changed=10   unreachable=0    failed=1

[fxpester]

dirty fix:
/root/ceph-ansible/roles/ceph-rgw/tasks/docker/start_docker_rgw.yml
add line 10: " register: docker_rgw_systemd_unit_generated"

/root/ceph-ansible/roles/ceph-common/handlers/main.yml
add line 76: " - docker_rgw_systemd_unit_generated"

[leseb]

There are no handlers in the containerized scenario, this PR solves this: #1727

[leseb]

Closed via: #1727