Playbook ansible with vagrant raises error because of task docker_service.

[JorisLA]

ISSUE TYPE

• Bug Report

COMPONENT NAME

Task docker_service

ANSIBLE VERSION

ansible 2.3.0.0
  config file = /etc/ansible/ansible.cfg
  configured module search path = Default w/o overrides

CONFIGURATION

No changes

OS / ENVIRONMENT

Running Ansible from ubuntu 16.04 LTS.
Managing Ansible from a VM (debian 8 jessie)

SUMMARY

Using docker_service to do a 'docker-compose up'. At the end a FAILED message appears but the containers runs properly in the VM.

STEPS TO REPRODUCE

---
- hosts: localhost
  become: yes
    - docker_service:
        project_src: /vagrant
        state: present

This is a part of my Vagrantfile

 config.vm.box = "debian/jessie64"

 config.vm.network "forwarded_port", guest: 8080, host: 8080

 config.vm.provision "ansible" do |ansible|
      ansible.groups = {
        'localhost' => ['default']
      }
      ansible.playbook = "bootstrap.yml"
 end

This is my docker-compose.yml

version: '2'

services:
  backend:
    build:
      context: backend/
      args:
        TAIGA_SECRET_KEY: ${TAIGA_SECRET_KEY}
        TAIGA_HOSTNAME: ${TAIGA_HOSTNAME}
        # To use an external SMTP for emails, fill in these values:
        TAIGA_ENABLE_EMAIL: ${TAIGA_ENABLE_EMAIL}
        TAIGA_EMAIL_FROM: ${TAIGA_EMAIL_FROM}
        TAIGA_EMAIL_USE_TLS: ${TAIGA_EMAIL_USE_TLS}
        TAIGA_EMAIL_HOST: ${TAIGA_EMAIL_HOST}
        TAIGA_EMAIL_PORT: ${TAIGA_EMAIL_PORT}
        TAIGA_EMAIL_USER: ${TAIGA_EMAIL_USER}
        TAIGA_EMAIL_PASS: ${TAIGA_EMAIL_PASS}
        RABBITMQ_DEFAULT_USER: ${RABBITMQ_DEFAULT_USER}
        RABBITMQ_DEFAULT_PASS: ${RABBITMQ_DEFAULT_PASS}
        RABBITMQ_DEFAULT_VHOST: ${RABBITMQ_DEFAULT_VHOST}
    volumes:
      - ./media:/usr/src/taiga-back/media
    environment:
      # Database settings
      # To use an external database, simply update these and remove the postgres
      # service from this docker-compose.yml file
      TAIGA_DB_NAME: ${TAIGA_DB_NAME}
      TAIGA_DB_HOST: ${TAIGA_DB_HOST}
      TAIGA_DB_USER: ${TAIGA_DB_USER}
      TAIGA_DB_PASSWORD: ${TAIGA_DB_PASSWORD}
      TAIGA_SLEEP: 15 # when the db comes up from docker, it is usually too quick
      RABBIT_PORT: 5672
      REDIS_PORT: 6379

  frontend:
    build: frontend/
    ports:
      - "80:80"
    environment:
      # Your hostname (REQUIRED)
      TAIGA_HOSTNAME: ${TAIGA_HOSTNAME}
    depends_on:
      - backend

  rabbitmq:
    image: rabbitmq:latest
    hostname: rabbitmq
    command: rabbitmq-server
    ports:
      - '5672:5672'
      - '15672:15672'
    environment:
      # https://www.rabbitmq.com/clustering.html#erlang-cookie
      #- RABBITMQ_ERLANG_COOKIE='secret_cookie_here'
      RABBITMQ_DEFAULT_USER: ${RABBITMQ_DEFAULT_USER}
      RABBITMQ_DEFAULT_PASS: ${RABBITMQ_DEFAULT_PASS}
      RABBITMQ_DEFAULT_VHOST: ${RABBITMQ_DEFAULT_VHOST}
      # http://www.rabbitmq.com/configure.html#config-items
      # - RABBITMQ_HIPE_COMPILE=1

  redis:
    image: redis:latest
    command: redis-server
    ports:
      - '6379:6379'

  events:
    hostname: events
    build: events/
    environment:
      TAIGA_SECRET_KEY: ${TAIGA_SECRET_KEY}
      RABBITMQ_DEFAULT_USER: ${RABBITMQ_DEFAULT_USER}
      RABBITMQ_DEFAULT_PASS: ${RABBITMQ_DEFAULT_PASS}
      RABBITMQ_DEFAULT_VHOST: ${RABBITMQ_DEFAULT_VHOST}
    command: ['coffee','index.coffee']

EXPECTED RESULTS

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
ok: [default]

TASK [docker_service] **************************************************
ok: [default]

ACTUAL RESULTS

TASK [docker_service] **********************************************************
fatal: [default]: FAILED! => {
"changed": false, "failed": true,
"module_stderr": "Shared connection to 127.0.0.1 closed.\r\n",
"module_stdout": "Traceback (most recent call last):\r\n
File \"/tmp/ansible_yvaFKx/ansible_module_docker_service.py\", line 1016,
in <module>\r\n    main()\r\n  File \"/tmp/ansible_yvaFKx/ansible_module_docker_service.py\",
line 1011, in main\r\n
result = ContainerManager(client).exec_module()\r\n
File \"/tmp/ansible_yvaFKx/ansible_module_docker_service.py\",
line 608, in exec_module\r\n    result = self.cmd_up()\r\n
File \"/tmp/ansible_yvaFKx/ansible_module_docker_service.py\",
line 703, in cmd_up\r\n    get_stdout(fd_name)\r\n
File \"/tmp/ansible_yvaFKx/ansible_module_docker_service.py\",
line 512, in get_stdout\r\n    new_line = re.sub(r'\\x1b\\[.+m', '',
line.encode('ascii'))\r\n
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 0:
 ordinal not in range(128)\r\n",
 "msg": "MODULE FAILURE", "rc": 0}

[snowsky]

What is the output on your terminal, echo $LANG?

[surudoiryu]

Got the same error also with docker_service in my project:

Ansible task:

- name: Run Docker-Compose from project
  docker_service:
    build: yes
    project_name: project
    project_src: /var/www

Docker-compose:

version: '3'
services:
  web:
    build:
      context: .
      dockerfile: web.docker
    volumes:
      - .:/var/www
    ports:
      - 80:80
    links:
      - app
  app:
    build:
      context: .
      dockerfile: app.docker
    volumes:
      - .:/var/www
    links:
      - db
      - cache
    environment:
      - DB_PORT=3306
      - DB_HOST=db
      - REDIS_PORT=6379
      - REDIS_HOST=cache
  db:
    image: mysql:5.7
    environment:
      - MYSQL_ROOT_PASSWORD=secret
      - MYSQL_DATABASE=project
    ports:
      - 3306:3306
  cache:
    image: redis:latest
    ports:
      - 6379:6379

Error:

Traceback (most recent call last):\r\n  
File \"/tmp/ansible_p8pdzrpz/ansible_module_docker_service.py\", line 1016, in <module>\r\n    
main()\r\n  
File \"/tmp/ansible_p8pdzrpz/ansible_module_docker_service.py\", line 1011, in main\r\n    
result = ContainerManager(client).exec_module()\r\n  
File \"/tmp/ansible_p8pdzrpz/ansible_module_docker_service.py\", line 608, in exec_module\r\n    
result = self.cmd_up()\r\n  
File \"/tmp/ansible_p8pdzrpz/ansible_module_docker_service.py\", line 703, in cmd_up\r\n 
get_stdout(fd_name)\r\n  
File \"/tmp/ansible_p8pdzrpz/ansible_module_docker_service.py\", line 512, in get_stdout\r\n    
new_line = re.sub(r'\\x1b\\[.+m', '', line.encode('ascii'))\r\n  
File \"/usr/lib/python3.5/re.py\", line 182, in sub\r\n    
return _compile(pattern, flags).sub(repl, string, count)\r\n
TypeError: cannot use a string pattern on a bytes-like object\r\n
", "msg": "MODULE FAILURE", "rc": 0}

[alikins]

@surudoiryu

Got the same error also with docker_service in my project:

Got the same error as what? #23607 (comment) is not the same as the error in #23607 (comment)

#23607 (comment) looks to be a python3 compatibility error and likely should be a different issue.

[JorisLA]

@snowsky
=> fr_FR.UTF-8

[surudoiryu]

@alikins
Aah i see now, i wasn't watching the last part -_-" my bad, it just looked a lot like this problem.

[snowsky]

Will replacing acsii with utf-8 fix this issue?

[snowsky]

Try this command before ansible-playbook:

export PYTHONIOENCODING=utf-8

[JorisLA]

It doesn't fix it, same error.

[snowsky]

I cannot reproduce. Could you please try 6ec4f18?

[sivel]

I can produce this. I believe the appropriate fix is actually the following:

diff --git a/lib/ansible/modules/cloud/docker/docker_service.py b/lib/ansible/modules/cloud/docker/docker_service.py
index 785e8c9..34fab3b 100644
--- a/lib/ansible/modules/cloud/docker/docker_service.py
+++ b/lib/ansible/modules/cloud/docker/docker_service.py
@@ -480,6 +480,7 @@ except ImportError as exc:
     DEFAULT_TIMEOUT = 10
 
 from ansible.module_utils.docker_common import *
+from ansible.module_utils._text import to_native
 from contextlib import contextmanager
 
 
@@ -509,11 +510,11 @@ def get_stdout(path_name):
     with open(path_name, 'r') as fd:
         for line in fd:
             # strip terminal format/color chars
-            new_line = re.sub(r'\x1b\[.+m', '', line.encode('ascii'))
+            new_line = re.sub(r'\x1b\[.+m', '', to_native(line))
             full_stdout += new_line
             if new_line.strip():
                 # Assuming last line contains the error message
-                last_line = new_line.strip().encode('utf-8')
+                last_line = to_native(new_line.strip())
     fd.close()
     os.remove(path_name)
     return full_stdout, last_line

This error occurs when the "build" phase, outputs non-ascii characters. Which would involve that one of the services from the docker-compose.yml or definitions specify a "build" that would produce a non-ascii character.

[snowsky]

Thanks @sivel, the PR was just updated.

[JorisLA]

Thank you guys !

[ansibot]

cc @chouseknecht
click here for bot help

[Akasurde]

resolved_by_pr #23702

[ansibot]

cc @felixfontein
click here for bot help

[ansibot]

cc @akshay196 @danihodovic @dariko @jwitko @kassiansun @tbouvet
click here for bot help

[ansibot]

cc @DBendit
click here for bot help

[felixfontein]

Please note that the docker_service module will be renamed to docker_compose in Ansible 2.8. You will be able to still use the old name, but you will receive a warning when doing so.

!component =lib/ansible/modules/cloud/docker/docker_compose.py

Also, please note that currently, nobody is actively maintaining the Ansible docker_service/docker_compose modules. If you are interested in working on this issue, please feel free to create a PR :) If you need any help, feel free to ping me or any other of the current docker_* module maintainers.

[ansibot]

cc @WojciechowskiPiotr
click here for bot help

[ansibot]

cc @sluther
click here for bot help

[sluther]

I will review the PR, verify that it fixes the issue, and create a new PR.

[ansibot]

Thank you very much for your interest in Ansible. Ansible has migrated much of the content into separate repositories to allow for more rapid, independent development. We are closing this issue/PR because this content has been moved to one or more collection repositories.

• lib/ansible/modules/cloud/docker/docker_compose.py -> https://galaxy.ansible.com/community/general

For further information, please see:
https://github.com/ansible/ansibullbot/blob/master/docs/collection_migration.md